2024-09-10T05:42:02.954 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T05:42:02.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T05:42:03.052 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747 branch: wip-cls-rgw-busy-resharding description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7898747' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cls-rgw-busy-resharding sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4606 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-cls-rgw-busy-resharding suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN74YsQf7ok+W0daKrhBe1hr7iUyYTFmNF2V96yPxEz8goJ9DxfzZGq6+ovxj+KZUPbNel9epvdVAEjRWiDRxcI= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJLyikHWZVbIw9gcdCSAWI/+kdMfIYM45Wh6yNyUDlWM3h6J8HEPKc9uOBhBgURLg8V1e242l+PuwCj97mEzyQA= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_03:24:22 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T05:42:03.052 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa; will attempt to use it 2024-09-10T05:42:03.053 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa/tasks 2024-09-10T05:42:03.053 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T05:42:03.054 INFO:teuthology.task.internal:Checking packages... 2024-09-10T05:42:03.075 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-10T05:42:03.075 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T05:42:03.075 INFO:teuthology.packaging:ref: None 2024-09-10T05:42:03.075 INFO:teuthology.packaging:tag: None 2024-09-10T05:42:03.075 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-10T05:42:03.076 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T05:42:03.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-10T05:42:03.220 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-10T05:42:03.221 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T05:42:03.230 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T05:42:03.230 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T05:42:03.272 INFO:teuthology.task.internal:Saving configuration 2024-09-10T05:42:03.284 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T05:42:03.298 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T05:42:03.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 05:36:22.786194', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDXsVTzZTFnSyWCWpKDWQ83FbqehdcoJxSgsT9uk5dvH'} 2024-09-10T05:42:03.343 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 05:36:22.784841', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBboyaMvy3UvhCH+DHaKzhLCCflFF0ceGdX/Uws7JHGM'} 2024-09-10T05:42:03.343 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T05:42:03.349 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-10T05:42:03.349 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-10T05:42:03.349 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T05:42:03.418 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5a24143a0>, signals=[15]) 2024-09-10T05:42:03.418 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T05:42:03.424 INFO:teuthology.task.internal:Opening connections... 2024-09-10T05:42:03.424 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T05:42:03.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:42:03.503 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T05:42:03.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:42:03.579 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T05:42:03.585 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-10T05:42:03.590 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-10T05:42:03.590 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-10T05:42:03.637 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T05:42:03.638 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2024-09-10T05:42:03.639 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-10T05:42:03.652 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-10T05:42:03.657 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-10T05:42:03.657 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T05:42:03.703 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T05:42:03.704 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2024-09-10T05:42:03.704 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-10T05:42:03.719 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T05:42:03.727 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T05:42:03.747 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T05:42:03.747 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-10T05:42:03.750 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-10T05:42:03.754 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T05:42:03.772 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T05:42:03.772 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-10T05:42:03.795 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-10T05:42:03.804 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T05:42:03.851 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T05:42:03.864 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T05:42:03.864 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T05:42:03.864 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T05:42:03.865 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T05:42:03.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:42:03.869 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-10T05:42:03.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:42:03.870 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-10T05:42:03.914 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2024-09-10T05:42:03.914 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.15.0-56-generic 2024-09-10T05:42:03.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-10T05:42:03.919 INFO:teuthology.orchestra.run.smithi098.stdout:5.15.0-56-generic 2024-09-10T05:42:03.920 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.15.0-56-generic 2024-09-10T05:42:03.920 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2024-09-10T05:42:04.043 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-10T05:42:04.044 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-10T05:42:04.193 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:42:04.195 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T05:42:04.195 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T05:42:04.204 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:42:04.215 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T05:42:04.263 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T05:42:04.284 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T05:42:04.318 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T05:42:04.439 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T05:42:04.452 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T05:42:04.521 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T05:42:04.524 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T05:42:04.525 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T05:42:04.558 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T05:42:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T05:42:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T05:42:04.561 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T05:42:04.562 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T05:42:04.565 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T05:42:04.565 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T05:42:04.565 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T05:42:04.583 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T05:42:04.584 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T05:42:04.588 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T05:42:04.588 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T05:42:04.590 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T05:42:04.592 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T05:42:04.595 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T05:42:04.595 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T05:42:04.599 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T05:42:04.600 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T05:42:04.601 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T05:42:04.610 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T05:42:04.622 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T05:42:04.622 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T05:42:04.623 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T05:42:04.623 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T05:42:04.623 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T05:42:04.625 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T05:42:04.628 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T05:42:04.640 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T05:42:04.641 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T05:42:04.641 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T05:42:04.642 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T05:42:04.642 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T05:42:04.642 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T05:42:04.643 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T05:42:04.643 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T05:42:04.643 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T05:42:04.643 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T05:42:04.644 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T05:42:04.646 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T05:42:04.646 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T05:42:04.650 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T05:42:04.657 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T05:42:04.658 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T05:42:04.659 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T05:42:04.659 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T05:42:04.659 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T05:42:04.675 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T05:42:04.676 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T05:42:04.676 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T05:42:04.676 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T05:42:04.677 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T05:42:04.677 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T05:42:04.682 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T05:42:04.683 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T05:42:04.683 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T05:42:04.693 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T05:42:04.694 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T05:42:04.694 INFO:teuthology.orchestra.run.smithi098.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T05:42:04.694 INFO:teuthology.orchestra.run.smithi098.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T05:42:04.796 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T05:42:05.214 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T05:42:05.230 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T05:42:05.239 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T05:42:05.239 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T05:42:05.336 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T05:42:05.337 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T05:42:05.348 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T05:42:05.348 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T05:42:05.364 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T05:42:05.390 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T05:42:05.396 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T05:42:05.397 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T05:42:05.397 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T05:42:05.477 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T05:42:05.477 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T05:42:10.791 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 15.8 MB in 2s (7,467 kB/s) 2024-09-10T05:42:10.939 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 15.8 MB in 2s (7,260 kB/s) 2024-09-10T05:42:12.167 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-10T05:42:12.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:42:12.238 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-10T05:42:12.367 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-10T05:42:12.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:42:12.423 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-10T05:42:12.423 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-10T05:42:12.438 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-10T05:42:12.587 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:42:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:42:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:42:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:42:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T05:42:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: python2.7-minimal 2024-09-10T05:42:12.588 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:42:12.589 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-10T05:42:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:42:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T05:42:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T05:42:12.591 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-10T05:42:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T05:42:12.591 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2024-09-10T05:42:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: thermald 2024-09-10T05:42:12.631 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-10T05:42:12.631 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-10T05:42:12.641 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-10T05:42:12.641 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:42:12.641 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T05:42:12.641 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T05:42:12.643 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages will be upgraded: 2024-09-10T05:42:12.643 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T05:42:12.693 INFO:teuthology.orchestra.run.smithi098.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:42:12.693 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 113 MB of archives. 2024-09-10T05:42:12.693 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T05:42:12.694 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T05:42:12.797 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:42:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:42:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:42:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:42:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T05:42:12.798 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2024-09-10T05:42:12.799 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:42:12.800 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-10T05:42:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:42:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T05:42:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T05:42:12.801 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-10T05:42:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T05:42:12.802 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-10T05:42:12.802 INFO:teuthology.orchestra.run.smithi070.stdout: thermald 2024-09-10T05:42:12.850 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-10T05:42:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T05:42:12.850 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T05:42:12.851 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T05:42:12.852 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-09-10T05:42:12.852 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T05:42:12.902 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:42:12.903 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 113 MB of archives. 2024-09-10T05:42:12.903 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T05:42:12.903 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T05:42:13.133 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T05:42:13.232 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T05:42:13.339 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T05:42:13.434 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T05:42:14.049 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T05:42:14.049 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T05:42:14.050 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T05:42:14.170 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T05:42:14.191 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T05:42:14.265 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T05:42:14.265 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T05:42:14.265 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T05:42:14.388 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T05:42:14.409 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T05:42:14.656 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 113 MB in 2s (70.3 MB/s) 2024-09-10T05:42:14.806 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 113 MB in 2s (73.1 MB/s) 2024-09-10T05:42:14.827 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T05:42:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T05:42:16.822 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T05:42:16.826 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:16.909 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:17.013 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T05:42:17.017 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:17.150 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:19.080 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T05:42:19.099 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:19.190 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:19.302 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T05:42:19.323 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:19.413 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:19.648 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T05:42:19.668 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:19.706 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:19.848 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T05:42:19.868 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:19.897 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:26.453 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:42:26.577 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:42:26.601 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:42:26.726 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:42:26.851 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:42:26.972 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:42:27.159 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:42:27.284 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T05:42:27.287 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:42:27.305 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T05:42:27.350 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:42:27.591 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T05:42:27.613 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T05:42:27.649 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:42:33.188 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T05:42:33.225 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:33.263 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:33.455 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T05:42:33.491 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T05:42:33.529 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:35.901 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:42:36.026 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:42:36.167 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T05:42:36.292 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T05:42:36.393 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:42:36.490 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:36.591 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T05:42:36.642 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T05:42:36.720 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:36.755 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:36.856 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T05:42:36.960 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:38.012 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:42:38.012 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T05:42:38.012 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:42:38.012 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T05:42:38.197 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:38.270 INFO:teuthology.orchestra.run.smithi098.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:42:38.270 INFO:teuthology.orchestra.run.smithi098.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T05:42:38.270 INFO:teuthology.orchestra.run.smithi098.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:42:38.271 INFO:teuthology.orchestra.run.smithi098.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T05:42:38.462 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:39.598 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:40.656 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:41.025 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T05:42:41.142 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T05:42:41.269 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:41.334 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T05:42:41.334 INFO:teuthology.orchestra.run.smithi070.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:42:42.008 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T05:42:42.133 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T05:42:42.260 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T05:42:42.328 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T05:42:42.329 INFO:teuthology.orchestra.run.smithi098.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:42:55.921 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T05:42:55.921 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub' 2024-09-10T05:42:55.938 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:42:55.961 INFO:teuthology.orchestra.run.smithi070.stdout:Generating grub configuration file ... 2024-09-10T05:42:56.241 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:42:56.261 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:42:56.549 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:42:56.554 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:42:56.622 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:42:56.628 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:42:56.814 INFO:teuthology.orchestra.run.smithi070.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:42:56.814 INFO:teuthology.orchestra.run.smithi070.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:42:56.814 INFO:teuthology.orchestra.run.smithi070.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:42:56.827 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T05:42:56.827 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub' 2024-09-10T05:42:56.849 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:42:56.850 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-09-10T05:42:56.873 INFO:teuthology.orchestra.run.smithi098.stdout:Generating grub configuration file ... 2024-09-10T05:42:57.138 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:42:57.152 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:42:57.393 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-10T05:42:57.413 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-10T05:42:57.413 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-10T05:42:57.413 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-10T05:42:57.413 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-10T05:42:57.413 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-10T05:42:57.413 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.119.119 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:42:57.414 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-10T05:42:57.414 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T05:42:57.414 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T05:42:57.415 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T05:42:57.415 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T05:42:57.415 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T05:42:57.415 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-10T05:42:57.421 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:42:57.427 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:42:57.489 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:42:57.496 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:42:57.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-10T05:42:57.651 INFO:teuthology.orchestra.run.smithi098.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:42:57.652 INFO:teuthology.orchestra.run.smithi098.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:42:57.652 INFO:teuthology.orchestra.run.smithi098.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:42:57.700 INFO:teuthology.orchestra.run.smithi098.stdout:done 2024-09-10T05:42:57.712 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:42:57.813 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:42:57.896 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:42:57.978 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:42:58.140 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2024-09-10T05:42:58.168 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2024-09-10T05:42:58.168 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2024-09-10T05:42:58.168 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2024-09-10T05:42:58.168 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2024-09-10T05:42:58.168 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 21 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.15.0.119.119 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:42:58.169 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2024-09-10T05:42:58.169 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T05:42:58.170 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T05:42:58.170 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T05:42:58.170 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-10T05:42:58.170 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T05:42:58.170 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2024-09-10T05:42:58.336 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-10T05:42:58.448 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:42:58.572 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:42:58.655 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:42:58.757 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:42:59.145 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-10T05:42:59.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:42:59.216 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-10T05:42:59.407 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-10T05:42:59.408 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-10T05:42:59.575 INFO:teuthology.orchestra.run.smithi070.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T05:42:59.576 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:42:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:42:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:42:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:42:59.576 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:42:59.577 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:42:59.577 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:42:59.618 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:42:59.620 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-10T05:42:59.675 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-10T05:42:59.675 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-10T05:42:59.675 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-10T05:42:59.675 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.119.119 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:42:59.676 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-10T05:42:59.677 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-10T05:42:59.721 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.o1rbMhuYmV 2024-09-10T05:42:59.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub/grub.cfg /tmp/tmp.o1rbMhuYmV 2024-09-10T05:42:59.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.o1rbMhuYmV 2024-09-10T05:42:59.893 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.o1rbMhuYmV is 10KB 2024-09-10T05:42:59.906 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.o1rbMhuYmV 2024-09-10T05:42:59.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T05:42:59.934 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-10T05:42:59.954 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T05:42:59.966 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:42:59.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T05:42:59.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T05:43:00.007 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-10T05:43:00.032 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T05:43:00.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-grub 2024-09-10T05:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-10T05:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-10T05:43:00.364 INFO:teuthology.orchestra.run.smithi098.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T05:43:00.364 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:43:00.364 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:43:00.364 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:43:00.364 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:43:00.365 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:43:00.365 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:43:00.365 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:43:00.404 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T05:43:00.406 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2024-09-10T05:43:00.461 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2024-09-10T05:43:00.461 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2024-09-10T05:43:00.461 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2024-09-10T05:43:00.461 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2024-09-10T05:43:00.461 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 21 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.15.0.119.119 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2024-09-10T05:43:00.462 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2024-09-10T05:43:00.463 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-10T05:43:00.507 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.Mxxq3CUSKN 2024-09-10T05:43:00.507 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Mxxq3CUSKN 2024-09-10T05:43:00.561 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.Mxxq3CUSKN 2024-09-10T05:43:00.676 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.Mxxq3CUSKN is 10KB 2024-09-10T05:43:00.689 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.Mxxq3CUSKN 2024-09-10T05:43:00.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T05:43:00.745 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:43:00.746 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T05:43:00.746 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T05:43:00.810 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T05:43:00.810 DEBUG:teuthology.orchestra.run.smithi098:> sudo update-grub 2024-09-10T05:43:01.254 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2024-09-10T05:43:01.255 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:43:01.257 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-10T05:43:01.451 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:43:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:43:01.690 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:43:01.694 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:43:01.731 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:43:01.736 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:43:01.858 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:43:01.858 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:43:01.858 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:43:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-10T05:43:01.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-10T05:43:02.059 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub' 2024-09-10T05:43:02.060 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T05:43:02.063 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-10T05:43:02.258 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T05:43:02.264 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T05:43:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T05:43:02.517 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T05:43:02.559 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T05:43:02.564 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T05:43:02.710 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T05:43:02.710 INFO:teuthology.orchestra.run.smithi098.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T05:43:02.711 INFO:teuthology.orchestra.run.smithi098.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T05:43:02.733 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-10T05:43:02.751 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-10T05:43:31.918 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T05:43:31.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T05:43:31.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:43:32.754 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T05:43:32.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T05:43:32.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:43:50.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-10T05:43:51.101 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-10T05:43:59.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T05:43:59.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:44:00.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T05:44:00.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:44:02.401 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-10T05:44:03.165 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-10T05:44:14.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T05:44:14.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:44:15.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T05:44:15.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:44:32.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-10T05:44:33.597 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-10T05:44:47.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T05:44:47.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:44:48.133 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-10T05:44:48.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T05:44:48.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:44:48.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T05:44:48.712 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T05:44:48.712 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-10T05:44:48.760 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-119-generic 2024-09-10T05:44:48.760 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T05:44:48.761 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T05:44:48.761 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T05:44:49.621 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-10T05:44:49.761 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T05:44:49.762 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T05:44:50.143 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-10T05:44:50.171 DEBUG:teuthology.parallel:result is None 2024-09-10T05:44:50.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T05:44:50.508 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-10T05:44:50.508 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-10T05:44:50.561 INFO:teuthology.orchestra.run.smithi098.stdout:5.15.0-119-generic 2024-09-10T05:44:50.561 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T05:44:50.561 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T05:44:50.561 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T05:44:51.562 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T05:44:51.562 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T05:44:51.672 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-10T05:44:51.727 DEBUG:teuthology.parallel:result is None 2024-09-10T05:44:51.727 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T05:44:51.738 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T05:44:51.738 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T05:44:51.741 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T05:44:51.746 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T05:44:51.773 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T05:44:51.798 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T05:44:51.799 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T05:44:51.801 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T05:44:51.894 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T05:44:51.901 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T05:44:51.901 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T05:44:51.904 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T05:44:51.923 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:44:51.924 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:44:51.931 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:44:51.931 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T05:44:51.933 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T05:44:51.941 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T05:44:51.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T05:44:51.977 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T05:44:51.990 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T05:44:51.999 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T05:44:51.999 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T05:44:52.033 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T05:44:52.039 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:44:52.085 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:44:52.133 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:44:52.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T05:44:52.189 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T05:44:52.194 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T05:44:52.241 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:44:52.241 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T05:44:52.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-10T05:44:52.331 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-10T05:44:52.475 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T05:44:52.487 INFO:teuthology.task.internal:Starting timer... 2024-09-10T05:44:52.487 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T05:44:52.520 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T05:44:52.534 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2024-09-10T05:44:52.534 DEBUG:teuthology.task.selinux:Excluding smithi098: OS 'ubuntu' does not support SELinux 2024-09-10T05:44:52.534 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T05:44:52.534 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T05:44:52.535 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T05:44:52.535 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T05:44:52.554 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T05:44:52.557 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T05:44:52.673 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T05:44:52.687 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T05:44:52.688 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T05:52:16.699 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2024-09-10T05:52:16.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T05:52:16.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:52:16.786 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-10T05:52:16.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-10T05:52:16.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T05:52:16.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T05:52:16.946 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-10T05:52:17.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-10T05:52:17.021 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T05:52:17.031 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T05:52:17.031 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T05:52:17.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:52:17.034 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T05:52:17.035 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T05:52:17.062 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T05:52:17.062 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Command line: ntpd -gq 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: ---------------------------------------------------- 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: corporation. Support and training for ntp-4 are 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: available at https://www.nwtime.org/support 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: ---------------------------------------------------- 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: proto: precision = 0.043 usec (-24) 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: basedate set to 2022-02-04 2024-09-10T05:52:17.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: gps base set to 2022-02-06 (week 2196) 2024-09-10T05:52:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:52:17.064 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:52:17.064 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:52:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:52:17.065 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T05:52:17.065 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T05:52:17.066 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T05:52:17.066 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2024-09-10T05:52:17.066 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Listen normally on 4 lo [::1]:123 2024-09-10T05:52:17.066 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2024-09-10T05:52:17.066 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:17 ntpd[18414]: Listening on routing socket on fd #22 for interface updates 2024-09-10T05:52:17.088 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T05:52:17.088 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Command line: ntpd -gq 2024-09-10T05:52:17.088 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: ---------------------------------------------------- 2024-09-10T05:52:17.088 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T05:52:17.088 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T05:52:17.089 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: corporation. Support and training for ntp-4 are 2024-09-10T05:52:17.089 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: available at https://www.nwtime.org/support 2024-09-10T05:52:17.089 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: ---------------------------------------------------- 2024-09-10T05:52:17.090 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: proto: precision = 0.044 usec (-24) 2024-09-10T05:52:17.090 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: basedate set to 2022-02-04 2024-09-10T05:52:17.090 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: gps base set to 2022-02-06 (week 2196) 2024-09-10T05:52:17.091 INFO:teuthology.orchestra.run.smithi098.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:52:17.091 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T05:52:17.091 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:52:17.091 INFO:teuthology.orchestra.run.smithi098.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T05:52:17.092 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T05:52:17.092 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T05:52:17.093 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T05:52:17.093 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Listen normally on 3 enp3s0f1 172.21.15.98:123 2024-09-10T05:52:17.093 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Listen normally on 4 lo [::1]:123 2024-09-10T05:52:17.093 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d26b%5]:123 2024-09-10T05:52:17.093 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:17 ntpd[18419]: Listening on routing socket on fd #22 for interface updates 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:18.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:18 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:18.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:18.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:18 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:19 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:19 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:19 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:19 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:19 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:19 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:20.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:20.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:20 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:20.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:20.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:20.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:20.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:20.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:20 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:21.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:21.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:21.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:21.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:21.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:21.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:21.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:21.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:21 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:21 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:21 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:21 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:21 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:21 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:21 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:22.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:22.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:22 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:22.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:22.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:22.091 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:22.091 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:22.091 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:22 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:23.062 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:23 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:23.062 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:23 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:23.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:23 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:23.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:23 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:23.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:23 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:23.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:23 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:23.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:23 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:23.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:23 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:23.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:23 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:23.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:23 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:23.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:23 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:23.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:23 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:24.062 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:24.062 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stdout:10 Sep 05:52:24 ntpd[18414]: ntpd: time slew -0.001702 s 2024-09-10T05:52:24.063 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.001702s 2024-09-10T05:52:24.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T05:52:24.064 INFO:teuthology.orchestra.run.smithi070.stderr:10 Sep 05:52:24 ntpd[18414]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T05:52:24.089 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T05:52:24.090 INFO:teuthology.orchestra.run.smithi098.stdout:10 Sep 05:52:24 ntpd[18419]: ntpd: time slew -0.000568 s 2024-09-10T05:52:24.090 INFO:teuthology.orchestra.run.smithi098.stdout:ntpd: time slew -0.000568s 2024-09-10T05:52:24.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T05:52:24.090 INFO:teuthology.orchestra.run.smithi098.stderr:10 Sep 05:52:24 ntpd[18419]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T05:52:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T05:52:24.113 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-10T05:52:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T05:52:24.137 INFO:teuthology.orchestra.run.smithi098.stdout:============================================================================== 2024-09-10T05:52:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T05:52:24.138 INFO:teuthology.run_tasks:Running task install... 2024-09-10T05:52:24.159 DEBUG:teuthology.task.install:project ceph 2024-09-10T05:52:24.159 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-10T05:52:24.159 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-10T05:52:24.159 INFO:teuthology.task.install:Using flavor: default 2024-09-10T05:52:24.164 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T05:52:24.165 INFO:teuthology.task.install:extra packages: [] 2024-09-10T05:52:24.165 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2024-09-10T05:52:24.166 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-key list | grep Ceph 2024-09-10T05:52:24.220 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T05:52:24.237 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T05:52:24.248 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T05:52:24.248 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T05:52:24.249 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T05:52:24.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T05:52:24.263 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T05:52:24.263 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T05:52:24.264 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T05:52:24.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T05:52:24.394 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-10T05:52:24.394 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-10T05:52:24.406 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-10T05:52:24.407 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-10T05:52:24.505 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:52:24.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T05:52:24.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-10T05:52:24.525 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:52:24.525 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T05:52:24.539 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-10T05:52:24.688 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:52:24.717 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:52:24.732 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:52:24.740 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T05:52:24.750 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:52:24.759 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T05:52:24.761 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T05:52:24.780 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T05:52:24.783 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T05:52:24.801 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T05:52:24.804 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-10T05:52:24.810 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T05:52:24.822 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-10T05:52:24.829 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T05:52:24.831 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-10T05:52:24.850 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-10T05:52:24.890 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T05:52:24.972 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T05:52:25.067 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 29.2 kB in 0s (83.2 kB/s) 2024-09-10T05:52:25.112 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 29.2 kB in 0s (71.2 kB/s) 2024-09-10T05:52:26.027 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-10T05:52:26.043 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-10T05:52:26.102 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-10T05:52:26.107 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-10T05:52:26.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-10T05:52:26.181 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-10T05:52:26.315 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-10T05:52:26.316 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-10T05:52:26.390 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-10T05:52:26.391 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-10T05:52:26.512 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:52:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:52:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:52:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:52:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:52:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:52:26.513 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:52:26.514 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-10T05:52:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T05:52:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T05:52:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T05:52:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T05:52:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:52:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet zip 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-10T05:52:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2024-09-10T05:52:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: btrfs-tools 2024-09-10T05:52:26.584 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T05:52:26.584 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T05:52:26.584 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T05:52:26.584 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T05:52:26.585 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T05:52:26.585 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T05:52:26.585 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T05:52:26.585 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-10T05:52:26.586 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T05:52:26.586 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T05:52:26.586 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T05:52:26.586 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:52:26.587 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T05:52:26.588 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet zip 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-10T05:52:26.589 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2024-09-10T05:52:26.619 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-10T05:52:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T05:52:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T05:52:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T05:52:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T05:52:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T05:52:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T05:52:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T05:52:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T05:52:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T05:52:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T05:52:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T05:52:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:52:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T05:52:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T05:52:26.680 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T05:52:26.681 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 251 MB of archives. 2024-09-10T05:52:26.681 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-10T05:52:26.681 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T05:52:26.690 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-10T05:52:26.690 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T05:52:26.690 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T05:52:26.690 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T05:52:26.690 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T05:52:26.690 INFO:teuthology.orchestra.run.smithi070.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T05:52:26.690 INFO:teuthology.orchestra.run.smithi070.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T05:52:26.691 INFO:teuthology.orchestra.run.smithi070.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T05:52:26.691 INFO:teuthology.orchestra.run.smithi070.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T05:52:26.692 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T05:52:26.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T05:52:26.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T05:52:26.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T05:52:26.693 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T05:52:26.693 INFO:teuthology.orchestra.run.smithi070.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T05:52:26.750 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T05:52:26.750 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 251 MB of archives. 2024-09-10T05:52:26.750 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-10T05:52:26.750 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T05:52:26.763 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-10T05:52:26.783 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T05:52:26.786 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T05:52:26.805 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T05:52:26.836 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-10T05:52:26.839 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T05:52:26.842 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T05:52:26.859 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T05:52:26.866 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T05:52:26.872 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T05:52:26.883 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T05:52:26.887 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T05:52:26.888 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T05:52:26.889 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T05:52:26.897 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T05:52:26.900 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T05:52:26.902 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T05:52:26.903 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T05:52:26.905 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T05:52:26.907 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T05:52:26.920 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T05:52:26.921 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T05:52:26.923 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T05:52:26.923 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T05:52:26.923 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T05:52:26.925 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T05:52:26.925 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T05:52:26.926 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T05:52:26.926 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T05:52:26.926 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T05:52:26.937 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T05:52:26.939 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T05:52:26.939 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T05:52:26.941 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T05:52:26.942 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T05:52:26.943 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T05:52:26.951 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T05:52:26.951 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-10T05:52:26.953 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T05:52:26.955 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T05:52:26.956 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T05:52:26.956 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T05:52:26.959 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T05:52:26.959 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T05:52:26.960 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T05:52:26.960 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T05:52:26.960 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T05:52:26.962 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T05:52:26.962 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T05:52:26.962 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T05:52:26.962 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T05:52:26.973 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T05:52:26.974 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T05:52:26.974 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T05:52:26.977 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T05:52:26.977 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T05:52:26.978 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T05:52:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T05:52:26.979 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T05:52:26.980 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T05:52:26.980 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T05:52:26.990 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T05:52:26.994 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T05:52:26.994 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T05:52:26.996 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T05:52:26.996 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T05:52:26.996 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T05:52:26.997 INFO:teuthology.orchestra.run.smithi098.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T05:52:26.999 INFO:teuthology.orchestra.run.smithi098.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T05:52:27.001 INFO:teuthology.orchestra.run.smithi098.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T05:52:27.001 INFO:teuthology.orchestra.run.smithi098.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T05:52:27.007 INFO:teuthology.orchestra.run.smithi098.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T05:52:27.008 INFO:teuthology.orchestra.run.smithi098.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T05:52:27.011 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T05:52:27.014 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T05:52:27.014 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T05:52:27.015 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T05:52:27.015 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T05:52:27.017 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T05:52:27.017 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T05:52:27.017 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T05:52:27.024 INFO:teuthology.orchestra.run.smithi098.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T05:52:27.025 INFO:teuthology.orchestra.run.smithi098.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T05:52:27.026 INFO:teuthology.orchestra.run.smithi098.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T05:52:27.028 INFO:teuthology.orchestra.run.smithi098.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T05:52:27.029 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T05:52:27.030 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T05:52:27.036 INFO:teuthology.orchestra.run.smithi098.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-10T05:52:27.046 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T05:52:27.047 INFO:teuthology.orchestra.run.smithi098.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-10T05:52:27.054 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T05:52:27.054 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T05:52:27.055 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T05:52:27.055 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T05:52:27.055 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T05:52:27.055 INFO:teuthology.orchestra.run.smithi098.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-10T05:52:27.055 INFO:teuthology.orchestra.run.smithi098.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-10T05:52:27.056 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T05:52:27.057 INFO:teuthology.orchestra.run.smithi098.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-10T05:52:27.057 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T05:52:27.058 INFO:teuthology.orchestra.run.smithi098.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-10T05:52:27.063 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T05:52:27.063 INFO:teuthology.orchestra.run.smithi098.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-10T05:52:27.064 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T05:52:27.069 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-10T05:52:27.081 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T05:52:27.082 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T05:52:27.082 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T05:52:27.083 INFO:teuthology.orchestra.run.smithi098.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T05:52:27.083 INFO:teuthology.orchestra.run.smithi098.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T05:52:27.083 INFO:teuthology.orchestra.run.smithi098.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T05:52:27.083 INFO:teuthology.orchestra.run.smithi098.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T05:52:27.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T05:52:27.085 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T05:52:27.101 INFO:teuthology.orchestra.run.smithi098.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T05:52:27.103 INFO:teuthology.orchestra.run.smithi098.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T05:52:27.103 INFO:teuthology.orchestra.run.smithi098.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T05:52:27.124 INFO:teuthology.orchestra.run.smithi098.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T05:52:27.125 INFO:teuthology.orchestra.run.smithi098.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T05:52:27.125 INFO:teuthology.orchestra.run.smithi098.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T05:52:27.125 INFO:teuthology.orchestra.run.smithi098.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T05:52:27.125 INFO:teuthology.orchestra.run.smithi098.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T05:52:27.126 INFO:teuthology.orchestra.run.smithi098.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T05:52:27.135 INFO:teuthology.orchestra.run.smithi098.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T05:52:27.135 INFO:teuthology.orchestra.run.smithi098.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T05:52:27.138 INFO:teuthology.orchestra.run.smithi098.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T05:52:27.139 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T05:52:27.140 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T05:52:27.141 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T05:52:27.141 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T05:52:27.142 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T05:52:27.152 INFO:teuthology.orchestra.run.smithi098.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T05:52:27.153 INFO:teuthology.orchestra.run.smithi098.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T05:52:27.153 INFO:teuthology.orchestra.run.smithi098.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T05:52:27.157 INFO:teuthology.orchestra.run.smithi098.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T05:52:27.159 INFO:teuthology.orchestra.run.smithi098.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T05:52:27.160 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T05:52:27.160 INFO:teuthology.orchestra.run.smithi098.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T05:52:27.160 INFO:teuthology.orchestra.run.smithi098.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T05:52:27.162 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T05:52:27.162 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T05:52:27.169 INFO:teuthology.orchestra.run.smithi098.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T05:52:27.169 INFO:teuthology.orchestra.run.smithi098.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T05:52:27.172 INFO:teuthology.orchestra.run.smithi098.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T05:52:27.177 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T05:52:27.177 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T05:52:27.177 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T05:52:27.177 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T05:52:27.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T05:52:27.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T05:52:27.186 INFO:teuthology.orchestra.run.smithi098.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T05:52:27.187 INFO:teuthology.orchestra.run.smithi098.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T05:52:27.187 INFO:teuthology.orchestra.run.smithi098.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T05:52:27.188 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-10T05:52:27.189 INFO:teuthology.orchestra.run.smithi098.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T05:52:27.189 INFO:teuthology.orchestra.run.smithi098.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T05:52:27.193 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T05:52:27.193 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T05:52:27.195 INFO:teuthology.orchestra.run.smithi098.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T05:52:27.195 INFO:teuthology.orchestra.run.smithi098.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T05:52:27.196 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T05:52:27.202 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-10T05:52:27.203 INFO:teuthology.orchestra.run.smithi098.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T05:52:27.205 INFO:teuthology.orchestra.run.smithi098.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T05:52:27.205 INFO:teuthology.orchestra.run.smithi098.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T05:52:27.209 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-10T05:52:27.210 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T05:52:27.210 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-10T05:52:27.211 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T05:52:27.212 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T05:52:27.214 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-10T05:52:27.216 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T05:52:27.216 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-10T05:52:27.217 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T05:52:27.218 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T05:52:27.219 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T05:52:27.227 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T05:52:27.228 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T05:52:27.231 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T05:52:27.245 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T05:52:27.246 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T05:52:27.246 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T05:52:27.248 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T05:52:27.249 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T05:52:27.249 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-10T05:52:27.254 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T05:52:27.254 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T05:52:27.261 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T05:52:27.264 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T05:52:27.264 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T05:52:27.307 INFO:teuthology.orchestra.run.smithi098.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-10T05:52:27.309 INFO:teuthology.orchestra.run.smithi098.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-10T05:52:27.320 INFO:teuthology.orchestra.run.smithi098.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-10T05:52:27.540 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-10T05:52:27.543 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-10T05:52:27.552 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-10T05:52:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-10T05:52:28.492 INFO:teuthology.orchestra.run.smithi098.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-10T05:52:28.495 INFO:teuthology.orchestra.run.smithi098.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-10T05:52:28.496 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-10T05:52:28.497 INFO:teuthology.orchestra.run.smithi098.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-10T05:52:28.539 INFO:teuthology.orchestra.run.smithi098.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-10T05:52:28.584 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-10T05:52:28.589 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-10T05:52:28.592 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-10T05:52:28.640 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-10T05:52:28.775 INFO:teuthology.orchestra.run.smithi098.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-10T05:52:28.828 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-10T05:52:29.653 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-10T05:52:29.653 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-10T05:52:29.670 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-10T05:52:29.684 INFO:teuthology.orchestra.run.smithi098.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-10T05:52:29.684 INFO:teuthology.orchestra.run.smithi098.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-10T05:52:29.701 INFO:teuthology.orchestra.run.smithi098.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-10T05:52:29.726 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-10T05:52:29.737 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-10T05:52:29.741 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-10T05:52:29.742 INFO:teuthology.orchestra.run.smithi098.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-10T05:52:29.752 INFO:teuthology.orchestra.run.smithi098.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-10T05:52:29.754 INFO:teuthology.orchestra.run.smithi098.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-10T05:52:31.992 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-10T05:52:32.075 INFO:teuthology.orchestra.run.smithi098.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-10T05:52:32.119 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-10T05:52:32.119 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-10T05:52:32.269 INFO:teuthology.orchestra.run.smithi098.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-10T05:52:32.269 INFO:teuthology.orchestra.run.smithi098.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-10T05:52:34.298 INFO:teuthology.orchestra.run.smithi098.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-10T05:52:34.301 INFO:teuthology.orchestra.run.smithi098.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-10T05:52:34.302 INFO:teuthology.orchestra.run.smithi098.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-10T05:52:34.329 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-10T05:52:34.332 INFO:teuthology.orchestra.run.smithi070.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-10T05:52:34.333 INFO:teuthology.orchestra.run.smithi070.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-10T05:52:34.747 INFO:teuthology.orchestra.run.smithi098.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-10T05:52:34.795 INFO:teuthology.orchestra.run.smithi070.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-10T05:52:35.316 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 251 MB in 8s (30.9 MB/s) 2024-09-10T05:52:35.353 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 251 MB in 8s (31.0 MB/s) 2024-09-10T05:52:35.476 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T05:52:35.534 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T05:52:35.576 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T05:52:35.581 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T05:52:35.634 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T05:52:35.640 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T05:52:35.666 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:52:35.741 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:52:36.003 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T05:52:36.030 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T05:52:36.070 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:52:36.153 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T05:52:36.179 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T05:52:36.227 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:52:36.365 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T05:52:36.381 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T05:52:36.415 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:52:36.647 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T05:52:36.674 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T05:52:36.722 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:52:36.843 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T05:52:36.870 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:52:36.918 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:52:37.184 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T05:52:37.211 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:52:37.267 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:52:37.355 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T05:52:37.373 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:52:37.413 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:52:37.700 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T05:52:37.726 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:52:37.737 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T05:52:37.758 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:52:37.763 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:52:37.812 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:52:38.103 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T05:52:38.129 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T05:52:38.170 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:52:38.223 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T05:52:38.250 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T05:52:38.290 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:52:38.498 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librados2. 2024-09-10T05:52:38.513 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:38.556 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:38.676 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T05:52:38.703 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T05:52:38.751 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:52:38.984 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librbd1. 2024-09-10T05:52:39.010 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:39.042 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:39.046 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2024-09-10T05:52:39.072 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:39.104 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:39.512 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T05:52:39.538 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:39.548 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2024-09-10T05:52:39.575 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:39.578 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:39.615 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:39.873 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rados. 2024-09-10T05:52:39.888 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:39.931 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:40.059 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T05:52:40.086 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:40.126 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:40.403 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2024-09-10T05:52:40.430 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:40.442 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T05:52:40.468 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:52:40.470 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:40.509 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:40.711 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T05:52:40.730 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:40.756 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T05:52:40.761 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:40.783 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:52:40.814 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:41.033 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T05:52:41.059 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:41.089 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T05:52:41.100 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:41.116 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:52:41.156 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:41.411 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T05:52:41.437 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:52:41.477 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:41.559 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T05:52:41.585 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T05:52:41.626 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:52:41.798 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T05:52:41.923 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T05:52:41.924 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:52:41.929 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T05:52:41.947 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T05:52:41.987 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T05:52:42.158 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T05:52:42.174 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T05:52:42.208 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T05:52:42.215 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T05:52:42.230 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:42.273 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:42.436 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T05:52:42.451 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:42.502 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:42.626 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T05:52:42.652 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T05:52:42.693 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:52:42.855 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T05:52:42.882 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T05:52:42.930 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:52:42.970 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T05:52:42.986 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T05:52:43.037 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:52:43.207 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T05:52:43.223 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T05:52:43.266 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:52:43.315 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T05:52:43.331 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T05:52:43.373 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:52:43.544 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T05:52:43.559 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T05:52:43.594 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:52:43.710 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua5.1. 2024-09-10T05:52:43.737 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T05:52:43.777 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:52:43.930 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua5.1. 2024-09-10T05:52:43.957 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T05:52:43.997 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:52:44.097 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-any. 2024-09-10T05:52:44.112 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T05:52:44.163 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T05:52:44.308 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-any. 2024-09-10T05:52:44.323 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T05:52:44.366 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T05:52:44.374 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package zip. 2024-09-10T05:52:44.389 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T05:52:44.433 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T05:52:44.585 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package zip. 2024-09-10T05:52:44.601 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T05:52:44.635 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T05:52:44.753 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package unzip. 2024-09-10T05:52:44.778 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T05:52:44.819 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:52:44.905 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package unzip. 2024-09-10T05:52:44.920 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T05:52:44.964 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:52:45.224 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package luarocks. 2024-09-10T05:52:45.250 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T05:52:45.310 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:52:45.474 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package luarocks. 2024-09-10T05:52:45.501 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T05:52:45.651 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:52:45.674 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librgw2. 2024-09-10T05:52:45.700 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:45.732 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:46.035 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2024-09-10T05:52:46.062 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:46.101 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:46.352 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T05:52:46.366 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:46.409 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:46.721 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T05:52:46.746 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T05:52:46.747 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:46.772 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T05:52:46.787 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:46.812 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:52:47.115 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T05:52:47.123 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T05:52:47.130 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:47.150 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T05:52:47.165 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:47.190 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:52:47.460 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T05:52:47.486 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:47.518 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:47.569 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-common. 2024-09-10T05:52:47.595 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:47.635 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:47.971 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2024-09-10T05:52:47.998 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:48.037 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:49.217 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-base. 2024-09-10T05:52:49.242 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:49.292 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:49.468 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2024-09-10T05:52:49.494 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:52:49.543 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:52:49.846 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T05:52:49.872 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T05:52:49.912 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:52:50.122 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T05:52:50.148 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T05:52:50.188 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:52:50.190 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T05:52:50.216 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T05:52:50.257 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:52:50.433 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T05:52:50.459 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T05:52:50.499 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:52:50.585 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T05:52:50.611 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T05:52:50.658 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:52:50.810 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T05:52:50.837 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T05:52:50.877 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:52:51.138 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T05:52:51.153 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T05:52:51.188 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:52:51.188 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T05:52:51.215 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T05:52:51.255 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:52:51.466 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T05:52:51.492 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T05:52:51.533 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:52:51.558 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T05:52:51.584 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T05:52:51.624 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:52:51.835 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T05:52:51.862 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T05:52:51.869 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T05:52:51.884 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T05:52:51.902 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T05:52:51.918 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T05:52:52.205 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-portend. 2024-09-10T05:52:52.232 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T05:52:52.238 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2024-09-10T05:52:52.264 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T05:52:52.271 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T05:52:52.305 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T05:52:52.525 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T05:52:52.551 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T05:52:52.591 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T05:52:52.607 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T05:52:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T05:52:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T05:52:52.894 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T05:52:52.921 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T05:52:52.944 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T05:52:52.959 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T05:52:52.961 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:52:52.993 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:52:53.306 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T05:52:53.333 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T05:52:53.338 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T05:52:53.366 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T05:52:53.381 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T05:52:53.405 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T05:52:53.693 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T05:52:53.720 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T05:52:53.729 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T05:52:53.752 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T05:52:53.759 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T05:52:53.791 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T05:52:54.037 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T05:52:54.052 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T05:52:54.061 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T05:52:54.087 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:52:54.088 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T05:52:54.119 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:52:54.365 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-mako. 2024-09-10T05:52:54.389 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2024-09-10T05:52:54.392 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T05:52:54.416 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T05:52:54.432 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:52:54.455 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:52:54.758 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T05:52:54.774 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T05:52:54.794 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T05:52:54.808 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:52:54.821 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T05:52:54.860 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:52:55.078 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T05:52:55.105 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T05:52:55.144 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:52:55.163 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T05:52:55.190 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T05:52:55.229 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:52:55.464 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2024-09-10T05:52:55.491 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T05:52:55.530 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:52:55.541 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webob. 2024-09-10T05:52:55.567 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T05:52:55.607 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:52:55.875 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T05:52:55.902 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T05:52:55.944 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:52:55.952 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T05:52:55.978 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T05:52:56.022 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:52:56.294 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T05:52:56.321 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T05:52:56.339 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T05:52:56.361 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:52:56.365 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T05:52:56.405 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:52:56.622 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2024-09-10T05:52:56.649 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T05:52:56.667 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-paste. 2024-09-10T05:52:56.688 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:52:56.693 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T05:52:56.725 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:52:57.017 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T05:52:57.033 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T05:52:57.061 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T05:52:57.075 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:52:57.076 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T05:52:57.120 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:52:57.364 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T05:52:57.378 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T05:52:57.391 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T05:52:57.405 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T05:52:57.422 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:52:57.444 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:52:57.709 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T05:52:57.714 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T05:52:57.736 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T05:52:57.741 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T05:52:57.772 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T05:52:57.775 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T05:52:58.033 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T05:52:58.060 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T05:52:58.113 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T05:52:58.116 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:52:58.139 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T05:52:58.178 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:52:58.480 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T05:52:58.507 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T05:52:58.546 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T05:52:58.559 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T05:52:58.582 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T05:52:58.625 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T05:52:58.841 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2024-09-10T05:52:58.868 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T05:52:58.907 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:52:58.953 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-idna. 2024-09-10T05:52:58.980 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T05:52:59.020 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:52:59.219 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T05:52:59.246 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T05:52:59.285 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:52:59.289 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T05:52:59.305 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T05:52:59.339 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:52:59.605 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2024-09-10T05:52:59.632 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T05:52:59.643 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-requests. 2024-09-10T05:52:59.669 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T05:52:59.671 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:52:59.710 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:53:00.850 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T05:53:00.864 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T05:53:00.877 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T05:53:00.890 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T05:53:01.075 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:53:01.113 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:53:01.327 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T05:53:01.343 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:01.386 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:01.394 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T05:53:01.420 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:01.460 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:01.749 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T05:53:01.775 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:01.807 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T05:53:01.824 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:01.833 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:01.865 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:02.126 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T05:53:02.153 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T05:53:02.193 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:53:02.218 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T05:53:02.244 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T05:53:02.284 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:53:02.462 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T05:53:02.489 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T05:53:02.520 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T05:53:02.587 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T05:53:02.614 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T05:53:02.654 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T05:53:02.857 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T05:53:02.883 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:02.923 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:02.965 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T05:53:02.992 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:03.032 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:03.326 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T05:53:03.353 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:03.393 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:03.402 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T05:53:03.429 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:03.468 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:03.963 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T05:53:03.990 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:04.029 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:04.080 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T05:53:04.107 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:04.147 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:05.082 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2024-09-10T05:53:05.098 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:05.141 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:05.225 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph. 2024-09-10T05:53:05.238 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:05.292 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:05.468 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T05:53:05.495 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:05.535 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:05.595 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T05:53:05.621 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:05.661 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:05.913 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T05:53:05.940 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:05.979 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:06.081 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T05:53:06.108 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:06.148 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:06.341 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2024-09-10T05:53:06.368 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:06.399 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:06.551 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package cephadm. 2024-09-10T05:53:06.577 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:06.626 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:06.710 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T05:53:06.737 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T05:53:06.776 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T05:53:06.921 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T05:53:06.947 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T05:53:06.987 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T05:53:07.080 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T05:53:07.106 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:53:07.146 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:07.314 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T05:53:07.330 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:53:07.364 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:08.176 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2024-09-10T05:53:08.203 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:53:08.234 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:08.428 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-babel. 2024-09-10T05:53:08.455 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T05:53:08.494 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:08.528 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T05:53:08.555 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T05:53:08.586 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:53:08.814 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T05:53:08.841 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T05:53:08.881 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:53:08.898 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T05:53:08.924 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:08.956 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:09.225 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T05:53:09.252 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:09.268 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T05:53:09.292 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:09.294 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T05:53:09.334 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T05:53:09.578 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2024-09-10T05:53:09.605 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T05:53:09.612 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T05:53:09.639 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T05:53:09.645 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:53:09.679 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T05:53:09.925 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T05:53:09.936 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:09.964 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:09.998 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-routes. 2024-09-10T05:53:10.025 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T05:53:10.065 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:53:10.427 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T05:53:10.453 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:10.493 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:12.486 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T05:53:12.516 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T05:53:12.567 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:53:13.022 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T05:53:13.050 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T05:53:13.089 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:53:13.223 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T05:53:13.241 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T05:53:13.273 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:53:13.401 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T05:53:13.428 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T05:53:13.467 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:53:13.752 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T05:53:13.770 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T05:53:13.779 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T05:53:13.797 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T05:53:13.810 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:53:13.836 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:53:14.164 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T05:53:14.192 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T05:53:14.230 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:53:14.517 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T05:53:14.520 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T05:53:14.544 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T05:53:14.548 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:14.583 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:53:14.672 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:15.376 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T05:53:15.404 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:15.536 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:15.559 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T05:53:15.575 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T05:53:15.608 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T05:53:15.878 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T05:53:15.905 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T05:53:15.944 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:53:16.428 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T05:53:16.456 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T05:53:16.490 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T05:53:16.518 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T05:53:16.606 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:53:16.765 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T05:53:16.918 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T05:53:16.945 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T05:53:16.984 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T05:53:17.043 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T05:53:17.071 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T05:53:17.109 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:53:17.313 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T05:53:17.340 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T05:53:17.379 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T05:53:17.446 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T05:53:17.474 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T05:53:17.513 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:53:17.657 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T05:53:17.673 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T05:53:17.707 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:53:17.833 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T05:53:17.861 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T05:53:17.899 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T05:53:17.977 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T05:53:18.004 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T05:53:18.043 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T05:53:18.220 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T05:53:18.248 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T05:53:18.286 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T05:53:18.363 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T05:53:18.390 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T05:53:18.429 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:53:18.581 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T05:53:18.609 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T05:53:18.639 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:53:18.909 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T05:53:18.937 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T05:53:18.976 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T05:53:19.085 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T05:53:19.102 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:19.143 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:19.296 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T05:53:19.323 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T05:53:19.362 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:53:19.463 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T05:53:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T05:53:19.529 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:53:19.799 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T05:53:19.827 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:53:19.857 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:53:19.968 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T05:53:19.984 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:20.026 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:20.110 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2024-09-10T05:53:20.127 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:53:20.168 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T05:53:20.354 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T05:53:20.382 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T05:53:20.420 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2024-09-10T05:53:20.421 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:53:20.437 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T05:53:20.479 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:53:20.765 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T05:53:20.794 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:53:20.807 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T05:53:20.823 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T05:53:20.832 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:53:20.865 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:53:21.051 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package jq. 2024-09-10T05:53:21.067 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T05:53:21.101 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T05:53:21.236 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2024-09-10T05:53:21.253 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:21.294 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:21.371 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package socat. 2024-09-10T05:53:21.399 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T05:53:21.562 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:53:21.874 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T05:53:21.902 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T05:53:21.941 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:53:22.304 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-test. 2024-09-10T05:53:22.332 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:22.370 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:23.749 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T05:53:23.777 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:23.815 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:24.119 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T05:53:24.135 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:24.177 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:24.446 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T05:53:24.463 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T05:53:24.496 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:53:24.826 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T05:53:24.854 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T05:53:24.892 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:53:25.016 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T05:53:25.044 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T05:53:25.082 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:25.213 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T05:53:25.241 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T05:53:25.271 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:53:25.412 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T05:53:25.440 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:25.478 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:25.726 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pkg-config. 2024-09-10T05:53:25.748 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T05:53:25.754 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T05:53:25.776 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T05:53:25.792 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:53:25.806 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:53:26.028 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T05:53:26.045 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T05:53:26.086 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:53:26.127 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T05:53:26.155 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T05:53:26.202 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:53:26.506 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T05:53:26.535 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T05:53:26.575 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T05:53:26.581 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T05:53:26.609 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T05:53:26.648 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:53:26.836 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T05:53:26.864 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T05:53:26.902 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T05:53:27.037 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package pkg-config. 2024-09-10T05:53:27.065 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T05:53:27.095 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:53:27.230 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T05:53:27.259 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T05:53:27.297 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:53:27.331 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T05:53:27.347 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T05:53:27.389 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:53:27.608 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T05:53:27.636 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T05:53:27.683 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T05:53:27.767 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T05:53:27.796 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T05:53:27.834 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T05:53:28.003 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2024-09-10T05:53:28.031 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T05:53:28.077 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T05:53:28.145 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T05:53:28.173 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T05:53:28.212 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T05:53:28.380 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T05:53:28.409 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T05:53:28.447 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:53:28.532 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T05:53:28.560 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T05:53:28.598 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:53:28.894 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T05:53:28.901 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T05:53:28.921 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T05:53:28.929 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T05:53:28.959 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T05:53:28.967 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:53:29.270 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2024-09-10T05:53:29.298 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T05:53:29.321 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-py. 2024-09-10T05:53:29.336 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T05:53:29.349 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T05:53:29.387 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T05:53:29.639 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T05:53:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T05:53:29.705 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:53:29.716 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T05:53:29.744 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T05:53:29.782 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:53:30.059 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T05:53:30.087 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T05:53:30.125 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:53:30.212 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T05:53:30.240 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T05:53:30.270 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:53:30.394 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T05:53:30.411 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T05:53:30.453 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:53:30.606 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-toml. 2024-09-10T05:53:30.634 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T05:53:30.672 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T05:53:30.975 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T05:53:31.004 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T05:53:31.042 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:53:31.115 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2024-09-10T05:53:31.143 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:31.181 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:31.387 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T05:53:31.416 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T05:53:31.454 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:53:31.707 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T05:53:31.735 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T05:53:31.773 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:53:32.042 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T05:53:32.059 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:32.092 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:32.372 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T05:53:32.622 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:53:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:53:32.811 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package radosgw. 2024-09-10T05:53:32.839 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:32.877 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:33.002 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T05:53:33.328 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T05:53:33.763 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T05:53:33.778 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T05:53:33.789 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T05:53:33.830 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:33.850 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:34.112 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T05:53:34.352 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T05:53:34.461 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T05:53:34.691 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2024-09-10T05:53:34.724 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T05:53:34.848 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:53:35.028 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T05:53:35.116 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:53:35.359 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:53:35.443 INFO:teuthology.orchestra.run.smithi098.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T05:53:35.476 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:53:35.505 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:35.744 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T05:53:35.988 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user cephadm....done 2024-09-10T05:53:36.004 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:53:36.130 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T05:53:36.136 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T05:53:36.421 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T05:53:36.431 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:53:36.681 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T05:53:36.783 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T05:53:36.823 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T05:53:37.042 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T05:53:37.075 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T05:53:37.310 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:53:37.317 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T05:53:37.419 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T05:53:37.561 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:53:37.704 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T05:53:37.812 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:53:38.055 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:53:38.056 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T05:53:38.315 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T05:53:38.408 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:38.600 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T05:53:38.690 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:53:38.791 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:53:38.843 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T05:53:38.892 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:53:39.018 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:53:39.086 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T05:53:39.277 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:53:39.354 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T05:53:39.613 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:39.685 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T05:53:39.717 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T05:53:39.781 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:53:39.907 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T05:53:39.964 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T05:53:40.090 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T05:53:40.216 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T05:53:40.269 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:40.317 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T05:53:40.392 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T05:53:40.560 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T05:53:40.660 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:53:40.928 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:53:40.947 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T05:53:40.975 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T05:53:41.039 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T05:53:41.165 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T05:53:41.212 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T05:53:41.338 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:53:41.533 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:41.642 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T05:53:41.909 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T05:53:42.031 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:53:42.152 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T05:53:42.291 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:53:42.417 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:53:42.462 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T05:53:42.543 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:53:42.605 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T05:53:42.835 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T05:53:43.253 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T05:53:43.350 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T05:53:43.487 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:53:43.508 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T05:53:43.634 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T05:53:43.752 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T05:53:43.864 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:53:44.028 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T05:53:44.165 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:53:44.414 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T05:53:44.508 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:53:44.682 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T05:53:44.768 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:53:44.893 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:45.059 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T05:53:45.220 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:53:45.343 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T05:53:45.545 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:53:45.678 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T05:53:45.929 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T05:53:46.064 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:46.365 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T05:53:46.659 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:53:46.691 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T05:53:46.911 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:53:47.062 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T05:53:47.613 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:53:47.739 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:53:47.857 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:53:48.022 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T05:53:48.133 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:53:48.324 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:53:48.384 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T05:53:48.458 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T05:53:48.635 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:53:48.717 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T05:53:48.761 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:53:48.818 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T05:53:48.944 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T05:53:49.062 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:53:49.229 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T05:53:49.338 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T05:53:49.489 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T05:53:49.581 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T05:53:49.748 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:53:49.815 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:53:49.874 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T05:53:50.058 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T05:53:50.167 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T05:53:50.334 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:53:50.410 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T05:53:50.460 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T05:53:50.653 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T05:53:50.744 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:53:50.870 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:53:50.903 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T05:53:51.155 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T05:53:51.171 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:53:51.431 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T05:53:51.456 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:53:51.557 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T05:53:51.690 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:53:51.816 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:53:51.841 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T05:53:51.942 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:51.942 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T05:53:52.031 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T05:53:52.218 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T05:53:52.294 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:53:52.419 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:53:52.536 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T05:53:52.787 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T05:53:52.821 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:53:52.914 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T05:53:53.040 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T05:53:53.080 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T05:53:53.129 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T05:53:53.193 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T05:53:53.366 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T05:53:53.432 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:53:53.467 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T05:53:53.550 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:53:53.852 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T05:53:53.868 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:53:54.103 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T05:53:54.169 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:53:54.229 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T05:53:54.445 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T05:53:54.480 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T05:53:54.571 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T05:53:54.606 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T05:53:54.830 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T05:53:54.949 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T05:53:55.089 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:53:55.259 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T05:53:55.418 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:53:55.534 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T05:53:55.644 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T05:53:55.811 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T05:53:55.895 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T05:53:56.112 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:53:56.188 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T05:53:56.440 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:53:56.541 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:56.558 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T05:53:56.667 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:56.793 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:53:56.926 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T05:53:57.129 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:57.228 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T05:53:57.255 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:57.372 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T05:53:57.564 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T05:53:57.641 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:57.690 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:57.767 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:57.816 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:57.892 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:57.942 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T05:53:58.109 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:53:58.109 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:53:58.262 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:58.388 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:58.522 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T05:53:58.635 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:58.761 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:58.799 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:58.887 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:58.925 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:58.988 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:53:59.051 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:59.253 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:53:59.254 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T05:53:59.710 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:59.870 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:53:59.996 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:00.122 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T05:54:00.175 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:00.301 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:00.427 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:00.553 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:00.679 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:01.172 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2024-09-10T05:54:01.334 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:01.435 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:01.515 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2024-09-10T05:54:01.553 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:01.674 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2024-09-10T05:54:01.678 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:01.689 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T05:54:01.805 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:01.824 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T05:54:02.138 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T05:54:02.331 INFO:teuthology.orchestra.run.smithi098.stdout:Adding group ceph....done 2024-09-10T05:54:02.596 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:02.697 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:02.715 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user ceph....done 2024-09-10T05:54:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:Setting system user ceph properties....done 2024-09-10T05:54:02.888 INFO:teuthology.orchestra.run.smithi098.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T05:54:03.024 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:54:03.164 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:54:03.324 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T05:54:03.607 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:03.756 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:03.882 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:03.948 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T05:54:04.339 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:54:04.339 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T05:54:04.401 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:04.639 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:54:04.639 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:54:04.817 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:05.102 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:05.136 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T05:54:05.323 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:54:05.324 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:54:05.754 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:05.779 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:05.989 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:54:05.989 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T05:54:06.032 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:54:06.032 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:54:06.489 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:06.497 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:06.598 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:06.702 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:54:06.702 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T05:54:06.741 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:06.932 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:54:06.932 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:54:07.157 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:07.352 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:07.425 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:54:07.426 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T05:54:07.476 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:07.602 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:07.745 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:07.969 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:08.068 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:08.194 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:08.405 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:54:08.405 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T05:54:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T05:54:08.711 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T05:54:08.863 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T05:54:09.074 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:09.209 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:09.310 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:09.453 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T05:54:09.906 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T05:54:09.946 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T05:54:10.023 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T05:54:10.176 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T05:54:10.599 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T05:54:10.605 DEBUG:teuthology.parallel:result is None 2024-09-10T05:54:11.210 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T05:54:11.880 INFO:teuthology.orchestra.run.smithi098.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T05:54:11.885 DEBUG:teuthology.parallel:result is None 2024-09-10T05:54:11.886 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T05:54:12.034 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2024-09-10T05:54:12.054 INFO:teuthology.orchestra.run.smithi070.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-10T05:54:12.054 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-10T05:54:12.055 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-10T05:54:12.057 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T05:54:12.193 DEBUG:teuthology.orchestra.run.smithi098:> dpkg-query -W -f '${Version}' ceph 2024-09-10T05:54:12.212 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-10T05:54:12.212 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-10T05:54:12.212 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-10T05:54:12.214 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T05:54:12.214 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:12.214 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T05:54:12.230 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:12.230 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T05:54:12.267 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T05:54:12.268 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:12.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T05:54:12.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T05:54:12.342 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:12.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T05:54:12.355 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T05:54:12.410 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T05:54:12.411 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:12.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T05:54:12.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T05:54:12.478 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:12.479 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T05:54:12.492 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T05:54:12.547 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T05:54:12.548 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:12.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T05:54:12.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T05:54:12.617 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:12.617 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T05:54:12.630 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T05:54:12.686 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T05:54:12.770 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T05:54:12.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-10T05:54:12.773 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-10T05:54:12.785 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T05:54:12.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T05:54:12.827 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T05:54:12.840 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T05:54:12.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T05:54:12.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T05:54:12.909 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T05:54:12.909 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T05:54:12.909 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7898747', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cls-rgw-busy-resharding', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4606, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cls-rgw-busy-resharding', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN74YsQf7ok+W0daKrhBe1hr7iUyYTFmNF2V96yPxEz8goJ9DxfzZGq6+ovxj+KZUPbNel9epvdVAEjRWiDRxcI=', 'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJLyikHWZVbIw9gcdCSAWI/+kdMfIYM45Wh6yNyUDlWM3h6J8HEPKc9uOBhBgURLg8V1e242l+PuwCj97mEzyQA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_03:24:22', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T05:54:12.909 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T05:54:12.939 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T05:54:12.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T05:54:12.987 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T05:54:13.002 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:13.002 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T05:54:13.046 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T05:54:13.046 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 05:48:45.819218785 +0000 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 05:48:45.815218820 +0000 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 05:48:45.815218820 +0000 2024-09-10T05:54:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-10T05:54:13.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T05:54:13.148 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T05:54:13.148 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T05:54:13.148 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000310608 s, 1.6 MB/s 2024-09-10T05:54:13.150 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T05:54:13.200 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-10T05:54:13.246 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T05:54:13.246 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:13.246 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-10T05:54:13.247 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:13.247 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 05:48:46.583211960 +0000 2024-09-10T05:54:13.247 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 05:48:46.295214533 +0000 2024-09-10T05:54:13.247 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 05:48:46.295214533 +0000 2024-09-10T05:54:13.247 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-10T05:54:13.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T05:54:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T05:54:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T05:54:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000319962 s, 1.6 MB/s 2024-09-10T05:54:13.303 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T05:54:13.352 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-10T05:54:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T05:54:13.398 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:13.398 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-10T05:54:13.398 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:13.398 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 05:48:47.083207494 +0000 2024-09-10T05:54:13.399 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 05:48:46.831209745 +0000 2024-09-10T05:54:13.399 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 05:48:46.831209745 +0000 2024-09-10T05:54:13.399 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-10T05:54:13.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T05:54:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T05:54:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T05:54:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.00026784 s, 1.9 MB/s 2024-09-10T05:54:13.454 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T05:54:13.504 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-10T05:54:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T05:54:13.550 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:13.551 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-09-10T05:54:13.551 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:13.551 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-10 05:48:47.555203278 +0000 2024-09-10T05:54:13.551 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-10 05:48:47.303205529 +0000 2024-09-10T05:54:13.551 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-10 05:48:47.303205529 +0000 2024-09-10T05:54:13.551 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-10T05:54:13.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T05:54:13.604 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-10T05:54:13.605 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-10T05:54:13.605 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000207174 s, 2.5 MB/s 2024-09-10T05:54:13.606 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T05:54:13.656 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:13.656 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:13.656 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T05:54:13.662 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T05:54:13.663 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-10T05:54:13.711 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T05:54:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:13.712 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-10T05:54:13.712 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:13.712 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 05:48:45.700160919 +0000 2024-09-10T05:54:13.712 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 05:48:45.448163162 +0000 2024-09-10T05:54:13.712 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 05:48:45.448163162 +0000 2024-09-10T05:54:13.712 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-10T05:54:13.712 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T05:54:13.766 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T05:54:13.766 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T05:54:13.767 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000467672 s, 1.1 MB/s 2024-09-10T05:54:13.768 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T05:54:13.818 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-10T05:54:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T05:54:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:13.867 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-10T05:54:13.868 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:13.868 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 05:48:46.192156539 +0000 2024-09-10T05:54:13.868 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 05:48:45.956158639 +0000 2024-09-10T05:54:13.868 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 05:48:45.956158639 +0000 2024-09-10T05:54:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-10T05:54:13.868 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T05:54:13.922 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T05:54:13.923 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T05:54:13.923 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000810845 s, 631 kB/s 2024-09-10T05:54:13.924 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T05:54:13.972 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-10T05:54:14.094 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T05:54:14.094 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:14.094 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-10T05:54:14.094 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:14.095 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 05:48:46.688152124 +0000 2024-09-10T05:54:14.095 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 05:48:46.432154404 +0000 2024-09-10T05:54:14.095 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 05:48:46.432154404 +0000 2024-09-10T05:54:14.095 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-10T05:54:14.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T05:54:14.154 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T05:54:14.154 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T05:54:14.154 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000379248 s, 1.4 MB/s 2024-09-10T05:54:14.155 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T05:54:14.204 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-10 05:48:47.184147709 +0000 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-10 05:48:46.912150132 +0000 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-10 05:48:46.912150132 +0000 2024-09-10T05:54:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-10T05:54:14.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T05:54:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-10T05:54:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-10T05:54:14.305 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000327242 s, 1.6 MB/s 2024-09-10T05:54:14.306 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T05:54:14.356 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:14.356 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T05:54:14.357 INFO:tasks.ceph:Generating config... 2024-09-10T05:54:14.358 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-09-10T05:54:14.358 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T05:54:14.358 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T05:54:14.358 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T05:54:14.358 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T05:54:14.358 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T05:54:14.359 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-10T05:54:14.360 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T05:54:14.360 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-10T05:54:14.360 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T05:54:14.360 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-10T05:54:14.360 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T05:54:14.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T05:54:14.395 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T05:54:14.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T05:54:14.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:54:14.542 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]'), ('mon.b', '172.21.15.98')] 2024-09-10T05:54:14.542 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.98'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-10T05:54:14.543 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:14.543 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T05:54:14.590 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --add b 172.21.15.98 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:14.678 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:14.678 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid 64591990-2498-4479-bfa8-9a8cb8fcb29f 2024-09-10T05:54:14.678 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 64591990-2498-4479-bfa8-9a8cb8fcb29f 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-09-10T05:54:14.680650+0000 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-10T05:54:14.680650+0000 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 17 (quincy) 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-10T05:54:14.679 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T05:54:14.680 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T05:54:14.685 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 64591990-2498-4479-bfa8-9a8cb8fcb29f... 2024-09-10T05:54:14.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T05:54:14.727 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T05:54:14.752 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-10T05:54:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-10T05:54:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T05:54:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-10T05:54:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.752 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-10T05:54:14.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-10T05:54:14.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-10T05:54:14.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.98" 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 64591990-2498-4479-bfa8-9a8cb8fcb29f 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-10T05:54:14.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.757 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-10T05:54:14.758 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd blocked scrub grace period = 3600 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd max markdown count = 1000 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd shutdown pgref assert = True 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.759 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-10T05:54:14.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T05:54:14.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T05:54:14.762 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T05:54:14.763 INFO:teuthology.orchestra.run.smithi070.stdout: rgw relaxed s3 bucket names = True 2024-09-10T05:54:14.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-10T05:54:14.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-09-10T05:54:14.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-09-10T05:54:14.763 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-10T05:54:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-10T05:54:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.98" 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 64591990-2498-4479-bfa8-9a8cb8fcb29f 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2024-09-10T05:54:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-10T05:54:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: bdev async discard = True 2024-09-10T05:54:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: bdev enable discard = True 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore allocator = bitmap 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: osd blocked scrub grace period = 3600 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-10T05:54:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: osd max markdown count = 1000 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: osd shutdown pgref assert = True 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.771 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T05:54:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-10T05:54:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: rgw relaxed s3 bucket names = True 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2024-09-10T05:54:14.774 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2024-09-10T05:54:14.776 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T05:54:14.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T05:54:14.865 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T05:54:14.865 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:14.865 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T05:54:14.871 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:14.871 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T05:54:14.918 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T05:54:14.918 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:14.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T05:54:14.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:54:14.982 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:14.983 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:15.030 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T05:54:15.030 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:15.030 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T05:54:15.031 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T05:54:15.054 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:15.054 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:15.103 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T05:54:15.103 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T05:54:15.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T05:54:15.146 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T05:54:15.149 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T05:54:15.193 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T05:54:15.208 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T05:54:15.208 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T05:54:15.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T05:54:15.242 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T05:54:15.254 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T05:54:15.289 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T05:54:15.300 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T05:54:15.300 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T05:54:15.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T05:54:15.313 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:15.313 INFO:tasks.ceph:role: osd.0 2024-09-10T05:54:15.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T05:54:15.314 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:15.373 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:15.397 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-10T05:54:15.399 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-10T05:54:15.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T05:54:15.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T05:54:15.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:15.512 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:15.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T05:54:15.565 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:15.566 INFO:tasks.ceph:role: osd.1 2024-09-10T05:54:15.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T05:54:15.566 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T05:54:15.621 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:15.622 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:15.645 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-10T05:54:15.647 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-10T05:54:15.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T05:54:15.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T05:54:15.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:15.759 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:15.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T05:54:15.813 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:15.813 INFO:tasks.ceph:role: osd.2 2024-09-10T05:54:15.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T05:54:15.813 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T05:54:15.866 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:15.866 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:15.867 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:15.890 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-10T05:54:15.891 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-10T05:54:15.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T05:54:15.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T05:54:16.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:16.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T05:54:16.061 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:16.062 INFO:tasks.ceph:role: osd.3 2024-09-10T05:54:16.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T05:54:16.062 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T05:54:16.118 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:16.118 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:16.118 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:16.118 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:16.119 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:16.119 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:16.141 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-10T05:54:16.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-10T05:54:16.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T05:54:16.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T05:54:16.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:16.251 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:16.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:16.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:16.362+0000 7fa604ca07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T05:54:16.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:16.362+0000 7fa604ca07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T05:54:16.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:16.362+0000 7fa604ca07c0 -1 bdev(0x55945cbc1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:16.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:16.362+0000 7fa604ca07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T05:54:19.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T05:54:19.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:19.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:19.610+0000 7fcbd91cc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T05:54:19.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:19.610+0000 7fcbd91cc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T05:54:19.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:19.610+0000 7fcbd91cc7c0 -1 bdev(0x55ce345d7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:19.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:19.610+0000 7fcbd91cc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T05:54:22.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T05:54:22.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:22.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:22.902+0000 7fb962b9d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T05:54:22.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:22.902+0000 7fb962b9d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T05:54:22.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:22.902+0000 7fb962b9d7c0 -1 bdev(0x5582a6519800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:22.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:22.902+0000 7fb962b9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T05:54:26.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T05:54:26.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:26.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:26.178+0000 7fbf633427c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T05:54:26.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:26.178+0000 7fbf633427c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T05:54:26.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:26.178+0000 7fbf633427c0 -1 bdev(0x55fafed43800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:26.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-10T05:54:26.178+0000 7fbf633427c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T05:54:29.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T05:54:29.366 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T05:54:29.484 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:29.484 INFO:tasks.ceph:role: osd.4 2024-09-10T05:54:29.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T05:54:29.484 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T05:54:29.547 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:29.547 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:29.547 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:29.548 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:29.548 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:30.021 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-10T05:54:30.023 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-10T05:54:30.023 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T05:54:30.169 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T05:54:30.180 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:30.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:30.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T05:54:30.235 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:30.235 INFO:tasks.ceph:role: osd.5 2024-09-10T05:54:30.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T05:54:30.235 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T05:54:30.299 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:30.300 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:30.723 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-10T05:54:30.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-10T05:54:30.725 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T05:54:30.788 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T05:54:30.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:30.841 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:30.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T05:54:30.894 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:30.894 INFO:tasks.ceph:role: osd.6 2024-09-10T05:54:30.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T05:54:30.895 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T05:54:30.958 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:30.958 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:30.958 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:30.958 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:30.958 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:30.958 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:30.959 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:30.959 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:30.959 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:30.959 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:31.427 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-10T05:54:31.429 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-10T05:54:31.429 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T05:54:31.518 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T05:54:31.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:31.529 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:31.529 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T05:54:31.582 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T05:54:31.582 INFO:tasks.ceph:role: osd.7 2024-09-10T05:54:31.582 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T05:54:31.582 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T05:54:31.647 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T05:54:31.647 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T05:54:31.647 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T05:54:31.647 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T05:54:31.647 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T05:54:31.648 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-10T05:54:31.648 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T05:54:31.648 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T05:54:31.648 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T05:54:31.648 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T05:54:32.109 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-10T05:54:32.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-10T05:54:32.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T05:54:32.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T05:54:32.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:54:32.263 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T05:54:32.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:32.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:32.371+0000 7f56b5f0e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T05:54:32.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:32.375+0000 7f56b5f0e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T05:54:32.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:32.375+0000 7f56b5f0e7c0 -1 bdev(0x55da94629800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:32.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:32.375+0000 7f56b5f0e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T05:54:35.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T05:54:35.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:35.659+0000 7f9f85c187c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T05:54:35.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:35.659+0000 7f9f85c187c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T05:54:35.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:35.659+0000 7f9f85c187c0 -1 bdev(0x55986c085800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:35.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:35.659+0000 7f9f85c187c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T05:54:38.817 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T05:54:38.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:38.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:38.947+0000 7f5d118c27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T05:54:38.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:38.947+0000 7f5d118c27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T05:54:38.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:38.947+0000 7f5d118c27c0 -1 bdev(0x55cd5213d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:38.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:38.947+0000 7f5d118c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T05:54:42.098 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T05:54:42.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:42.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:42.231+0000 7fde892067c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T05:54:42.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:42.235+0000 7fde892067c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T05:54:42.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:42.235+0000 7fde892067c0 -1 bdev(0x55f12f28f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T05:54:42.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-10T05:54:42.235+0000 7fde892067c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T05:54:45.365 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T05:54:45.418 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T05:54:45.419 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:45.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T05:54:45.434 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:45.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T05:54:45.489 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:45.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T05:54:45.545 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:45.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T05:54:45.604 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:45.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T05:54:45.656 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:45.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T05:54:45.670 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:45.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T05:54:45.726 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:45.726 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T05:54:45.782 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:45.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T05:54:45.838 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:45.838 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T05:54:45.894 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:45.894 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T05:54:45.900 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:45.900 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T05:54:45.943 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T05:54:45.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T05:54:45.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAH399m70vdCBAA/7vWmoG9hV4TA+hS1vBEzw== 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAI399myXXWFRAA9KCiXuXgPHAHlXPcPq3n/Q== 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAL399mEdaVJBAAnclAbAnoMC2LFJxFNbtSkg== 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAO399muh8bNhAAj+gz/65V3XmszYahZcNnWQ== 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-09-10T05:54:45.993 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAS399mXl3mChAAja7j7Zdm30H5dCo4qFqErg== 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAH399mF1aRCxAAXcCoHfJGjLvatozETv+O2Q== 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAY399mCapwFhAAgP+7DCkO4b2UmqYEty04rA== 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAb399mNIGeJxAAu98JDRtf/H28ek7pckI6eQ== 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAe399miqvXOBAAVWkXW/8CEmv7BWCVOSvXYg== 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAi399miDw6DhAAR34deQBzpEacjTz34ike8w== 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAH399mnpmaDhAA6eiot48NUlZijkkCcazGHA== 2024-09-10T05:54:45.994 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2024-09-10T05:54:45.995 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQAH399mmcVHERAACNwTYXLAuxIv+TuuJOvUtA== 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.y] 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAH399m70vdCBAA/7vWmoG9hV4TA+hS1vBEzw== 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAI399myXXWFRAA9KCiXuXgPHAHlXPcPq3n/Q== 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAL399mEdaVJBAAnclAbAnoMC2LFJxFNbtSkg== 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAO399muh8bNhAAj+gz/65V3XmszYahZcNnWQ== 2024-09-10T05:54:46.001 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAS399mXl3mChAAja7j7Zdm30H5dCo4qFqErg== 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAH399mF1aRCxAAXcCoHfJGjLvatozETv+O2Q== 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.4] 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAY399mCapwFhAAgP+7DCkO4b2UmqYEty04rA== 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.5] 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAb399mNIGeJxAAu98JDRtf/H28ek7pckI6eQ== 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.6] 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAe399miqvXOBAAVWkXW/8CEmv7BWCVOSvXYg== 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.7] 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAi399miDw6DhAAR34deQBzpEacjTz34ike8w== 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAH399mnpmaDhAA6eiot48NUlZijkkCcazGHA== 2024-09-10T05:54:46.002 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2024-09-10T05:54:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAH399mmcVHERAACNwTYXLAuxIv+TuuJOvUtA== 2024-09-10T05:54:46.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T05:54:46.039 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T05:54:46.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.093 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.174 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.255 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.300 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T05:54:46.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T05:54:46.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.470 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.558 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.643 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.727 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T05:54:46.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T05:54:46.814 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T05:54:46.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T05:54:46.902 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T05:54:46.949 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T05:54:46.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T05:54:46.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T05:54:47.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T05:54:47.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T05:54:47.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T05:54:47.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T05:54:47.262 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T05:54:47.277 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T05:54:47.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T05:54:47.379 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:47.382 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T05:54:47.426 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T05:54:47.426 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T05:54:47.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T05:54:47.430 INFO:tasks.ceph.mon.a:Started 2024-09-10T05:54:47.430 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T05:54:47.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T05:54:47.433 INFO:tasks.ceph.mon.c:Started 2024-09-10T05:54:47.434 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T05:54:47.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T05:54:47.471 INFO:tasks.ceph.mon.b:Started 2024-09-10T05:54:47.472 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T05:54:47.472 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T05:54:47.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T05:54:47.474 INFO:tasks.ceph.mgr.y:Started 2024-09-10T05:54:47.474 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T05:54:47.474 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T05:54:47.476 INFO:tasks.ceph.mgr.x:Started 2024-09-10T05:54:47.476 DEBUG:tasks.ceph:set 0 configs 2024-09-10T05:54:47.476 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T05:54:47.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T05:54:53.060 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-10T05:54:53.079 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T05:54:53.080 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T05:54:53.080 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:53.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T05:54:53.091 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:53.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T05:54:53.143 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:53.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T05:54:53.196 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:54:53.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T05:54:53.253 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:53.253 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T05:54:53.267 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:53.267 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T05:54:53.323 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:53.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T05:54:53.378 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-10T05:54:53.378 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T05:54:53.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 7de4b4d6-bddb-415b-ac33-62eda22b0fc5 0 2024-09-10T05:54:53.701 INFO:teuthology.orchestra.run.smithi098.stdout:0 2024-09-10T05:54:53.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new e1d81852-e81f-4738-bc5c-acf3a2a5b5de 1 2024-09-10T05:54:53.921 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-10T05:54:53.938 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 405e0867-aba2-42fe-bdf6-4be0de0860d7 2 2024-09-10T05:54:54.140 INFO:teuthology.orchestra.run.smithi098.stdout:2 2024-09-10T05:54:54.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new d57b60c0-744b-4d58-bb15-b3cffc9083bd 3 2024-09-10T05:54:54.354 INFO:teuthology.orchestra.run.smithi098.stdout:3 2024-09-10T05:54:54.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new b6988baa-4417-4899-9adf-7832c70b4eb4 4 2024-09-10T05:54:54.564 INFO:teuthology.orchestra.run.smithi098.stdout:4 2024-09-10T05:54:54.580 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new f215d032-5868-49d0-8238-19a0c9476b4e 5 2024-09-10T05:54:54.777 INFO:teuthology.orchestra.run.smithi098.stdout:5 2024-09-10T05:54:54.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 878c5865-fed4-48f5-8b7c-c4ca199a2737 6 2024-09-10T05:54:54.995 INFO:teuthology.orchestra.run.smithi098.stdout:6 2024-09-10T05:54:55.012 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new b98908e9-8169-41e3-8239-ea1d729d36af 7 2024-09-10T05:54:55.208 INFO:teuthology.orchestra.run.smithi098.stdout:7 2024-09-10T05:54:55.224 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T05:54:55.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T05:54:55.228 INFO:tasks.ceph.osd.0:Started 2024-09-10T05:54:55.228 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T05:54:55.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T05:54:55.231 INFO:tasks.ceph.osd.1:Started 2024-09-10T05:54:55.232 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T05:54:55.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T05:54:55.235 INFO:tasks.ceph.osd.2:Started 2024-09-10T05:54:55.235 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T05:54:55.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T05:54:55.238 INFO:tasks.ceph.osd.3:Started 2024-09-10T05:54:55.239 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T05:54:55.239 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T05:54:55.242 INFO:tasks.ceph.osd.4:Started 2024-09-10T05:54:55.242 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T05:54:55.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T05:54:55.244 INFO:tasks.ceph.osd.5:Started 2024-09-10T05:54:55.245 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T05:54:55.245 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T05:54:55.247 INFO:tasks.ceph.osd.6:Started 2024-09-10T05:54:55.248 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T05:54:55.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T05:54:55.250 INFO:tasks.ceph.osd.7:Started 2024-09-10T05:54:55.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:54:55.451 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:54:55.452 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:54:55.207944+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:54:55.207944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:54:55.468 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T05:54:55.468 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T05:54:55.702 INFO:tasks.ceph.mgr.x.smithi098.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T05:54:55.702 INFO:tasks.ceph.mgr.x.smithi098.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T05:54:55.702 INFO:tasks.ceph.mgr.x.smithi098.stderr: from numpy import show_config as show_numpy_config 2024-09-10T05:54:56.275 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:54:56.452 INFO:tasks.ceph.mgr.y.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T05:54:56.452 INFO:tasks.ceph.mgr.y.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T05:54:56.453 INFO:tasks.ceph.mgr.y.smithi070.stderr: from numpy import show_config as show_numpy_config 2024-09-10T05:54:56.458 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-10T05:54:56.458 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":10,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:54:55.207944+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:54:55.207944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:54:56.473 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T05:54:56.567 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:54:56.566+0000 7efd5abb97c0 -1 Falling back to public interface 2024-09-10T05:54:56.603 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:54:56.599+0000 7f8875ce37c0 -1 Falling back to public interface 2024-09-10T05:54:56.611 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:54:56.610+0000 7f7fda3697c0 -1 Falling back to public interface 2024-09-10T05:54:56.623 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:54:56.619+0000 7f6d49a857c0 -1 Falling back to public interface 2024-09-10T05:54:56.638 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:54:56.638+0000 7f0b1a02d7c0 -1 Falling back to public interface 2024-09-10T05:54:56.852 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:54:56.847+0000 7f90b85a27c0 -1 Falling back to public interface 2024-09-10T05:54:56.902 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:54:56.902+0000 7fdba835f7c0 -1 Falling back to public interface 2024-09-10T05:54:57.336 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:54:57.331+0000 7f0a7110c7c0 -1 Falling back to public interface 2024-09-10T05:54:58.640 INFO:tasks.ceph.mgr.x.smithi098.stderr:2024-09-10T05:54:58.635+0000 7f4c27e88640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T05:54:58.641 INFO:tasks.ceph.mgr.x.smithi098.stderr:2024-09-10T05:54:58.635+0000 7f4c27e88640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T05:55:00.623 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:00.619+0000 7f8875ce37c0 -1 osd.4 0 log_to_monitors true 2024-09-10T05:55:00.679 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:00.678+0000 7efd5abb97c0 -1 osd.0 0 log_to_monitors true 2024-09-10T05:55:00.760 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:00.758+0000 7f0b1a02d7c0 -1 osd.2 0 log_to_monitors true 2024-09-10T05:55:00.810 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:00.810+0000 7f7fda3697c0 -1 osd.1 0 log_to_monitors true 2024-09-10T05:55:00.879 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:00.875+0000 7f90b85a27c0 -1 osd.6 0 log_to_monitors true 2024-09-10T05:55:00.912 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:00.907+0000 7f6d49a857c0 -1 osd.7 0 log_to_monitors true 2024-09-10T05:55:01.282 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:01.282+0000 7fdba835f7c0 -1 osd.3 0 log_to_monitors true 2024-09-10T05:55:01.584 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:01.579+0000 7f0a7110c7c0 -1 osd.5 0 log_to_monitors true 2024-09-10T05:55:02.882 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:02.879+0000 7f887249e640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T05:55:02.903 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:02.899+0000 7f8869abe640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:03.153 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:03.154+0000 7f7fd6b24640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T05:55:03.160 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:03.158+0000 7efd57374640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T05:55:03.175 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:03.174+0000 7f0b15fd6640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T05:55:03.181 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:03.182+0000 7f7fce144640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:03.198 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:03.198+0000 7efd4e994640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:03.205 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:03.206+0000 7f0b0de08640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:03.279 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:55:03.654 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-10T05:55:03.654 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":13,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:55:02.902547+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T05:54:55.207944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:55:03.672 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T05:55:03.799 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:03.798+0000 7fdba4308640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T05:55:03.830 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:03.830+0000 7fdb9c13a640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:04.605 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:04.599+0000 7f0a6d8c7640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T05:55:04.605 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:04.599+0000 7f6d46240640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T05:55:04.627 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:04.623+0000 7f0a64ee7640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:04.627 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:04.623+0000 7f6d3d860640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:04.655 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:04.651+0000 7f90b454b640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T05:55:04.691 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:04.687+0000 7f90ac37d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T05:55:10.480 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T05:55:10.789 INFO:teuthology.misc.health.smithi070.stdout: 2024-09-10T05:55:10.790 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":19,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:55:08.985221+0000","last_up_change":"2024-09-10T05:55:04.950402+0000","last_in_change":"2024-09-10T05:54:55.207944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:55:05.674567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6801","nonce":3378450542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6803","nonce":3378450542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6807","nonce":3378450542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6805","nonce":3378450542}]},"public_addr":"172.21.15.70:6801/3378450542","cluster_addr":"172.21.15.70:6803/3378450542","heartbeat_back_addr":"172.21.15.70:6807/3378450542","heartbeat_front_addr":"172.21.15.70:6805/3378450542","state":["exists","up"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6809","nonce":841653474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6811","nonce":841653474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6815","nonce":841653474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6813","nonce":841653474}]},"public_addr":"172.21.15.70:6809/841653474","cluster_addr":"172.21.15.70:6811/841653474","heartbeat_back_addr":"172.21.15.70:6815/841653474","heartbeat_front_addr":"172.21.15.70:6813/841653474","state":["exists","up"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6817","nonce":2429334233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6819","nonce":2429334233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6823","nonce":2429334233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6821","nonce":2429334233}]},"public_addr":"172.21.15.70:6817/2429334233","cluster_addr":"172.21.15.70:6819/2429334233","heartbeat_back_addr":"172.21.15.70:6823/2429334233","heartbeat_front_addr":"172.21.15.70:6821/2429334233","state":["exists","up"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6825","nonce":128774917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6827","nonce":128774917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6831","nonce":128774917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6829","nonce":128774917}]},"public_addr":"172.21.15.70:6825/128774917","cluster_addr":"172.21.15.70:6827/128774917","heartbeat_back_addr":"172.21.15.70:6831/128774917","heartbeat_front_addr":"172.21.15.70:6829/128774917","state":["exists","up"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6801","nonce":2565298170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6803","nonce":2565298170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6807","nonce":2565298170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6805","nonce":2565298170}]},"public_addr":"172.21.15.98:6801/2565298170","cluster_addr":"172.21.15.98:6803/2565298170","heartbeat_back_addr":"172.21.15.98:6807/2565298170","heartbeat_front_addr":"172.21.15.98:6805/2565298170","state":["exists","up"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6825","nonce":1681543764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6827","nonce":1681543764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6831","nonce":1681543764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6829","nonce":1681543764}]},"public_addr":"172.21.15.98:6825/1681543764","cluster_addr":"172.21.15.98:6827/1681543764","heartbeat_back_addr":"172.21.15.98:6831/1681543764","heartbeat_front_addr":"172.21.15.98:6829/1681543764","state":["exists","up"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6817","nonce":2743355861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6819","nonce":2743355861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6823","nonce":2743355861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6821","nonce":2743355861}]},"public_addr":"172.21.15.98:6817/2743355861","cluster_addr":"172.21.15.98:6819/2743355861","heartbeat_back_addr":"172.21.15.98:6823/2743355861","heartbeat_front_addr":"172.21.15.98:6821/2743355861","state":["exists","up"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6809","nonce":134608104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6811","nonce":134608104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6815","nonce":134608104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6813","nonce":134608104}]},"public_addr":"172.21.15.98:6809/134608104","cluster_addr":"172.21.15.98:6811/134608104","heartbeat_back_addr":"172.21.15.98:6815/134608104","heartbeat_front_addr":"172.21.15.98:6813/134608104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.657166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.779551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.757932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.247018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.648338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.605178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.839697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.929351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:55:10.809 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T05:55:10.809 INFO:tasks.ceph:Creating RBD pool 2024-09-10T05:55:10.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T05:55:11.220 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2024-09-10T05:55:11.244 DEBUG:teuthology.orchestra.run.smithi070:> rbd --cluster ceph pool init rbd 2024-09-10T05:55:14.347 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T05:55:14.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T05:55:14.348 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T05:55:14.669 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:14.690 INFO:teuthology.orchestra.run.smithi070.stdout:[{"version":9,"timestamp":"2024-09-10T05:55:04.660255+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5351.004242"}]}] 2024-09-10T05:55:14.690 INFO:tasks.ceph_manager:config epoch is 9 2024-09-10T05:55:14.690 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T05:55:14.691 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T05:55:14.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T05:55:15.051 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:15.069 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1969692347},{"type":"v1","addr":"172.21.15.98:6833","nonce":1969692347}]},"active_addr":"172.21.15.98:6833/1969692347","active_change":"2024-09-10T05:54:57.621256+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4120,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":425015874}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":2529452739}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1996992143}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":2773165728}]}]} 2024-09-10T05:55:15.075 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T05:55:15.075 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T05:55:15.075 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:55:15.384 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:15.384 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:55:14.240730+0000","last_up_change":"2024-09-10T05:55:04.950402+0000","last_in_change":"2024-09-10T05:54:55.207944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:55:05.674567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:55:11.127613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6801","nonce":3378450542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6803","nonce":3378450542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6807","nonce":3378450542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6805","nonce":3378450542}]},"public_addr":"172.21.15.70:6801/3378450542","cluster_addr":"172.21.15.70:6803/3378450542","heartbeat_back_addr":"172.21.15.70:6807/3378450542","heartbeat_front_addr":"172.21.15.70:6805/3378450542","state":["exists","up"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6809","nonce":841653474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6811","nonce":841653474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6815","nonce":841653474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6813","nonce":841653474}]},"public_addr":"172.21.15.70:6809/841653474","cluster_addr":"172.21.15.70:6811/841653474","heartbeat_back_addr":"172.21.15.70:6815/841653474","heartbeat_front_addr":"172.21.15.70:6813/841653474","state":["exists","up"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6817","nonce":2429334233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6819","nonce":2429334233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6823","nonce":2429334233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6821","nonce":2429334233}]},"public_addr":"172.21.15.70:6817/2429334233","cluster_addr":"172.21.15.70:6819/2429334233","heartbeat_back_addr":"172.21.15.70:6823/2429334233","heartbeat_front_addr":"172.21.15.70:6821/2429334233","state":["exists","up"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6825","nonce":128774917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6827","nonce":128774917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6831","nonce":128774917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6829","nonce":128774917}]},"public_addr":"172.21.15.70:6825/128774917","cluster_addr":"172.21.15.70:6827/128774917","heartbeat_back_addr":"172.21.15.70:6831/128774917","heartbeat_front_addr":"172.21.15.70:6829/128774917","state":["exists","up"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6801","nonce":2565298170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6803","nonce":2565298170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6807","nonce":2565298170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6805","nonce":2565298170}]},"public_addr":"172.21.15.98:6801/2565298170","cluster_addr":"172.21.15.98:6803/2565298170","heartbeat_back_addr":"172.21.15.98:6807/2565298170","heartbeat_front_addr":"172.21.15.98:6805/2565298170","state":["exists","up"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6825","nonce":1681543764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6827","nonce":1681543764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6831","nonce":1681543764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6829","nonce":1681543764}]},"public_addr":"172.21.15.98:6825/1681543764","cluster_addr":"172.21.15.98:6827/1681543764","heartbeat_back_addr":"172.21.15.98:6831/1681543764","heartbeat_front_addr":"172.21.15.98:6829/1681543764","state":["exists","up"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6817","nonce":2743355861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6819","nonce":2743355861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6823","nonce":2743355861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6821","nonce":2743355861}]},"public_addr":"172.21.15.98:6817/2743355861","cluster_addr":"172.21.15.98:6819/2743355861","heartbeat_back_addr":"172.21.15.98:6823/2743355861","heartbeat_front_addr":"172.21.15.98:6821/2743355861","state":["exists","up"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6809","nonce":134608104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6811","nonce":134608104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6815","nonce":134608104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6813","nonce":134608104}]},"public_addr":"172.21.15.98:6809/134608104","cluster_addr":"172.21.15.98:6811/134608104","heartbeat_back_addr":"172.21.15.98:6815/134608104","heartbeat_front_addr":"172.21.15.98:6813/134608104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.657166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.779551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.757932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.247018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.648338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.605178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.839697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.929351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:55:15.403 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T05:55:15.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:55:15.696 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:15.696 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:55:14.240730+0000","last_up_change":"2024-09-10T05:55:04.950402+0000","last_in_change":"2024-09-10T05:54:55.207944+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:55:05.674567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:55:11.127613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6801","nonce":3378450542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6803","nonce":3378450542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6807","nonce":3378450542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6805","nonce":3378450542}]},"public_addr":"172.21.15.70:6801/3378450542","cluster_addr":"172.21.15.70:6803/3378450542","heartbeat_back_addr":"172.21.15.70:6807/3378450542","heartbeat_front_addr":"172.21.15.70:6805/3378450542","state":["exists","up"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6809","nonce":841653474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6811","nonce":841653474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6815","nonce":841653474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6813","nonce":841653474}]},"public_addr":"172.21.15.70:6809/841653474","cluster_addr":"172.21.15.70:6811/841653474","heartbeat_back_addr":"172.21.15.70:6815/841653474","heartbeat_front_addr":"172.21.15.70:6813/841653474","state":["exists","up"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6817","nonce":2429334233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6819","nonce":2429334233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6823","nonce":2429334233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6821","nonce":2429334233}]},"public_addr":"172.21.15.70:6817/2429334233","cluster_addr":"172.21.15.70:6819/2429334233","heartbeat_back_addr":"172.21.15.70:6823/2429334233","heartbeat_front_addr":"172.21.15.70:6821/2429334233","state":["exists","up"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6825","nonce":128774917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6827","nonce":128774917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6831","nonce":128774917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6829","nonce":128774917}]},"public_addr":"172.21.15.70:6825/128774917","cluster_addr":"172.21.15.70:6827/128774917","heartbeat_back_addr":"172.21.15.70:6831/128774917","heartbeat_front_addr":"172.21.15.70:6829/128774917","state":["exists","up"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6801","nonce":2565298170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6803","nonce":2565298170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6807","nonce":2565298170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6805","nonce":2565298170}]},"public_addr":"172.21.15.98:6801/2565298170","cluster_addr":"172.21.15.98:6803/2565298170","heartbeat_back_addr":"172.21.15.98:6807/2565298170","heartbeat_front_addr":"172.21.15.98:6805/2565298170","state":["exists","up"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6825","nonce":1681543764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6827","nonce":1681543764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6831","nonce":1681543764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6829","nonce":1681543764}]},"public_addr":"172.21.15.98:6825/1681543764","cluster_addr":"172.21.15.98:6827/1681543764","heartbeat_back_addr":"172.21.15.98:6831/1681543764","heartbeat_front_addr":"172.21.15.98:6829/1681543764","state":["exists","up"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6817","nonce":2743355861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6819","nonce":2743355861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6823","nonce":2743355861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6821","nonce":2743355861}]},"public_addr":"172.21.15.98:6817/2743355861","cluster_addr":"172.21.15.98:6819/2743355861","heartbeat_back_addr":"172.21.15.98:6823/2743355861","heartbeat_front_addr":"172.21.15.98:6821/2743355861","state":["exists","up"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6809","nonce":134608104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6811","nonce":134608104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6815","nonce":134608104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6813","nonce":134608104}]},"public_addr":"172.21.15.98:6809/134608104","cluster_addr":"172.21.15.98:6811/134608104","heartbeat_back_addr":"172.21.15.98:6815/134608104","heartbeat_front_addr":"172.21.15.98:6813/134608104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.657166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.779551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.757932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.247018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.648338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.605178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.839697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.929351+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:55:15.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T05:55:15.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T05:55:15.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T05:55:15.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T05:55:15.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T05:55:15.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T05:55:15.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T05:55:15.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T05:55:15.962 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-10T05:55:15.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T05:55:15.965 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:15.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:55:15.966 INFO:teuthology.orchestra.run.smithi070.stdout:60129542150 2024-09-10T05:55:15.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:55:15.979 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:15.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:55:15.984 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-10T05:55:15.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T05:55:15.988 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-10T05:55:15.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T05:55:15.989 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:15.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:55:16.005 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:16.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T05:55:16.496 INFO:teuthology.orchestra.run.smithi070.stdout:64424509442 2024-09-10T05:55:16.497 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-10T05:55:16.498 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:16.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.5 2024-09-10T05:55:16.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-10T05:55:16.528 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:16.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2024-09-10T05:55:16.539 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:16.551 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-10T05:55:16.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-09-10T05:55:16.565 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:16.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-10T05:55:16.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-09-10T05:55:16.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-09-10T05:55:16.584 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:16.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-10T05:55:17.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T05:55:17.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T05:55:17.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:55:17.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:55:17.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:55:17.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T05:55:17.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:55:17.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T05:55:18.050 INFO:teuthology.orchestra.run.smithi070.stdout:64424509442 2024-09-10T05:55:18.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.5 2024-09-10T05:55:18.092 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-10T05:55:18.108 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:18.116 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:18.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-10T05:55:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-10T05:55:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:18.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2024-09-10T05:55:18.134 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:18.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-09-10T05:55:18.150 INFO:teuthology.orchestra.run.smithi070.stdout:60129542148 2024-09-10T05:55:18.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-09-10T05:55:18.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-10T05:55:18.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-09-10T05:55:18.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-10T05:55:19.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T05:55:19.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T05:55:19.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:55:19.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:55:19.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T05:55:19.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:55:19.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:55:19.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T05:55:19.596 INFO:teuthology.orchestra.run.smithi070.stdout:64424509444 2024-09-10T05:55:19.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.5 2024-09-10T05:55:19.621 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.639 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-10T05:55:19.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-10T05:55:19.666 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.679 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:19.691 INFO:teuthology.orchestra.run.smithi070.stdout:60129542150 2024-09-10T05:55:19.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-10T05:55:19.700 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.701 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:19.712 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:19.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-10T05:55:19.721 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-10T05:55:19.722 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.723 INFO:teuthology.orchestra.run.smithi070.stdout:64424509446 2024-09-10T05:55:19.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-10T05:55:19.736 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.744 INFO:teuthology.orchestra.run.smithi070.stdout:60129542149 2024-09-10T05:55:19.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-10T05:55:19.745 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-10T05:55:19.761 DEBUG:teuthology.parallel:result is None 2024-09-10T05:55:19.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T05:55:19.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:55:20.083 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:20.083 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:55:20.100 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T05:55:19.634455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235904,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738816,"statfs":{"total":773094113280,"available":772852547584,"internally_reserved":0,"allocated":3063808,"data_stored":1827694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.398143"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.287785+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:55:14.287785+0000","last_peered":"2024-09-10T05:55:14.287785+0000","last_clean":"2024-09-10T05:55:14.287785+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:55:14.287785+0000","last_undegraded":"2024-09-10T05:55:14.287785+0000","last_fullsized":"2024-09-10T05:55:14.287785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.267516+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:55:14.267516+0000","last_peered":"2024-09-10T05:55:14.267516+0000","last_clean":"2024-09-10T05:55:14.267516+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:55:14.267516+0000","last_undegraded":"2024-09-10T05:55:14.267516+0000","last_fullsized":"2024-09-10T05:55:14.267516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.909663+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:55:14.909663+0000","last_peered":"2024-09-10T05:55:14.909663+0000","last_clean":"2024-09-10T05:55:14.909663+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:55:14.909663+0000","last_undegraded":"2024-09-10T05:55:14.909663+0000","last_fullsized":"2024-09-10T05:55:14.909663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.267290+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:55:14.267290+0000","last_peered":"2024-09-10T05:55:14.267290+0000","last_clean":"2024-09-10T05:55:14.267290+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:55:14.267290+0000","last_undegraded":"2024-09-10T05:55:14.267290+0000","last_fullsized":"2024-09-10T05:55:14.267290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.262963+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:55:14.262963+0000","last_peered":"2024-09-10T05:55:14.262963+0000","last_clean":"2024-09-10T05:55:14.262963+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:55:14.262963+0000","last_undegraded":"2024-09-10T05:55:14.262963+0000","last_fullsized":"2024-09-10T05:55:14.262963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.253426+0000","last_change":"2024-09-10T05:55:14.253426+0000","last_active":"2024-09-10T05:55:14.253426+0000","last_peered":"2024-09-10T05:55:14.253426+0000","last_clean":"2024-09-10T05:55:14.253426+0000","last_became_active":"2024-09-10T05:55:12.625451+0000","last_became_peered":"2024-09-10T05:55:12.625451+0000","last_unstale":"2024-09-10T05:55:14.253426+0000","last_undegraded":"2024-09-10T05:55:14.253426+0000","last_fullsized":"2024-09-10T05:55:14.253426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:39.260823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.909715+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:55:14.909715+0000","last_peered":"2024-09-10T05:55:14.909715+0000","last_clean":"2024-09-10T05:55:14.909715+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:55:14.909715+0000","last_undegraded":"2024-09-10T05:55:14.909715+0000","last_fullsized":"2024-09-10T05:55:14.909715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.260381+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:55:14.260381+0000","last_peered":"2024-09-10T05:55:14.260381+0000","last_clean":"2024-09-10T05:55:14.260381+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:55:14.260381+0000","last_undegraded":"2024-09-10T05:55:14.260381+0000","last_fullsized":"2024-09-10T05:55:14.260381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.908635+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:55:14.908635+0000","last_peered":"2024-09-10T05:55:14.908635+0000","last_clean":"2024-09-10T05:55:14.908635+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:55:14.908635+0000","last_undegraded":"2024-09-10T05:55:14.908635+0000","last_fullsized":"2024-09-10T05:55:14.908635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":671233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":80884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":237568,"data_stored":80884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":671233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:55:20.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:55:20.378 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:20.379 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:55:20.395 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-10T05:55:19.634455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235904,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738816,"statfs":{"total":773094113280,"available":772852547584,"internally_reserved":0,"allocated":3063808,"data_stored":1827694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.398143"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.287785+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:55:14.287785+0000","last_peered":"2024-09-10T05:55:14.287785+0000","last_clean":"2024-09-10T05:55:14.287785+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:55:14.287785+0000","last_undegraded":"2024-09-10T05:55:14.287785+0000","last_fullsized":"2024-09-10T05:55:14.287785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.267516+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:55:14.267516+0000","last_peered":"2024-09-10T05:55:14.267516+0000","last_clean":"2024-09-10T05:55:14.267516+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:55:14.267516+0000","last_undegraded":"2024-09-10T05:55:14.267516+0000","last_fullsized":"2024-09-10T05:55:14.267516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.909663+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:55:14.909663+0000","last_peered":"2024-09-10T05:55:14.909663+0000","last_clean":"2024-09-10T05:55:14.909663+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:55:14.909663+0000","last_undegraded":"2024-09-10T05:55:14.909663+0000","last_fullsized":"2024-09-10T05:55:14.909663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.267290+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:55:14.267290+0000","last_peered":"2024-09-10T05:55:14.267290+0000","last_clean":"2024-09-10T05:55:14.267290+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:55:14.267290+0000","last_undegraded":"2024-09-10T05:55:14.267290+0000","last_fullsized":"2024-09-10T05:55:14.267290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.262963+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:55:14.262963+0000","last_peered":"2024-09-10T05:55:14.262963+0000","last_clean":"2024-09-10T05:55:14.262963+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:55:14.262963+0000","last_undegraded":"2024-09-10T05:55:14.262963+0000","last_fullsized":"2024-09-10T05:55:14.262963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.253426+0000","last_change":"2024-09-10T05:55:14.253426+0000","last_active":"2024-09-10T05:55:14.253426+0000","last_peered":"2024-09-10T05:55:14.253426+0000","last_clean":"2024-09-10T05:55:14.253426+0000","last_became_active":"2024-09-10T05:55:12.625451+0000","last_became_peered":"2024-09-10T05:55:12.625451+0000","last_unstale":"2024-09-10T05:55:14.253426+0000","last_undegraded":"2024-09-10T05:55:14.253426+0000","last_fullsized":"2024-09-10T05:55:14.253426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:39.260823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.909715+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:55:14.909715+0000","last_peered":"2024-09-10T05:55:14.909715+0000","last_clean":"2024-09-10T05:55:14.909715+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:55:14.909715+0000","last_undegraded":"2024-09-10T05:55:14.909715+0000","last_fullsized":"2024-09-10T05:55:14.909715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.260381+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:55:14.260381+0000","last_peered":"2024-09-10T05:55:14.260381+0000","last_clean":"2024-09-10T05:55:14.260381+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:55:14.260381+0000","last_undegraded":"2024-09-10T05:55:14.260381+0000","last_fullsized":"2024-09-10T05:55:14.260381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-10T05:55:14.908635+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:55:14.908635+0000","last_peered":"2024-09-10T05:55:14.908635+0000","last_clean":"2024-09-10T05:55:14.908635+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:55:14.908635+0000","last_undegraded":"2024-09-10T05:55:14.908635+0000","last_fullsized":"2024-09-10T05:55:14.908635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":671233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":80884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":80865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":237568,"data_stored":80884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":671233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:55:20.396 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T05:55:20.396 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T05:55:20.396 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T05:55:20.396 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T05:55:20.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:20.711 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T05:55:20.729 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T05:55:20.729 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T05:55:20.744 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T05:55:20.744 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T05:55:20.744 INFO:tasks.rgw:Creating data pools 2024-09-10T05:55:20.744 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T05:55:20.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-10T05:55:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T05:55:21.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T05:55:22.523 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T05:55:22.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T05:55:23.522 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T05:55:23.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T05:55:24.540 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T05:55:24.593 DEBUG:tasks.rgw:Pools created 2024-09-10T05:55:24.594 INFO:tasks.rgw:Starting rgw... 2024-09-10T05:55:24.594 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T05:55:24.594 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T05:55:24.595 DEBUG:teuthology.orchestra.run.smithi070:> sudo echo -n http://smithi070.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T05:55:24.606 INFO:teuthology.orchestra.run.smithi070.stdout:http://smithi070.front.sepia.ceph.com:80 2024-09-10T05:55:24.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T05:55:24.658 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T05:55:24.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T05:55:24.702 INFO:tasks.rgw.client.0:Started 2024-09-10T05:55:24.702 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi070.front.sepia.ceph.com:80/ 2024-09-10T05:55:24.702 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:80/ 2024-09-10T05:55:24.957 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:55:24.957 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:55:24.959 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:55:24.959 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:55:24.959 INFO:teuthology.orchestra.run.smithi070.stderr:curl: (7) Failed to connect to smithi070.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:55:25.960 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:80/ 2024-09-10T05:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:55:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:curl: (7) Failed to connect to smithi070.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:55:25.973 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:55:27.974 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:80/ 2024-09-10T05:55:27.986 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:55:27.986 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:55:27.986 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:55:27.986 INFO:teuthology.orchestra.run.smithi070.stderr:curl: (7) Failed to connect to smithi070.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:55:27.987 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:55:31.988 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:80/ 2024-09-10T05:55:32.000 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:55:32.001 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:55:32.001 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T05:55:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:curl: (7) Failed to connect to smithi070.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T05:55:32.001 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T05:55:40.003 DEBUG:teuthology.orchestra.run.smithi070:> curl http://smithi070.front.sepia.ceph.com:80/ 2024-09-10T05:55:40.014 INFO:teuthology.orchestra.run.smithi070.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T05:55:40.015 INFO:teuthology.orchestra.run.smithi070.stderr: Dload Upload Total Spent Left Speed 2024-09-10T05:55:40.017 INFO:teuthology.orchestra.run.smithi070.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 61211 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-10T05:55:40.018 INFO:teuthology.orchestra.run.smithi070.stdout:anonymous 2024-09-10T05:55:40.018 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-10T05:55:40.031 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-10T05:55:40.031 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cls-rgw-busy-resharding', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-10T05:55:40.032 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-10T05:55:40.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-10T05:55:40.399 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-10T05:55:40.399 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T05:55:40.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:55:40.719 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:55:40.733 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-10T05:55:39.642662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":512,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249888,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724832,"statfs":{"total":773094113280,"available":772838227968,"internally_reserved":0,"allocated":4669440,"data_stored":2596580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3548,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":973,"num_read_kb":702,"num_write":608,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004198"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638333+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:55:33.638333+0000","last_peered":"2024-09-10T05:55:33.638333+0000","last_clean":"2024-09-10T05:55:33.638333+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:55:33.638333+0000","last_undegraded":"2024-09-10T05:55:33.638333+0000","last_fullsized":"2024-09-10T05:55:33.638333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607171+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:55:33.607171+0000","last_peered":"2024-09-10T05:55:33.607171+0000","last_clean":"2024-09-10T05:55:33.607171+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:55:33.607171+0000","last_undegraded":"2024-09-10T05:55:33.607171+0000","last_fullsized":"2024-09-10T05:55:33.607171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612330+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:55:33.612330+0000","last_peered":"2024-09-10T05:55:33.612330+0000","last_clean":"2024-09-10T05:55:33.612330+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:55:33.612330+0000","last_undegraded":"2024-09-10T05:55:33.612330+0000","last_fullsized":"2024-09-10T05:55:33.612330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636323+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:55:33.636323+0000","last_peered":"2024-09-10T05:55:33.636323+0000","last_clean":"2024-09-10T05:55:33.636323+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:55:33.636323+0000","last_undegraded":"2024-09-10T05:55:33.636323+0000","last_fullsized":"2024-09-10T05:55:33.636323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624536+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:55:33.624536+0000","last_peered":"2024-09-10T05:55:33.624536+0000","last_clean":"2024-09-10T05:55:33.624536+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:55:33.624536+0000","last_undegraded":"2024-09-10T05:55:33.624536+0000","last_fullsized":"2024-09-10T05:55:33.624536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653499+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:55:33.653499+0000","last_peered":"2024-09-10T05:55:33.653499+0000","last_clean":"2024-09-10T05:55:33.653499+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:55:33.653499+0000","last_undegraded":"2024-09-10T05:55:33.653499+0000","last_fullsized":"2024-09-10T05:55:33.653499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608346+0000","last_change":"2024-09-10T05:55:22.559003+0000","last_active":"2024-09-10T05:55:33.608346+0000","last_peered":"2024-09-10T05:55:33.608346+0000","last_clean":"2024-09-10T05:55:33.608346+0000","last_became_active":"2024-09-10T05:55:22.558263+0000","last_became_peered":"2024-09-10T05:55:22.558263+0000","last_unstale":"2024-09-10T05:55:33.608346+0000","last_undegraded":"2024-09-10T05:55:33.608346+0000","last_fullsized":"2024-09-10T05:55:33.608346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623121+0000","last_change":"2024-09-10T05:55:24.571167+0000","last_active":"2024-09-10T05:55:33.623121+0000","last_peered":"2024-09-10T05:55:33.623121+0000","last_clean":"2024-09-10T05:55:33.623121+0000","last_became_active":"2024-09-10T05:55:24.570461+0000","last_became_peered":"2024-09-10T05:55:24.570461+0000","last_unstale":"2024-09-10T05:55:33.623121+0000","last_undegraded":"2024-09-10T05:55:33.623121+0000","last_fullsized":"2024-09-10T05:55:33.623121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:12.188381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637428+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:55:33.637428+0000","last_peered":"2024-09-10T05:55:33.637428+0000","last_clean":"2024-09-10T05:55:33.637428+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:55:33.637428+0000","last_undegraded":"2024-09-10T05:55:33.637428+0000","last_fullsized":"2024-09-10T05:55:33.637428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646345+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:55:33.646345+0000","last_peered":"2024-09-10T05:55:33.646345+0000","last_clean":"2024-09-10T05:55:33.646345+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:55:33.646345+0000","last_undegraded":"2024-09-10T05:55:33.646345+0000","last_fullsized":"2024-09-10T05:55:33.646345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607683+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:55:33.607683+0000","last_peered":"2024-09-10T05:55:33.607683+0000","last_clean":"2024-09-10T05:55:33.607683+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:55:33.607683+0000","last_undegraded":"2024-09-10T05:55:33.607683+0000","last_fullsized":"2024-09-10T05:55:33.607683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654672+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:55:33.654672+0000","last_peered":"2024-09-10T05:55:33.654672+0000","last_clean":"2024-09-10T05:55:33.654672+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:55:33.654672+0000","last_undegraded":"2024-09-10T05:55:33.654672+0000","last_fullsized":"2024-09-10T05:55:33.654672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636531+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:55:33.636531+0000","last_peered":"2024-09-10T05:55:33.636531+0000","last_clean":"2024-09-10T05:55:33.636531+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:55:33.636531+0000","last_undegraded":"2024-09-10T05:55:33.636531+0000","last_fullsized":"2024-09-10T05:55:33.636531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607910+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:55:33.607910+0000","last_peered":"2024-09-10T05:55:33.607910+0000","last_clean":"2024-09-10T05:55:33.607910+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:55:33.607910+0000","last_undegraded":"2024-09-10T05:55:33.607910+0000","last_fullsized":"2024-09-10T05:55:33.607910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632290+0000","last_change":"2024-09-10T05:55:22.557400+0000","last_active":"2024-09-10T05:55:33.632290+0000","last_peered":"2024-09-10T05:55:33.632290+0000","last_clean":"2024-09-10T05:55:33.632290+0000","last_became_active":"2024-09-10T05:55:22.557071+0000","last_became_peered":"2024-09-10T05:55:22.557071+0000","last_unstale":"2024-09-10T05:55:33.632290+0000","last_undegraded":"2024-09-10T05:55:33.632290+0000","last_fullsized":"2024-09-10T05:55:33.632290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:33.841554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.672091+0000","last_change":"2024-09-10T05:55:24.573619+0000","last_active":"2024-09-10T05:55:33.672091+0000","last_peered":"2024-09-10T05:55:33.672091+0000","last_clean":"2024-09-10T05:55:33.672091+0000","last_became_active":"2024-09-10T05:55:24.572932+0000","last_became_peered":"2024-09-10T05:55:24.572932+0000","last_unstale":"2024-09-10T05:55:33.672091+0000","last_undegraded":"2024-09-10T05:55:33.672091+0000","last_fullsized":"2024-09-10T05:55:33.672091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:45.073700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652921+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:55:33.652921+0000","last_peered":"2024-09-10T05:55:33.652921+0000","last_clean":"2024-09-10T05:55:33.652921+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:55:33.652921+0000","last_undegraded":"2024-09-10T05:55:33.652921+0000","last_fullsized":"2024-09-10T05:55:33.652921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638603+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:55:33.638603+0000","last_peered":"2024-09-10T05:55:33.638603+0000","last_clean":"2024-09-10T05:55:33.638603+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:55:33.638603+0000","last_undegraded":"2024-09-10T05:55:33.638603+0000","last_fullsized":"2024-09-10T05:55:33.638603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636453+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:55:33.636453+0000","last_peered":"2024-09-10T05:55:33.636453+0000","last_clean":"2024-09-10T05:55:33.636453+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:55:33.636453+0000","last_undegraded":"2024-09-10T05:55:33.636453+0000","last_fullsized":"2024-09-10T05:55:33.636453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646798+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:55:33.646798+0000","last_peered":"2024-09-10T05:55:33.646798+0000","last_clean":"2024-09-10T05:55:33.646798+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:55:33.646798+0000","last_undegraded":"2024-09-10T05:55:33.646798+0000","last_fullsized":"2024-09-10T05:55:33.646798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608161+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:55:33.608161+0000","last_peered":"2024-09-10T05:55:33.608161+0000","last_clean":"2024-09-10T05:55:33.608161+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:55:33.608161+0000","last_undegraded":"2024-09-10T05:55:33.608161+0000","last_fullsized":"2024-09-10T05:55:33.608161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647203+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:55:33.647203+0000","last_peered":"2024-09-10T05:55:33.647203+0000","last_clean":"2024-09-10T05:55:33.647203+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:55:33.647203+0000","last_undegraded":"2024-09-10T05:55:33.647203+0000","last_fullsized":"2024-09-10T05:55:33.647203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670995+0000","last_change":"2024-09-10T05:55:24.571973+0000","last_active":"2024-09-10T05:55:33.670995+0000","last_peered":"2024-09-10T05:55:33.670995+0000","last_clean":"2024-09-10T05:55:33.670995+0000","last_became_active":"2024-09-10T05:55:24.571283+0000","last_became_peered":"2024-09-10T05:55:24.571283+0000","last_unstale":"2024-09-10T05:55:33.670995+0000","last_undegraded":"2024-09-10T05:55:33.670995+0000","last_fullsized":"2024-09-10T05:55:33.670995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:51.405782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654255+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:55:33.654255+0000","last_peered":"2024-09-10T05:55:33.654255+0000","last_clean":"2024-09-10T05:55:33.654255+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:55:33.654255+0000","last_undegraded":"2024-09-10T05:55:33.654255+0000","last_fullsized":"2024-09-10T05:55:33.654255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671583+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:55:33.671583+0000","last_peered":"2024-09-10T05:55:33.671583+0000","last_clean":"2024-09-10T05:55:33.671583+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:55:33.671583+0000","last_undegraded":"2024-09-10T05:55:33.671583+0000","last_fullsized":"2024-09-10T05:55:33.671583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632544+0000","last_change":"2024-09-10T05:55:22.552632+0000","last_active":"2024-09-10T05:55:33.632544+0000","last_peered":"2024-09-10T05:55:33.632544+0000","last_clean":"2024-09-10T05:55:33.632544+0000","last_became_active":"2024-09-10T05:55:22.550781+0000","last_became_peered":"2024-09-10T05:55:22.550781+0000","last_unstale":"2024-09-10T05:55:33.632544+0000","last_undegraded":"2024-09-10T05:55:33.632544+0000","last_fullsized":"2024-09-10T05:55:33.632544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:50.331419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654811+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:55:33.654811+0000","last_peered":"2024-09-10T05:55:33.654811+0000","last_clean":"2024-09-10T05:55:33.654811+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:55:33.654811+0000","last_undegraded":"2024-09-10T05:55:33.654811+0000","last_fullsized":"2024-09-10T05:55:33.654811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623276+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:55:33.623276+0000","last_peered":"2024-09-10T05:55:33.623276+0000","last_clean":"2024-09-10T05:55:33.623276+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:55:33.623276+0000","last_undegraded":"2024-09-10T05:55:33.623276+0000","last_fullsized":"2024-09-10T05:55:33.623276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652818+0000","last_change":"2024-09-10T05:55:32.640522+0000","last_active":"2024-09-10T05:55:33.652818+0000","last_peered":"2024-09-10T05:55:33.652818+0000","last_clean":"2024-09-10T05:55:33.652818+0000","last_became_active":"2024-09-10T05:55:32.638735+0000","last_became_peered":"2024-09-10T05:55:32.638735+0000","last_unstale":"2024-09-10T05:55:33.652818+0000","last_undegraded":"2024-09-10T05:55:33.652818+0000","last_fullsized":"2024-09-10T05:55:33.652818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:26.363476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633459+0000","last_change":"2024-09-10T05:55:24.564828+0000","last_active":"2024-09-10T05:55:33.633459+0000","last_peered":"2024-09-10T05:55:33.633459+0000","last_clean":"2024-09-10T05:55:33.633459+0000","last_became_active":"2024-09-10T05:55:24.564473+0000","last_became_peered":"2024-09-10T05:55:24.564473+0000","last_unstale":"2024-09-10T05:55:33.633459+0000","last_undegraded":"2024-09-10T05:55:33.633459+0000","last_fullsized":"2024-09-10T05:55:33.633459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:54.332302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637651+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:55:33.637651+0000","last_peered":"2024-09-10T05:55:33.637651+0000","last_clean":"2024-09-10T05:55:33.637651+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:55:33.637651+0000","last_undegraded":"2024-09-10T05:55:33.637651+0000","last_fullsized":"2024-09-10T05:55:33.637651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608310+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:55:33.608310+0000","last_peered":"2024-09-10T05:55:33.608310+0000","last_clean":"2024-09-10T05:55:33.608310+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:55:33.608310+0000","last_undegraded":"2024-09-10T05:55:33.608310+0000","last_fullsized":"2024-09-10T05:55:33.608310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"36'21","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.022326+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:55:34.022326+0000","last_peered":"2024-09-10T05:55:34.022326+0000","last_clean":"2024-09-10T05:55:34.022326+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:55:34.022326+0000","last_undegraded":"2024-09-10T05:55:34.022326+0000","last_fullsized":"2024-09-10T05:55:34.022326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638093+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:55:33.638093+0000","last_peered":"2024-09-10T05:55:33.638093+0000","last_clean":"2024-09-10T05:55:33.638093+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:55:33.638093+0000","last_undegraded":"2024-09-10T05:55:33.638093+0000","last_fullsized":"2024-09-10T05:55:33.638093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607144+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:55:33.607144+0000","last_peered":"2024-09-10T05:55:33.607144+0000","last_clean":"2024-09-10T05:55:33.607144+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:55:33.607144+0000","last_undegraded":"2024-09-10T05:55:33.607144+0000","last_fullsized":"2024-09-10T05:55:33.607144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609183+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:55:33.609183+0000","last_peered":"2024-09-10T05:55:33.609183+0000","last_clean":"2024-09-10T05:55:33.609183+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:55:33.609183+0000","last_undegraded":"2024-09-10T05:55:33.609183+0000","last_fullsized":"2024-09-10T05:55:33.609183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623308+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:55:33.623308+0000","last_peered":"2024-09-10T05:55:33.623308+0000","last_clean":"2024-09-10T05:55:33.623308+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:55:33.623308+0000","last_undegraded":"2024-09-10T05:55:33.623308+0000","last_fullsized":"2024-09-10T05:55:33.623308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634366+0000","last_change":"2024-09-10T05:55:26.566912+0000","last_active":"2024-09-10T05:55:33.634366+0000","last_peered":"2024-09-10T05:55:33.634366+0000","last_clean":"2024-09-10T05:55:33.634366+0000","last_became_active":"2024-09-10T05:55:26.566305+0000","last_became_peered":"2024-09-10T05:55:26.566305+0000","last_unstale":"2024-09-10T05:55:33.634366+0000","last_undegraded":"2024-09-10T05:55:33.634366+0000","last_fullsized":"2024-09-10T05:55:33.634366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:56.014911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.314856+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:55:34.314856+0000","last_peered":"2024-09-10T05:55:34.314856+0000","last_clean":"2024-09-10T05:55:34.314856+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:55:34.314856+0000","last_undegraded":"2024-09-10T05:55:34.314856+0000","last_fullsized":"2024-09-10T05:55:34.314856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654743+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:55:33.654743+0000","last_peered":"2024-09-10T05:55:33.654743+0000","last_clean":"2024-09-10T05:55:33.654743+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:55:33.654743+0000","last_undegraded":"2024-09-10T05:55:33.654743+0000","last_fullsized":"2024-09-10T05:55:33.654743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623123+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:55:33.623123+0000","last_peered":"2024-09-10T05:55:33.623123+0000","last_clean":"2024-09-10T05:55:33.623123+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:55:33.623123+0000","last_undegraded":"2024-09-10T05:55:33.623123+0000","last_fullsized":"2024-09-10T05:55:33.623123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625966+0000","last_change":"2024-09-10T05:55:24.571856+0000","last_active":"2024-09-10T05:55:33.625966+0000","last_peered":"2024-09-10T05:55:33.625966+0000","last_clean":"2024-09-10T05:55:33.625966+0000","last_became_active":"2024-09-10T05:55:24.570838+0000","last_became_peered":"2024-09-10T05:55:24.570838+0000","last_unstale":"2024-09-10T05:55:33.625966+0000","last_undegraded":"2024-09-10T05:55:33.625966+0000","last_fullsized":"2024-09-10T05:55:33.625966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:05.305448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636754+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:55:33.636754+0000","last_peered":"2024-09-10T05:55:33.636754+0000","last_clean":"2024-09-10T05:55:33.636754+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:55:33.636754+0000","last_undegraded":"2024-09-10T05:55:33.636754+0000","last_fullsized":"2024-09-10T05:55:33.636754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634903+0000","last_change":"2024-09-10T05:55:26.567407+0000","last_active":"2024-09-10T05:55:33.634903+0000","last_peered":"2024-09-10T05:55:33.634903+0000","last_clean":"2024-09-10T05:55:33.634903+0000","last_became_active":"2024-09-10T05:55:26.566951+0000","last_became_peered":"2024-09-10T05:55:26.566951+0000","last_unstale":"2024-09-10T05:55:33.634903+0000","last_undegraded":"2024-09-10T05:55:33.634903+0000","last_fullsized":"2024-09-10T05:55:33.634903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'22","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.367131+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:55:34.367131+0000","last_peered":"2024-09-10T05:55:34.367131+0000","last_clean":"2024-09-10T05:55:34.367131+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:55:34.367131+0000","last_undegraded":"2024-09-10T05:55:34.367131+0000","last_fullsized":"2024-09-10T05:55:34.367131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637750+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:55:33.637750+0000","last_peered":"2024-09-10T05:55:33.637750+0000","last_clean":"2024-09-10T05:55:33.637750+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:55:33.637750+0000","last_undegraded":"2024-09-10T05:55:33.637750+0000","last_fullsized":"2024-09-10T05:55:33.637750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653697+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:55:33.653697+0000","last_peered":"2024-09-10T05:55:33.653697+0000","last_clean":"2024-09-10T05:55:33.653697+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:55:33.653697+0000","last_undegraded":"2024-09-10T05:55:33.653697+0000","last_fullsized":"2024-09-10T05:55:33.653697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634288+0000","last_change":"2024-09-10T05:55:24.556982+0000","last_active":"2024-09-10T05:55:33.634288+0000","last_peered":"2024-09-10T05:55:33.634288+0000","last_clean":"2024-09-10T05:55:33.634288+0000","last_became_active":"2024-09-10T05:55:24.556683+0000","last_became_peered":"2024-09-10T05:55:24.556683+0000","last_unstale":"2024-09-10T05:55:33.634288+0000","last_undegraded":"2024-09-10T05:55:33.634288+0000","last_fullsized":"2024-09-10T05:55:33.634288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:25.347351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645646+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:55:33.645646+0000","last_peered":"2024-09-10T05:55:33.645646+0000","last_clean":"2024-09-10T05:55:33.645646+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:55:33.645646+0000","last_undegraded":"2024-09-10T05:55:33.645646+0000","last_fullsized":"2024-09-10T05:55:33.645646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607818+0000","last_change":"2024-09-10T05:55:26.573512+0000","last_active":"2024-09-10T05:55:33.607818+0000","last_peered":"2024-09-10T05:55:33.607818+0000","last_clean":"2024-09-10T05:55:33.607818+0000","last_became_active":"2024-09-10T05:55:26.572502+0000","last_became_peered":"2024-09-10T05:55:26.572502+0000","last_unstale":"2024-09-10T05:55:33.607818+0000","last_undegraded":"2024-09-10T05:55:33.607818+0000","last_fullsized":"2024-09-10T05:55:33.607818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:26.420995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.370313+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:55:34.370313+0000","last_peered":"2024-09-10T05:55:34.370313+0000","last_clean":"2024-09-10T05:55:34.370313+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:55:34.370313+0000","last_undegraded":"2024-09-10T05:55:34.370313+0000","last_fullsized":"2024-09-10T05:55:34.370313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632798+0000","last_change":"2024-09-10T05:55:30.608079+0000","last_active":"2024-09-10T05:55:33.632798+0000","last_peered":"2024-09-10T05:55:33.632798+0000","last_clean":"2024-09-10T05:55:33.632798+0000","last_became_active":"2024-09-10T05:55:30.607194+0000","last_became_peered":"2024-09-10T05:55:30.607194+0000","last_unstale":"2024-09-10T05:55:33.632798+0000","last_undegraded":"2024-09-10T05:55:33.632798+0000","last_fullsized":"2024-09-10T05:55:33.632798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:44.793013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609103+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:55:33.609103+0000","last_peered":"2024-09-10T05:55:33.609103+0000","last_clean":"2024-09-10T05:55:33.609103+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:55:33.609103+0000","last_undegraded":"2024-09-10T05:55:33.609103+0000","last_fullsized":"2024-09-10T05:55:33.609103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638758+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:55:33.638758+0000","last_peered":"2024-09-10T05:55:33.638758+0000","last_clean":"2024-09-10T05:55:33.638758+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:55:33.638758+0000","last_undegraded":"2024-09-10T05:55:33.638758+0000","last_fullsized":"2024-09-10T05:55:33.638758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636031+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:55:33.636031+0000","last_peered":"2024-09-10T05:55:33.636031+0000","last_clean":"2024-09-10T05:55:33.636031+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:55:33.636031+0000","last_undegraded":"2024-09-10T05:55:33.636031+0000","last_fullsized":"2024-09-10T05:55:33.636031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"36'25","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.459585+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:55:34.459585+0000","last_peered":"2024-09-10T05:55:34.459585+0000","last_clean":"2024-09-10T05:55:34.459585+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:55:34.459585+0000","last_undegraded":"2024-09-10T05:55:34.459585+0000","last_fullsized":"2024-09-10T05:55:34.459585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610507+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:55:33.610507+0000","last_peered":"2024-09-10T05:55:33.610507+0000","last_clean":"2024-09-10T05:55:33.610507+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:55:33.610507+0000","last_undegraded":"2024-09-10T05:55:33.610507+0000","last_fullsized":"2024-09-10T05:55:33.610507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607765+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:55:33.607765+0000","last_peered":"2024-09-10T05:55:33.607765+0000","last_clean":"2024-09-10T05:55:33.607765+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:55:33.607765+0000","last_undegraded":"2024-09-10T05:55:33.607765+0000","last_fullsized":"2024-09-10T05:55:33.607765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653237+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:55:33.653237+0000","last_peered":"2024-09-10T05:55:33.653237+0000","last_clean":"2024-09-10T05:55:33.653237+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:55:33.653237+0000","last_undegraded":"2024-09-10T05:55:33.653237+0000","last_fullsized":"2024-09-10T05:55:33.653237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638435+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:55:33.638435+0000","last_peered":"2024-09-10T05:55:33.638435+0000","last_clean":"2024-09-10T05:55:33.638435+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:55:33.638435+0000","last_undegraded":"2024-09-10T05:55:33.638435+0000","last_fullsized":"2024-09-10T05:55:33.638435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670520+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:55:33.670520+0000","last_peered":"2024-09-10T05:55:33.670520+0000","last_clean":"2024-09-10T05:55:33.670520+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:55:33.670520+0000","last_undegraded":"2024-09-10T05:55:33.670520+0000","last_fullsized":"2024-09-10T05:55:33.670520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.348474+0000","last_change":"2024-09-10T05:55:28.588127+0000","last_active":"2024-09-10T05:55:34.348474+0000","last_peered":"2024-09-10T05:55:34.348474+0000","last_clean":"2024-09-10T05:55:34.348474+0000","last_became_active":"2024-09-10T05:55:28.587370+0000","last_became_peered":"2024-09-10T05:55:28.587370+0000","last_unstale":"2024-09-10T05:55:34.348474+0000","last_undegraded":"2024-09-10T05:55:34.348474+0000","last_fullsized":"2024-09-10T05:55:34.348474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:12.868467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631518+0000","last_change":"2024-09-10T05:55:30.607579+0000","last_active":"2024-09-10T05:55:33.631518+0000","last_peered":"2024-09-10T05:55:33.631518+0000","last_clean":"2024-09-10T05:55:33.631518+0000","last_became_active":"2024-09-10T05:55:30.606853+0000","last_became_peered":"2024-09-10T05:55:30.606853+0000","last_unstale":"2024-09-10T05:55:33.631518+0000","last_undegraded":"2024-09-10T05:55:33.631518+0000","last_fullsized":"2024-09-10T05:55:33.631518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:26.576932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646702+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:55:33.646702+0000","last_peered":"2024-09-10T05:55:33.646702+0000","last_clean":"2024-09-10T05:55:33.646702+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:55:33.646702+0000","last_undegraded":"2024-09-10T05:55:33.646702+0000","last_fullsized":"2024-09-10T05:55:33.646702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648721+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:55:33.648721+0000","last_peered":"2024-09-10T05:55:33.648721+0000","last_clean":"2024-09-10T05:55:33.648721+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:55:33.648721+0000","last_undegraded":"2024-09-10T05:55:33.648721+0000","last_fullsized":"2024-09-10T05:55:33.648721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639031+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:55:33.639031+0000","last_peered":"2024-09-10T05:55:33.639031+0000","last_clean":"2024-09-10T05:55:33.639031+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:55:33.639031+0000","last_undegraded":"2024-09-10T05:55:33.639031+0000","last_fullsized":"2024-09-10T05:55:33.639031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671324+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:55:33.671324+0000","last_peered":"2024-09-10T05:55:33.671324+0000","last_clean":"2024-09-10T05:55:33.671324+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:55:33.671324+0000","last_undegraded":"2024-09-10T05:55:33.671324+0000","last_fullsized":"2024-09-10T05:55:33.671324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'27","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.269694+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:55:34.269694+0000","last_peered":"2024-09-10T05:55:34.269694+0000","last_clean":"2024-09-10T05:55:34.269694+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:55:34.269694+0000","last_undegraded":"2024-09-10T05:55:34.269694+0000","last_fullsized":"2024-09-10T05:55:34.269694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622183+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:55:33.622183+0000","last_peered":"2024-09-10T05:55:33.622183+0000","last_clean":"2024-09-10T05:55:33.622183+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:55:33.622183+0000","last_undegraded":"2024-09-10T05:55:33.622183+0000","last_fullsized":"2024-09-10T05:55:33.622183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625299+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:55:33.625299+0000","last_peered":"2024-09-10T05:55:33.625299+0000","last_clean":"2024-09-10T05:55:33.625299+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:55:33.625299+0000","last_undegraded":"2024-09-10T05:55:33.625299+0000","last_fullsized":"2024-09-10T05:55:33.625299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624073+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:55:33.624073+0000","last_peered":"2024-09-10T05:55:33.624073+0000","last_clean":"2024-09-10T05:55:33.624073+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:55:33.624073+0000","last_undegraded":"2024-09-10T05:55:33.624073+0000","last_fullsized":"2024-09-10T05:55:33.624073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609006+0000","last_change":"2024-09-10T05:55:22.559608+0000","last_active":"2024-09-10T05:55:33.609006+0000","last_peered":"2024-09-10T05:55:33.609006+0000","last_clean":"2024-09-10T05:55:33.609006+0000","last_became_active":"2024-09-10T05:55:22.558802+0000","last_became_peered":"2024-09-10T05:55:22.558802+0000","last_unstale":"2024-09-10T05:55:33.609006+0000","last_undegraded":"2024-09-10T05:55:33.609006+0000","last_fullsized":"2024-09-10T05:55:33.609006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670947+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:55:33.670947+0000","last_peered":"2024-09-10T05:55:33.670947+0000","last_clean":"2024-09-10T05:55:33.670947+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:55:33.670947+0000","last_undegraded":"2024-09-10T05:55:33.670947+0000","last_fullsized":"2024-09-10T05:55:33.670947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'24","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.047956+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:55:34.047956+0000","last_peered":"2024-09-10T05:55:34.047956+0000","last_clean":"2024-09-10T05:55:34.047956+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:55:34.047956+0000","last_undegraded":"2024-09-10T05:55:34.047956+0000","last_fullsized":"2024-09-10T05:55:34.047956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670332+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:55:33.670332+0000","last_peered":"2024-09-10T05:55:33.670332+0000","last_clean":"2024-09-10T05:55:33.670332+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:55:33.670332+0000","last_undegraded":"2024-09-10T05:55:33.670332+0000","last_fullsized":"2024-09-10T05:55:33.670332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610937+0000","last_change":"2024-09-10T05:55:32.625390+0000","last_active":"2024-09-10T05:55:33.610937+0000","last_peered":"2024-09-10T05:55:33.610937+0000","last_clean":"2024-09-10T05:55:33.610937+0000","last_became_active":"2024-09-10T05:55:32.624651+0000","last_became_peered":"2024-09-10T05:55:32.624651+0000","last_unstale":"2024-09-10T05:55:33.610937+0000","last_undegraded":"2024-09-10T05:55:33.610937+0000","last_fullsized":"2024-09-10T05:55:33.610937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:21.472496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654430+0000","last_change":"2024-09-10T05:55:24.559341+0000","last_active":"2024-09-10T05:55:33.654430+0000","last_peered":"2024-09-10T05:55:33.654430+0000","last_clean":"2024-09-10T05:55:33.654430+0000","last_became_active":"2024-09-10T05:55:24.558589+0000","last_became_peered":"2024-09-10T05:55:24.558589+0000","last_unstale":"2024-09-10T05:55:33.654430+0000","last_undegraded":"2024-09-10T05:55:33.654430+0000","last_fullsized":"2024-09-10T05:55:33.654430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:59.318764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632024+0000","last_change":"2024-09-10T05:55:22.555183+0000","last_active":"2024-09-10T05:55:33.632024+0000","last_peered":"2024-09-10T05:55:33.632024+0000","last_clean":"2024-09-10T05:55:33.632024+0000","last_became_active":"2024-09-10T05:55:22.554019+0000","last_became_peered":"2024-09-10T05:55:22.554019+0000","last_unstale":"2024-09-10T05:55:33.632024+0000","last_undegraded":"2024-09-10T05:55:33.632024+0000","last_fullsized":"2024-09-10T05:55:33.632024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:04.308909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671379+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:55:33.671379+0000","last_peered":"2024-09-10T05:55:33.671379+0000","last_clean":"2024-09-10T05:55:33.671379+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:55:33.671379+0000","last_undegraded":"2024-09-10T05:55:33.671379+0000","last_fullsized":"2024-09-10T05:55:33.671379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'19","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.402075+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:55:34.402075+0000","last_peered":"2024-09-10T05:55:34.402075+0000","last_clean":"2024-09-10T05:55:34.402075+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:55:34.402075+0000","last_undegraded":"2024-09-10T05:55:34.402075+0000","last_fullsized":"2024-09-10T05:55:34.402075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625369+0000","last_change":"2024-09-10T05:55:30.627775+0000","last_active":"2024-09-10T05:55:33.625369+0000","last_peered":"2024-09-10T05:55:33.625369+0000","last_clean":"2024-09-10T05:55:33.625369+0000","last_became_active":"2024-09-10T05:55:30.617486+0000","last_became_peered":"2024-09-10T05:55:30.617486+0000","last_unstale":"2024-09-10T05:55:33.625369+0000","last_undegraded":"2024-09-10T05:55:33.625369+0000","last_fullsized":"2024-09-10T05:55:33.625369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:42.641816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631783+0000","last_change":"2024-09-10T05:55:32.622452+0000","last_active":"2024-09-10T05:55:33.631783+0000","last_peered":"2024-09-10T05:55:33.631783+0000","last_clean":"2024-09-10T05:55:33.631783+0000","last_became_active":"2024-09-10T05:55:32.621526+0000","last_became_peered":"2024-09-10T05:55:32.621526+0000","last_unstale":"2024-09-10T05:55:33.631783+0000","last_undegraded":"2024-09-10T05:55:33.631783+0000","last_fullsized":"2024-09-10T05:55:33.631783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:10.744428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654962+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:55:33.654962+0000","last_peered":"2024-09-10T05:55:33.654962+0000","last_clean":"2024-09-10T05:55:33.654962+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:55:33.654962+0000","last_undegraded":"2024-09-10T05:55:33.654962+0000","last_fullsized":"2024-09-10T05:55:33.654962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.649026+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:55:33.649026+0000","last_peered":"2024-09-10T05:55:33.649026+0000","last_clean":"2024-09-10T05:55:33.649026+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:55:33.649026+0000","last_undegraded":"2024-09-10T05:55:33.649026+0000","last_fullsized":"2024-09-10T05:55:33.649026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610316+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:55:33.610316+0000","last_peered":"2024-09-10T05:55:33.610316+0000","last_clean":"2024-09-10T05:55:33.610316+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:55:33.610316+0000","last_undegraded":"2024-09-10T05:55:33.610316+0000","last_fullsized":"2024-09-10T05:55:33.610316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.468548+0000","last_change":"2024-09-10T05:55:28.590795+0000","last_active":"2024-09-10T05:55:34.468548+0000","last_peered":"2024-09-10T05:55:34.468548+0000","last_clean":"2024-09-10T05:55:34.468548+0000","last_became_active":"2024-09-10T05:55:28.590012+0000","last_became_peered":"2024-09-10T05:55:28.590012+0000","last_unstale":"2024-09-10T05:55:34.468548+0000","last_undegraded":"2024-09-10T05:55:34.468548+0000","last_fullsized":"2024-09-10T05:55:34.468548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:11.582824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671697+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:55:33.671697+0000","last_peered":"2024-09-10T05:55:33.671697+0000","last_clean":"2024-09-10T05:55:33.671697+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:55:33.671697+0000","last_undegraded":"2024-09-10T05:55:33.671697+0000","last_fullsized":"2024-09-10T05:55:33.671697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612520+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:55:33.612520+0000","last_peered":"2024-09-10T05:55:33.612520+0000","last_clean":"2024-09-10T05:55:33.612520+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:55:33.612520+0000","last_undegraded":"2024-09-10T05:55:33.612520+0000","last_fullsized":"2024-09-10T05:55:33.612520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655417+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:55:33.655417+0000","last_peered":"2024-09-10T05:55:33.655417+0000","last_clean":"2024-09-10T05:55:33.655417+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:55:33.655417+0000","last_undegraded":"2024-09-10T05:55:33.655417+0000","last_fullsized":"2024-09-10T05:55:33.655417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653831+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:55:33.653831+0000","last_peered":"2024-09-10T05:55:33.653831+0000","last_clean":"2024-09-10T05:55:33.653831+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:55:33.653831+0000","last_undegraded":"2024-09-10T05:55:33.653831+0000","last_fullsized":"2024-09-10T05:55:33.653831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608543+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:55:33.608543+0000","last_peered":"2024-09-10T05:55:33.608543+0000","last_clean":"2024-09-10T05:55:33.608543+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:55:33.608543+0000","last_undegraded":"2024-09-10T05:55:33.608543+0000","last_fullsized":"2024-09-10T05:55:33.608543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.279949+0000","last_change":"2024-09-10T05:55:28.613924+0000","last_active":"2024-09-10T05:55:34.279949+0000","last_peered":"2024-09-10T05:55:34.279949+0000","last_clean":"2024-09-10T05:55:34.279949+0000","last_became_active":"2024-09-10T05:55:28.613419+0000","last_became_peered":"2024-09-10T05:55:28.613419+0000","last_unstale":"2024-09-10T05:55:34.279949+0000","last_undegraded":"2024-09-10T05:55:34.279949+0000","last_fullsized":"2024-09-10T05:55:34.279949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646485+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:55:33.646485+0000","last_peered":"2024-09-10T05:55:33.646485+0000","last_clean":"2024-09-10T05:55:33.646485+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:55:33.646485+0000","last_undegraded":"2024-09-10T05:55:33.646485+0000","last_fullsized":"2024-09-10T05:55:33.646485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653579+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:55:33.653579+0000","last_peered":"2024-09-10T05:55:33.653579+0000","last_clean":"2024-09-10T05:55:33.653579+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:55:33.653579+0000","last_undegraded":"2024-09-10T05:55:33.653579+0000","last_fullsized":"2024-09-10T05:55:33.653579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611352+0000","last_change":"2024-09-10T05:55:24.572073+0000","last_active":"2024-09-10T05:55:33.611352+0000","last_peered":"2024-09-10T05:55:33.611352+0000","last_clean":"2024-09-10T05:55:33.611352+0000","last_became_active":"2024-09-10T05:55:24.571749+0000","last_became_peered":"2024-09-10T05:55:24.571749+0000","last_unstale":"2024-09-10T05:55:33.611352+0000","last_undegraded":"2024-09-10T05:55:33.611352+0000","last_fullsized":"2024-09-10T05:55:33.611352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632552+0000","last_change":"2024-09-10T05:55:22.545583+0000","last_active":"2024-09-10T05:55:33.632552+0000","last_peered":"2024-09-10T05:55:33.632552+0000","last_clean":"2024-09-10T05:55:33.632552+0000","last_became_active":"2024-09-10T05:55:22.545064+0000","last_became_peered":"2024-09-10T05:55:22.545064+0000","last_unstale":"2024-09-10T05:55:33.632552+0000","last_undegraded":"2024-09-10T05:55:33.632552+0000","last_fullsized":"2024-09-10T05:55:33.632552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655223+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:55:33.655223+0000","last_peered":"2024-09-10T05:55:33.655223+0000","last_clean":"2024-09-10T05:55:33.655223+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:55:33.655223+0000","last_undegraded":"2024-09-10T05:55:33.655223+0000","last_fullsized":"2024-09-10T05:55:33.655223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.394996+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:55:34.394996+0000","last_peered":"2024-09-10T05:55:34.394996+0000","last_clean":"2024-09-10T05:55:34.394996+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:55:34.394996+0000","last_undegraded":"2024-09-10T05:55:34.394996+0000","last_fullsized":"2024-09-10T05:55:34.394996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645807+0000","last_change":"2024-09-10T05:55:30.609186+0000","last_active":"2024-09-10T05:55:33.645807+0000","last_peered":"2024-09-10T05:55:33.645807+0000","last_clean":"2024-09-10T05:55:33.645807+0000","last_became_active":"2024-09-10T05:55:30.608639+0000","last_became_peered":"2024-09-10T05:55:30.608639+0000","last_unstale":"2024-09-10T05:55:33.645807+0000","last_undegraded":"2024-09-10T05:55:33.645807+0000","last_fullsized":"2024-09-10T05:55:33.645807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:31.395218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610452+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:55:33.610452+0000","last_peered":"2024-09-10T05:55:33.610452+0000","last_clean":"2024-09-10T05:55:33.610452+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:55:33.610452+0000","last_undegraded":"2024-09-10T05:55:33.610452+0000","last_fullsized":"2024-09-10T05:55:33.610452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646956+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:55:33.646956+0000","last_peered":"2024-09-10T05:55:33.646956+0000","last_clean":"2024-09-10T05:55:33.646956+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:55:33.646956+0000","last_undegraded":"2024-09-10T05:55:33.646956+0000","last_fullsized":"2024-09-10T05:55:33.646956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636549+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:55:33.636549+0000","last_peered":"2024-09-10T05:55:33.636549+0000","last_clean":"2024-09-10T05:55:33.636549+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:55:33.636549+0000","last_undegraded":"2024-09-10T05:55:33.636549+0000","last_fullsized":"2024-09-10T05:55:33.636549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607657+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:55:33.607657+0000","last_peered":"2024-09-10T05:55:33.607657+0000","last_clean":"2024-09-10T05:55:33.607657+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:55:33.607657+0000","last_undegraded":"2024-09-10T05:55:33.607657+0000","last_fullsized":"2024-09-10T05:55:33.607657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632336+0000","last_change":"2024-09-10T05:55:22.569046+0000","last_active":"2024-09-10T05:55:33.632336+0000","last_peered":"2024-09-10T05:55:33.632336+0000","last_clean":"2024-09-10T05:55:33.632336+0000","last_became_active":"2024-09-10T05:55:22.568467+0000","last_became_peered":"2024-09-10T05:55:22.568467+0000","last_unstale":"2024-09-10T05:55:33.632336+0000","last_undegraded":"2024-09-10T05:55:33.632336+0000","last_fullsized":"2024-09-10T05:55:33.632336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637177+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:55:33.637177+0000","last_peered":"2024-09-10T05:55:33.637177+0000","last_clean":"2024-09-10T05:55:33.637177+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:55:33.637177+0000","last_undegraded":"2024-09-10T05:55:33.637177+0000","last_fullsized":"2024-09-10T05:55:33.637177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"36'19","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.211432+0000","last_change":"2024-09-10T05:55:28.588054+0000","last_active":"2024-09-10T05:55:34.211432+0000","last_peered":"2024-09-10T05:55:34.211432+0000","last_clean":"2024-09-10T05:55:34.211432+0000","last_became_active":"2024-09-10T05:55:28.587107+0000","last_became_peered":"2024-09-10T05:55:28.587107+0000","last_unstale":"2024-09-10T05:55:34.211432+0000","last_undegraded":"2024-09-10T05:55:34.211432+0000","last_fullsized":"2024-09-10T05:55:34.211432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:12.868467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624963+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:55:33.624963+0000","last_peered":"2024-09-10T05:55:33.624963+0000","last_clean":"2024-09-10T05:55:33.624963+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:55:33.624963+0000","last_undegraded":"2024-09-10T05:55:33.624963+0000","last_fullsized":"2024-09-10T05:55:33.624963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645845+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:55:33.645845+0000","last_peered":"2024-09-10T05:55:33.645845+0000","last_clean":"2024-09-10T05:55:33.645845+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:55:33.645845+0000","last_undegraded":"2024-09-10T05:55:33.645845+0000","last_fullsized":"2024-09-10T05:55:33.645845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625598+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:55:33.625598+0000","last_peered":"2024-09-10T05:55:33.625598+0000","last_clean":"2024-09-10T05:55:33.625598+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:55:33.625598+0000","last_undegraded":"2024-09-10T05:55:33.625598+0000","last_fullsized":"2024-09-10T05:55:33.625598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636270+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:55:33.636270+0000","last_peered":"2024-09-10T05:55:33.636270+0000","last_clean":"2024-09-10T05:55:33.636270+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:55:33.636270+0000","last_undegraded":"2024-09-10T05:55:33.636270+0000","last_fullsized":"2024-09-10T05:55:33.636270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622848+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:55:33.622848+0000","last_peered":"2024-09-10T05:55:33.622848+0000","last_clean":"2024-09-10T05:55:33.622848+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:55:33.622848+0000","last_undegraded":"2024-09-10T05:55:33.622848+0000","last_fullsized":"2024-09-10T05:55:33.622848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609552+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:55:33.609552+0000","last_peered":"2024-09-10T05:55:33.609552+0000","last_clean":"2024-09-10T05:55:33.609552+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:55:33.609552+0000","last_undegraded":"2024-09-10T05:55:33.609552+0000","last_fullsized":"2024-09-10T05:55:33.609552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"36'29","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.386373+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:55:34.386373+0000","last_peered":"2024-09-10T05:55:34.386373+0000","last_clean":"2024-09-10T05:55:34.386373+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:55:34.386373+0000","last_undegraded":"2024-09-10T05:55:34.386373+0000","last_fullsized":"2024-09-10T05:55:34.386373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637759+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:55:33.637759+0000","last_peered":"2024-09-10T05:55:33.637759+0000","last_clean":"2024-09-10T05:55:33.637759+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:55:33.637759+0000","last_undegraded":"2024-09-10T05:55:33.637759+0000","last_fullsized":"2024-09-10T05:55:33.637759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612467+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:55:33.612467+0000","last_peered":"2024-09-10T05:55:33.612467+0000","last_clean":"2024-09-10T05:55:33.612467+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:55:33.612467+0000","last_undegraded":"2024-09-10T05:55:33.612467+0000","last_fullsized":"2024-09-10T05:55:33.612467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611575+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:55:33.611575+0000","last_peered":"2024-09-10T05:55:33.611575+0000","last_clean":"2024-09-10T05:55:33.611575+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:55:33.611575+0000","last_undegraded":"2024-09-10T05:55:33.611575+0000","last_fullsized":"2024-09-10T05:55:33.611575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670773+0000","last_change":"2024-09-10T05:55:14.253426+0000","last_active":"2024-09-10T05:55:33.670773+0000","last_peered":"2024-09-10T05:55:33.670773+0000","last_clean":"2024-09-10T05:55:33.670773+0000","last_became_active":"2024-09-10T05:55:12.625451+0000","last_became_peered":"2024-09-10T05:55:12.625451+0000","last_unstale":"2024-09-10T05:55:33.670773+0000","last_undegraded":"2024-09-10T05:55:33.670773+0000","last_fullsized":"2024-09-10T05:55:33.670773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:39.260823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609221+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:55:33.609221+0000","last_peered":"2024-09-10T05:55:33.609221+0000","last_clean":"2024-09-10T05:55:33.609221+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:55:33.609221+0000","last_undegraded":"2024-09-10T05:55:33.609221+0000","last_fullsized":"2024-09-10T05:55:33.609221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671993+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:55:33.671993+0000","last_peered":"2024-09-10T05:55:33.671993+0000","last_clean":"2024-09-10T05:55:33.671993+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:55:33.671993+0000","last_undegraded":"2024-09-10T05:55:33.671993+0000","last_fullsized":"2024-09-10T05:55:33.671993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.389111+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:55:34.389111+0000","last_peered":"2024-09-10T05:55:34.389111+0000","last_clean":"2024-09-10T05:55:34.389111+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:55:34.389111+0000","last_undegraded":"2024-09-10T05:55:34.389111+0000","last_fullsized":"2024-09-10T05:55:34.389111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623093+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:55:33.623093+0000","last_peered":"2024-09-10T05:55:33.623093+0000","last_clean":"2024-09-10T05:55:33.623093+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:55:33.623093+0000","last_undegraded":"2024-09-10T05:55:33.623093+0000","last_fullsized":"2024-09-10T05:55:33.623093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633050+0000","last_change":"2024-09-10T05:55:32.642991+0000","last_active":"2024-09-10T05:55:33.633050+0000","last_peered":"2024-09-10T05:55:33.633050+0000","last_clean":"2024-09-10T05:55:33.633050+0000","last_became_active":"2024-09-10T05:55:32.642276+0000","last_became_peered":"2024-09-10T05:55:32.642276+0000","last_unstale":"2024-09-10T05:55:33.633050+0000","last_undegraded":"2024-09-10T05:55:33.633050+0000","last_fullsized":"2024-09-10T05:55:33.633050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:41.787760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610771+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:55:33.610771+0000","last_peered":"2024-09-10T05:55:33.610771+0000","last_clean":"2024-09-10T05:55:33.610771+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:55:33.610771+0000","last_undegraded":"2024-09-10T05:55:33.610771+0000","last_fullsized":"2024-09-10T05:55:33.610771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608518+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:55:33.608518+0000","last_peered":"2024-09-10T05:55:33.608518+0000","last_clean":"2024-09-10T05:55:33.608518+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:55:33.608518+0000","last_undegraded":"2024-09-10T05:55:33.608518+0000","last_fullsized":"2024-09-10T05:55:33.608518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654431+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:55:33.654431+0000","last_peered":"2024-09-10T05:55:33.654431+0000","last_clean":"2024-09-10T05:55:33.654431+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:55:33.654431+0000","last_undegraded":"2024-09-10T05:55:33.654431+0000","last_fullsized":"2024-09-10T05:55:33.654431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624410+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:55:33.624410+0000","last_peered":"2024-09-10T05:55:33.624410+0000","last_clean":"2024-09-10T05:55:33.624410+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:55:33.624410+0000","last_undegraded":"2024-09-10T05:55:33.624410+0000","last_fullsized":"2024-09-10T05:55:33.624410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.248402+0000","last_change":"2024-09-10T05:55:28.588230+0000","last_active":"2024-09-10T05:55:34.248402+0000","last_peered":"2024-09-10T05:55:34.248402+0000","last_clean":"2024-09-10T05:55:34.248402+0000","last_became_active":"2024-09-10T05:55:28.587443+0000","last_became_peered":"2024-09-10T05:55:28.587443+0000","last_unstale":"2024-09-10T05:55:34.248402+0000","last_undegraded":"2024-09-10T05:55:34.248402+0000","last_fullsized":"2024-09-10T05:55:34.248402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646687+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:55:33.646687+0000","last_peered":"2024-09-10T05:55:33.646687+0000","last_clean":"2024-09-10T05:55:33.646687+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:55:33.646687+0000","last_undegraded":"2024-09-10T05:55:33.646687+0000","last_fullsized":"2024-09-10T05:55:33.646687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.606978+0000","last_change":"2024-09-10T05:55:32.623633+0000","last_active":"2024-09-10T05:55:33.606978+0000","last_peered":"2024-09-10T05:55:33.606978+0000","last_clean":"2024-09-10T05:55:33.606978+0000","last_became_active":"2024-09-10T05:55:32.621769+0000","last_became_peered":"2024-09-10T05:55:32.621769+0000","last_unstale":"2024-09-10T05:55:33.606978+0000","last_undegraded":"2024-09-10T05:55:33.606978+0000","last_fullsized":"2024-09-10T05:55:33.606978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.593293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611495+0000","last_change":"2024-09-10T05:55:24.564966+0000","last_active":"2024-09-10T05:55:33.611495+0000","last_peered":"2024-09-10T05:55:33.611495+0000","last_clean":"2024-09-10T05:55:33.611495+0000","last_became_active":"2024-09-10T05:55:24.564572+0000","last_became_peered":"2024-09-10T05:55:24.564572+0000","last_unstale":"2024-09-10T05:55:33.611495+0000","last_undegraded":"2024-09-10T05:55:33.611495+0000","last_fullsized":"2024-09-10T05:55:33.611495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609466+0000","last_change":"2024-09-10T05:55:22.558913+0000","last_active":"2024-09-10T05:55:33.609466+0000","last_peered":"2024-09-10T05:55:33.609466+0000","last_clean":"2024-09-10T05:55:33.609466+0000","last_became_active":"2024-09-10T05:55:22.558172+0000","last_became_peered":"2024-09-10T05:55:22.558172+0000","last_unstale":"2024-09-10T05:55:33.609466+0000","last_undegraded":"2024-09-10T05:55:33.609466+0000","last_fullsized":"2024-09-10T05:55:33.609466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611512+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:55:33.611512+0000","last_peered":"2024-09-10T05:55:33.611512+0000","last_clean":"2024-09-10T05:55:33.611512+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:55:33.611512+0000","last_undegraded":"2024-09-10T05:55:33.611512+0000","last_fullsized":"2024-09-10T05:55:33.611512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623613+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:55:33.623613+0000","last_peered":"2024-09-10T05:55:33.623613+0000","last_clean":"2024-09-10T05:55:33.623613+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:55:33.623613+0000","last_undegraded":"2024-09-10T05:55:33.623613+0000","last_fullsized":"2024-09-10T05:55:33.623613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'30","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.329982+0000","last_change":"2024-09-10T05:55:28.591664+0000","last_active":"2024-09-10T05:55:34.329982+0000","last_peered":"2024-09-10T05:55:34.329982+0000","last_clean":"2024-09-10T05:55:34.329982+0000","last_became_active":"2024-09-10T05:55:28.590273+0000","last_became_peered":"2024-09-10T05:55:28.590273+0000","last_unstale":"2024-09-10T05:55:34.329982+0000","last_undegraded":"2024-09-10T05:55:34.329982+0000","last_fullsized":"2024-09-10T05:55:34.329982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:46.079078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652809+0000","last_change":"2024-09-10T05:55:30.595410+0000","last_active":"2024-09-10T05:55:33.652809+0000","last_peered":"2024-09-10T05:55:33.652809+0000","last_clean":"2024-09-10T05:55:33.652809+0000","last_became_active":"2024-09-10T05:55:30.594589+0000","last_became_peered":"2024-09-10T05:55:30.594589+0000","last_unstale":"2024-09-10T05:55:33.652809+0000","last_undegraded":"2024-09-10T05:55:33.652809+0000","last_fullsized":"2024-09-10T05:55:33.652809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:56.649903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624803+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:55:33.624803+0000","last_peered":"2024-09-10T05:55:33.624803+0000","last_clean":"2024-09-10T05:55:33.624803+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:55:33.624803+0000","last_undegraded":"2024-09-10T05:55:33.624803+0000","last_fullsized":"2024-09-10T05:55:33.624803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624076+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:55:33.624076+0000","last_peered":"2024-09-10T05:55:33.624076+0000","last_clean":"2024-09-10T05:55:33.624076+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:55:33.624076+0000","last_undegraded":"2024-09-10T05:55:33.624076+0000","last_fullsized":"2024-09-10T05:55:33.624076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611049+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:55:33.611049+0000","last_peered":"2024-09-10T05:55:33.611049+0000","last_clean":"2024-09-10T05:55:33.611049+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:55:33.611049+0000","last_undegraded":"2024-09-10T05:55:33.611049+0000","last_fullsized":"2024-09-10T05:55:33.611049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639312+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:55:33.639312+0000","last_peered":"2024-09-10T05:55:33.639312+0000","last_clean":"2024-09-10T05:55:33.639312+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:55:33.639312+0000","last_undegraded":"2024-09-10T05:55:33.639312+0000","last_fullsized":"2024-09-10T05:55:33.639312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648365+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:55:33.648365+0000","last_peered":"2024-09-10T05:55:33.648365+0000","last_clean":"2024-09-10T05:55:33.648365+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:55:33.648365+0000","last_undegraded":"2024-09-10T05:55:33.648365+0000","last_fullsized":"2024-09-10T05:55:33.648365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.418787+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:55:34.418787+0000","last_peered":"2024-09-10T05:55:34.418787+0000","last_clean":"2024-09-10T05:55:34.418787+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:55:34.418787+0000","last_undegraded":"2024-09-10T05:55:34.418787+0000","last_fullsized":"2024-09-10T05:55:34.418787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607865+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:55:33.607865+0000","last_peered":"2024-09-10T05:55:33.607865+0000","last_clean":"2024-09-10T05:55:33.607865+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:55:33.607865+0000","last_undegraded":"2024-09-10T05:55:33.607865+0000","last_fullsized":"2024-09-10T05:55:33.607865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634889+0000","last_change":"2024-09-10T05:55:32.863868+0000","last_active":"2024-09-10T05:55:33.634889+0000","last_peered":"2024-09-10T05:55:33.634889+0000","last_clean":"2024-09-10T05:55:33.634889+0000","last_became_active":"2024-09-10T05:55:32.862966+0000","last_became_peered":"2024-09-10T05:55:32.862966+0000","last_unstale":"2024-09-10T05:55:33.634889+0000","last_undegraded":"2024-09-10T05:55:33.634889+0000","last_fullsized":"2024-09-10T05:55:33.634889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:42.616817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632028+0000","last_change":"2024-09-10T05:55:24.552746+0000","last_active":"2024-09-10T05:55:33.632028+0000","last_peered":"2024-09-10T05:55:33.632028+0000","last_clean":"2024-09-10T05:55:33.632028+0000","last_became_active":"2024-09-10T05:55:24.552326+0000","last_became_peered":"2024-09-10T05:55:24.552326+0000","last_unstale":"2024-09-10T05:55:33.632028+0000","last_undegraded":"2024-09-10T05:55:33.632028+0000","last_fullsized":"2024-09-10T05:55:33.632028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:39.661302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633749+0000","last_change":"2024-09-10T05:55:22.571302+0000","last_active":"2024-09-10T05:55:33.633749+0000","last_peered":"2024-09-10T05:55:33.633749+0000","last_clean":"2024-09-10T05:55:33.633749+0000","last_became_active":"2024-09-10T05:55:22.570586+0000","last_became_peered":"2024-09-10T05:55:22.570586+0000","last_unstale":"2024-09-10T05:55:33.633749+0000","last_undegraded":"2024-09-10T05:55:33.633749+0000","last_fullsized":"2024-09-10T05:55:33.633749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:43.825302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611877+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:55:33.611877+0000","last_peered":"2024-09-10T05:55:33.611877+0000","last_clean":"2024-09-10T05:55:33.611877+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:55:33.611877+0000","last_undegraded":"2024-09-10T05:55:33.611877+0000","last_fullsized":"2024-09-10T05:55:33.611877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653075+0000","last_change":"2024-09-10T05:55:26.567267+0000","last_active":"2024-09-10T05:55:33.653075+0000","last_peered":"2024-09-10T05:55:33.653075+0000","last_clean":"2024-09-10T05:55:33.653075+0000","last_became_active":"2024-09-10T05:55:26.566406+0000","last_became_peered":"2024-09-10T05:55:26.566406+0000","last_unstale":"2024-09-10T05:55:33.653075+0000","last_undegraded":"2024-09-10T05:55:33.653075+0000","last_fullsized":"2024-09-10T05:55:33.653075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:00.428645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.377319+0000","last_change":"2024-09-10T05:55:28.588437+0000","last_active":"2024-09-10T05:55:34.377319+0000","last_peered":"2024-09-10T05:55:34.377319+0000","last_clean":"2024-09-10T05:55:34.377319+0000","last_became_active":"2024-09-10T05:55:28.587136+0000","last_became_peered":"2024-09-10T05:55:28.587136+0000","last_unstale":"2024-09-10T05:55:34.377319+0000","last_undegraded":"2024-09-10T05:55:34.377319+0000","last_fullsized":"2024-09-10T05:55:34.377319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:40:32.880337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633842+0000","last_change":"2024-09-10T05:55:30.616043+0000","last_active":"2024-09-10T05:55:33.633842+0000","last_peered":"2024-09-10T05:55:33.633842+0000","last_clean":"2024-09-10T05:55:33.633842+0000","last_became_active":"2024-09-10T05:55:30.615332+0000","last_became_peered":"2024-09-10T05:55:30.615332+0000","last_unstale":"2024-09-10T05:55:33.633842+0000","last_undegraded":"2024-09-10T05:55:33.633842+0000","last_fullsized":"2024-09-10T05:55:33.633842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:07.408810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623656+0000","last_change":"2024-09-10T05:55:32.627524+0000","last_active":"2024-09-10T05:55:33.623656+0000","last_peered":"2024-09-10T05:55:33.623656+0000","last_clean":"2024-09-10T05:55:33.623656+0000","last_became_active":"2024-09-10T05:55:32.626785+0000","last_became_peered":"2024-09-10T05:55:32.626785+0000","last_unstale":"2024-09-10T05:55:33.623656+0000","last_undegraded":"2024-09-10T05:55:33.623656+0000","last_fullsized":"2024-09-10T05:55:33.623656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:51.953007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653316+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:55:33.653316+0000","last_peered":"2024-09-10T05:55:33.653316+0000","last_clean":"2024-09-10T05:55:33.653316+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:55:33.653316+0000","last_undegraded":"2024-09-10T05:55:33.653316+0000","last_fullsized":"2024-09-10T05:55:33.653316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.626231+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:55:33.626231+0000","last_peered":"2024-09-10T05:55:33.626231+0000","last_clean":"2024-09-10T05:55:33.626231+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:55:33.626231+0000","last_undegraded":"2024-09-10T05:55:33.626231+0000","last_fullsized":"2024-09-10T05:55:33.626231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647268+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:55:33.647268+0000","last_peered":"2024-09-10T05:55:33.647268+0000","last_clean":"2024-09-10T05:55:33.647268+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:55:33.647268+0000","last_undegraded":"2024-09-10T05:55:33.647268+0000","last_fullsized":"2024-09-10T05:55:33.647268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631782+0000","last_change":"2024-09-10T05:55:26.567071+0000","last_active":"2024-09-10T05:55:33.631782+0000","last_peered":"2024-09-10T05:55:33.631782+0000","last_clean":"2024-09-10T05:55:33.631782+0000","last_became_active":"2024-09-10T05:55:26.566699+0000","last_became_peered":"2024-09-10T05:55:26.566699+0000","last_unstale":"2024-09-10T05:55:33.631782+0000","last_undegraded":"2024-09-10T05:55:33.631782+0000","last_fullsized":"2024-09-10T05:55:33.631782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:06.770848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'26","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.358023+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:55:34.358023+0000","last_peered":"2024-09-10T05:55:34.358023+0000","last_clean":"2024-09-10T05:55:34.358023+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:55:34.358023+0000","last_undegraded":"2024-09-10T05:55:34.358023+0000","last_fullsized":"2024-09-10T05:55:34.358023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631522+0000","last_change":"2024-09-10T05:55:30.617156+0000","last_active":"2024-09-10T05:55:33.631522+0000","last_peered":"2024-09-10T05:55:33.631522+0000","last_clean":"2024-09-10T05:55:33.631522+0000","last_became_active":"2024-09-10T05:55:30.616444+0000","last_became_peered":"2024-09-10T05:55:30.616444+0000","last_unstale":"2024-09-10T05:55:33.631522+0000","last_undegraded":"2024-09-10T05:55:33.631522+0000","last_fullsized":"2024-09-10T05:55:33.631522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:27.529277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608141+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:55:33.608141+0000","last_peered":"2024-09-10T05:55:33.608141+0000","last_clean":"2024-09-10T05:55:33.608141+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:55:33.608141+0000","last_undegraded":"2024-09-10T05:55:33.608141+0000","last_fullsized":"2024-09-10T05:55:33.608141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625538+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:55:33.625538+0000","last_peered":"2024-09-10T05:55:33.625538+0000","last_clean":"2024-09-10T05:55:33.625538+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:55:33.625538+0000","last_undegraded":"2024-09-10T05:55:33.625538+0000","last_fullsized":"2024-09-10T05:55:33.625538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654035+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:55:33.654035+0000","last_peered":"2024-09-10T05:55:33.654035+0000","last_clean":"2024-09-10T05:55:33.654035+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:55:33.654035+0000","last_undegraded":"2024-09-10T05:55:33.654035+0000","last_fullsized":"2024-09-10T05:55:33.654035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654100+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:55:33.654100+0000","last_peered":"2024-09-10T05:55:33.654100+0000","last_clean":"2024-09-10T05:55:33.654100+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:55:33.654100+0000","last_undegraded":"2024-09-10T05:55:33.654100+0000","last_fullsized":"2024-09-10T05:55:33.654100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611761+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:55:33.611761+0000","last_peered":"2024-09-10T05:55:33.611761+0000","last_clean":"2024-09-10T05:55:33.611761+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:55:33.611761+0000","last_undegraded":"2024-09-10T05:55:33.611761+0000","last_fullsized":"2024-09-10T05:55:33.611761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'17","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.425615+0000","last_change":"2024-09-10T05:55:28.588559+0000","last_active":"2024-09-10T05:55:34.425615+0000","last_peered":"2024-09-10T05:55:34.425615+0000","last_clean":"2024-09-10T05:55:34.425615+0000","last_became_active":"2024-09-10T05:55:28.587805+0000","last_became_peered":"2024-09-10T05:55:28.587805+0000","last_unstale":"2024-09-10T05:55:34.425615+0000","last_undegraded":"2024-09-10T05:55:34.425615+0000","last_fullsized":"2024-09-10T05:55:34.425615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:19.106173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631330+0000","last_change":"2024-09-10T05:55:30.604838+0000","last_active":"2024-09-10T05:55:33.631330+0000","last_peered":"2024-09-10T05:55:33.631330+0000","last_clean":"2024-09-10T05:55:33.631330+0000","last_became_active":"2024-09-10T05:55:30.603989+0000","last_became_peered":"2024-09-10T05:55:30.603989+0000","last_unstale":"2024-09-10T05:55:33.631330+0000","last_undegraded":"2024-09-10T05:55:33.631330+0000","last_fullsized":"2024-09-10T05:55:33.631330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:55.306195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633762+0000","last_change":"2024-09-10T05:55:32.621971+0000","last_active":"2024-09-10T05:55:33.633762+0000","last_peered":"2024-09-10T05:55:33.633762+0000","last_clean":"2024-09-10T05:55:33.633762+0000","last_became_active":"2024-09-10T05:55:32.621237+0000","last_became_peered":"2024-09-10T05:55:32.621237+0000","last_unstale":"2024-09-10T05:55:33.633762+0000","last_undegraded":"2024-09-10T05:55:33.633762+0000","last_fullsized":"2024-09-10T05:55:33.633762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:53.481428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611272+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:55:33.611272+0000","last_peered":"2024-09-10T05:55:33.611272+0000","last_clean":"2024-09-10T05:55:33.611272+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:55:33.611272+0000","last_undegraded":"2024-09-10T05:55:33.611272+0000","last_fullsized":"2024-09-10T05:55:33.611272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638951+0000","last_change":"2024-09-10T05:55:22.572808+0000","last_active":"2024-09-10T05:55:33.638951+0000","last_peered":"2024-09-10T05:55:33.638951+0000","last_clean":"2024-09-10T05:55:33.638951+0000","last_became_active":"2024-09-10T05:55:22.572130+0000","last_became_peered":"2024-09-10T05:55:22.572130+0000","last_unstale":"2024-09-10T05:55:33.638951+0000","last_undegraded":"2024-09-10T05:55:33.638951+0000","last_fullsized":"2024-09-10T05:55:33.638951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:09.009494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632708+0000","last_change":"2024-09-10T05:55:26.570811+0000","last_active":"2024-09-10T05:55:33.632708+0000","last_peered":"2024-09-10T05:55:33.632708+0000","last_clean":"2024-09-10T05:55:33.632708+0000","last_became_active":"2024-09-10T05:55:26.570227+0000","last_became_peered":"2024-09-10T05:55:26.570227+0000","last_unstale":"2024-09-10T05:55:33.632708+0000","last_undegraded":"2024-09-10T05:55:33.632708+0000","last_fullsized":"2024-09-10T05:55:33.632708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:33.508950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'4","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.997331+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:55:33.997331+0000","last_peered":"2024-09-10T05:55:33.997331+0000","last_clean":"2024-09-10T05:55:33.997331+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:55:33.997331+0000","last_undegraded":"2024-09-10T05:55:33.997331+0000","last_fullsized":"2024-09-10T05:55:33.997331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636228+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:55:33.636228+0000","last_peered":"2024-09-10T05:55:33.636228+0000","last_clean":"2024-09-10T05:55:33.636228+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:55:33.636228+0000","last_undegraded":"2024-09-10T05:55:33.636228+0000","last_fullsized":"2024-09-10T05:55:33.636228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623485+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:55:33.623485+0000","last_peered":"2024-09-10T05:55:33.623485+0000","last_clean":"2024-09-10T05:55:33.623485+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:55:33.623485+0000","last_undegraded":"2024-09-10T05:55:33.623485+0000","last_fullsized":"2024-09-10T05:55:33.623485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633491+0000","last_change":"2024-09-10T05:55:24.557478+0000","last_active":"2024-09-10T05:55:33.633491+0000","last_peered":"2024-09-10T05:55:33.633491+0000","last_clean":"2024-09-10T05:55:33.633491+0000","last_became_active":"2024-09-10T05:55:24.557026+0000","last_became_peered":"2024-09-10T05:55:24.557026+0000","last_unstale":"2024-09-10T05:55:33.633491+0000","last_undegraded":"2024-09-10T05:55:33.633491+0000","last_fullsized":"2024-09-10T05:55:33.633491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:16.764319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608808+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:55:33.608808+0000","last_peered":"2024-09-10T05:55:33.608808+0000","last_clean":"2024-09-10T05:55:33.608808+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:55:33.608808+0000","last_undegraded":"2024-09-10T05:55:33.608808+0000","last_fullsized":"2024-09-10T05:55:33.608808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.635529+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:55:33.635529+0000","last_peered":"2024-09-10T05:55:33.635529+0000","last_clean":"2024-09-10T05:55:33.635529+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:55:33.635529+0000","last_undegraded":"2024-09-10T05:55:33.635529+0000","last_fullsized":"2024-09-10T05:55:33.635529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.342459+0000","last_change":"2024-09-10T05:55:28.582238+0000","last_active":"2024-09-10T05:55:34.342459+0000","last_peered":"2024-09-10T05:55:34.342459+0000","last_clean":"2024-09-10T05:55:34.342459+0000","last_became_active":"2024-09-10T05:55:28.581532+0000","last_became_peered":"2024-09-10T05:55:28.581532+0000","last_unstale":"2024-09-10T05:55:34.342459+0000","last_undegraded":"2024-09-10T05:55:34.342459+0000","last_fullsized":"2024-09-10T05:55:34.342459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:18.922489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648181+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:55:33.648181+0000","last_peered":"2024-09-10T05:55:33.648181+0000","last_clean":"2024-09-10T05:55:33.648181+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:55:33.648181+0000","last_undegraded":"2024-09-10T05:55:33.648181+0000","last_fullsized":"2024-09-10T05:55:33.648181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609401+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:55:33.609401+0000","last_peered":"2024-09-10T05:55:33.609401+0000","last_clean":"2024-09-10T05:55:33.609401+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:55:33.609401+0000","last_undegraded":"2024-09-10T05:55:33.609401+0000","last_fullsized":"2024-09-10T05:55:33.609401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632222+0000","last_change":"2024-09-10T05:55:24.565846+0000","last_active":"2024-09-10T05:55:33.632222+0000","last_peered":"2024-09-10T05:55:33.632222+0000","last_clean":"2024-09-10T05:55:33.632222+0000","last_became_active":"2024-09-10T05:55:24.565138+0000","last_became_peered":"2024-09-10T05:55:24.565138+0000","last_unstale":"2024-09-10T05:55:33.632222+0000","last_undegraded":"2024-09-10T05:55:33.632222+0000","last_fullsized":"2024-09-10T05:55:33.632222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:43.891979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625980+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:55:33.625980+0000","last_peered":"2024-09-10T05:55:33.625980+0000","last_clean":"2024-09-10T05:55:33.625980+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:55:33.625980+0000","last_undegraded":"2024-09-10T05:55:33.625980+0000","last_fullsized":"2024-09-10T05:55:33.625980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646965+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:55:33.646965+0000","last_peered":"2024-09-10T05:55:33.646965+0000","last_clean":"2024-09-10T05:55:33.646965+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:55:33.646965+0000","last_undegraded":"2024-09-10T05:55:33.646965+0000","last_fullsized":"2024-09-10T05:55:33.646965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.139119+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:55:34.139119+0000","last_peered":"2024-09-10T05:55:34.139119+0000","last_clean":"2024-09-10T05:55:34.139119+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:55:34.139119+0000","last_undegraded":"2024-09-10T05:55:34.139119+0000","last_fullsized":"2024-09-10T05:55:34.139119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622864+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:55:33.622864+0000","last_peered":"2024-09-10T05:55:33.622864+0000","last_clean":"2024-09-10T05:55:33.622864+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:55:33.622864+0000","last_undegraded":"2024-09-10T05:55:33.622864+0000","last_fullsized":"2024-09-10T05:55:33.622864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647005+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:55:33.647005+0000","last_peered":"2024-09-10T05:55:33.647005+0000","last_clean":"2024-09-10T05:55:33.647005+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:55:33.647005+0000","last_undegraded":"2024-09-10T05:55:33.647005+0000","last_fullsized":"2024-09-10T05:55:33.647005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632483+0000","last_change":"2024-09-10T05:55:22.555925+0000","last_active":"2024-09-10T05:55:33.632483+0000","last_peered":"2024-09-10T05:55:33.632483+0000","last_clean":"2024-09-10T05:55:33.632483+0000","last_became_active":"2024-09-10T05:55:22.555404+0000","last_became_peered":"2024-09-10T05:55:22.555404+0000","last_unstale":"2024-09-10T05:55:33.632483+0000","last_undegraded":"2024-09-10T05:55:33.632483+0000","last_fullsized":"2024-09-10T05:55:33.632483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625186+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:55:33.625186+0000","last_peered":"2024-09-10T05:55:33.625186+0000","last_clean":"2024-09-10T05:55:33.625186+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:55:33.625186+0000","last_undegraded":"2024-09-10T05:55:33.625186+0000","last_fullsized":"2024-09-10T05:55:33.625186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'18","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.450599+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:55:34.450599+0000","last_peered":"2024-09-10T05:55:34.450599+0000","last_clean":"2024-09-10T05:55:34.450599+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:55:34.450599+0000","last_undegraded":"2024-09-10T05:55:34.450599+0000","last_fullsized":"2024-09-10T05:55:34.450599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607949+0000","last_change":"2024-09-10T05:55:30.604845+0000","last_active":"2024-09-10T05:55:33.607949+0000","last_peered":"2024-09-10T05:55:33.607949+0000","last_clean":"2024-09-10T05:55:33.607949+0000","last_became_active":"2024-09-10T05:55:30.604134+0000","last_became_peered":"2024-09-10T05:55:30.604134+0000","last_unstale":"2024-09-10T05:55:33.607949+0000","last_undegraded":"2024-09-10T05:55:33.607949+0000","last_fullsized":"2024-09-10T05:55:33.607949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632386+0000","last_change":"2024-09-10T05:55:32.866321+0000","last_active":"2024-09-10T05:55:33.632386+0000","last_peered":"2024-09-10T05:55:33.632386+0000","last_clean":"2024-09-10T05:55:33.632386+0000","last_became_active":"2024-09-10T05:55:32.865490+0000","last_became_peered":"2024-09-10T05:55:32.865490+0000","last_unstale":"2024-09-10T05:55:33.632386+0000","last_undegraded":"2024-09-10T05:55:33.632386+0000","last_fullsized":"2024-09-10T05:55:33.632386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:03.601742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625482+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:55:33.625482+0000","last_peered":"2024-09-10T05:55:33.625482+0000","last_clean":"2024-09-10T05:55:33.625482+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:55:33.625482+0000","last_undegraded":"2024-09-10T05:55:33.625482+0000","last_fullsized":"2024-09-10T05:55:33.625482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611612+0000","last_change":"2024-09-10T05:55:22.545969+0000","last_active":"2024-09-10T05:55:33.611612+0000","last_peered":"2024-09-10T05:55:33.611612+0000","last_clean":"2024-09-10T05:55:33.611612+0000","last_became_active":"2024-09-10T05:55:22.544732+0000","last_became_peered":"2024-09-10T05:55:22.544732+0000","last_unstale":"2024-09-10T05:55:33.611612+0000","last_undegraded":"2024-09-10T05:55:33.611612+0000","last_fullsized":"2024-09-10T05:55:33.611612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:39.644138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646765+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:55:33.646765+0000","last_peered":"2024-09-10T05:55:33.646765+0000","last_clean":"2024-09-10T05:55:33.646765+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:55:33.646765+0000","last_undegraded":"2024-09-10T05:55:33.646765+0000","last_fullsized":"2024-09-10T05:55:33.646765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.251765+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:55:34.251765+0000","last_peered":"2024-09-10T05:55:34.251765+0000","last_clean":"2024-09-10T05:55:34.251765+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:55:34.251765+0000","last_undegraded":"2024-09-10T05:55:34.251765+0000","last_fullsized":"2024-09-10T05:55:34.251765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610964+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:55:33.610964+0000","last_peered":"2024-09-10T05:55:33.610964+0000","last_clean":"2024-09-10T05:55:33.610964+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:55:33.610964+0000","last_undegraded":"2024-09-10T05:55:33.610964+0000","last_fullsized":"2024-09-10T05:55:33.610964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648023+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:55:33.648023+0000","last_peered":"2024-09-10T05:55:33.648023+0000","last_clean":"2024-09-10T05:55:33.648023+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:55:33.648023+0000","last_undegraded":"2024-09-10T05:55:33.648023+0000","last_fullsized":"2024-09-10T05:55:33.648023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633234+0000","last_change":"2024-09-10T05:55:24.565289+0000","last_active":"2024-09-10T05:55:33.633234+0000","last_peered":"2024-09-10T05:55:33.633234+0000","last_clean":"2024-09-10T05:55:33.633234+0000","last_became_active":"2024-09-10T05:55:24.564280+0000","last_became_peered":"2024-09-10T05:55:24.564280+0000","last_unstale":"2024-09-10T05:55:33.633234+0000","last_undegraded":"2024-09-10T05:55:33.633234+0000","last_fullsized":"2024-09-10T05:55:33.633234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:13.779901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654009+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:55:33.654009+0000","last_peered":"2024-09-10T05:55:33.654009+0000","last_clean":"2024-09-10T05:55:33.654009+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:55:33.654009+0000","last_undegraded":"2024-09-10T05:55:33.654009+0000","last_fullsized":"2024-09-10T05:55:33.654009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655134+0000","last_change":"2024-09-10T05:55:26.565035+0000","last_active":"2024-09-10T05:55:33.655134+0000","last_peered":"2024-09-10T05:55:33.655134+0000","last_clean":"2024-09-10T05:55:33.655134+0000","last_became_active":"2024-09-10T05:55:26.564334+0000","last_became_peered":"2024-09-10T05:55:26.564334+0000","last_unstale":"2024-09-10T05:55:33.655134+0000","last_undegraded":"2024-09-10T05:55:33.655134+0000","last_fullsized":"2024-09-10T05:55:33.655134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:56.748091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"36'17","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.432513+0000","last_change":"2024-09-10T05:55:28.614053+0000","last_active":"2024-09-10T05:55:34.432513+0000","last_peered":"2024-09-10T05:55:34.432513+0000","last_clean":"2024-09-10T05:55:34.432513+0000","last_became_active":"2024-09-10T05:55:28.613481+0000","last_became_peered":"2024-09-10T05:55:28.613481+0000","last_unstale":"2024-09-10T05:55:34.432513+0000","last_undegraded":"2024-09-10T05:55:34.432513+0000","last_fullsized":"2024-09-10T05:55:34.432513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:19.110667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610832+0000","last_change":"2024-09-10T05:55:30.622398+0000","last_active":"2024-09-10T05:55:33.610832+0000","last_peered":"2024-09-10T05:55:33.610832+0000","last_clean":"2024-09-10T05:55:33.610832+0000","last_became_active":"2024-09-10T05:55:30.621878+0000","last_became_peered":"2024-09-10T05:55:30.621878+0000","last_unstale":"2024-09-10T05:55:33.610832+0000","last_undegraded":"2024-09-10T05:55:33.610832+0000","last_fullsized":"2024-09-10T05:55:33.610832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:40.030654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607525+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:55:33.607525+0000","last_peered":"2024-09-10T05:55:33.607525+0000","last_clean":"2024-09-10T05:55:33.607525+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:55:33.607525+0000","last_undegraded":"2024-09-10T05:55:33.607525+0000","last_fullsized":"2024-09-10T05:55:33.607525+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671702+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:55:33.671702+0000","last_peered":"2024-09-10T05:55:33.671702+0000","last_clean":"2024-09-10T05:55:33.671702+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:55:33.671702+0000","last_undegraded":"2024-09-10T05:55:33.671702+0000","last_fullsized":"2024-09-10T05:55:33.671702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623366+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:55:33.623366+0000","last_peered":"2024-09-10T05:55:33.623366+0000","last_clean":"2024-09-10T05:55:33.623366+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:55:33.623366+0000","last_undegraded":"2024-09-10T05:55:33.623366+0000","last_fullsized":"2024-09-10T05:55:33.623366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611477+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:55:33.611477+0000","last_peered":"2024-09-10T05:55:33.611477+0000","last_clean":"2024-09-10T05:55:33.611477+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:55:33.611477+0000","last_undegraded":"2024-09-10T05:55:33.611477+0000","last_fullsized":"2024-09-10T05:55:33.611477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.409055+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:55:34.409055+0000","last_peered":"2024-09-10T05:55:34.409055+0000","last_clean":"2024-09-10T05:55:34.409055+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:55:34.409055+0000","last_undegraded":"2024-09-10T05:55:34.409055+0000","last_fullsized":"2024-09-10T05:55:34.409055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646446+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:55:33.646446+0000","last_peered":"2024-09-10T05:55:33.646446+0000","last_clean":"2024-09-10T05:55:33.646446+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:55:33.646446+0000","last_undegraded":"2024-09-10T05:55:33.646446+0000","last_fullsized":"2024-09-10T05:55:33.646446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.635981+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:55:33.635981+0000","last_peered":"2024-09-10T05:55:33.635981+0000","last_clean":"2024-09-10T05:55:33.635981+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:55:33.635981+0000","last_undegraded":"2024-09-10T05:55:33.635981+0000","last_fullsized":"2024-09-10T05:55:33.635981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653905+0000","last_change":"2024-09-10T05:55:24.554255+0000","last_active":"2024-09-10T05:55:33.653905+0000","last_peered":"2024-09-10T05:55:33.653905+0000","last_clean":"2024-09-10T05:55:33.653905+0000","last_became_active":"2024-09-10T05:55:24.544039+0000","last_became_peered":"2024-09-10T05:55:24.544039+0000","last_unstale":"2024-09-10T05:55:33.653905+0000","last_undegraded":"2024-09-10T05:55:33.653905+0000","last_fullsized":"2024-09-10T05:55:33.653905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608580+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:55:33.608580+0000","last_peered":"2024-09-10T05:55:33.608580+0000","last_clean":"2024-09-10T05:55:33.608580+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:55:33.608580+0000","last_undegraded":"2024-09-10T05:55:33.608580+0000","last_fullsized":"2024-09-10T05:55:33.608580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636561+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:55:33.636561+0000","last_peered":"2024-09-10T05:55:33.636561+0000","last_clean":"2024-09-10T05:55:33.636561+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:55:33.636561+0000","last_undegraded":"2024-09-10T05:55:33.636561+0000","last_fullsized":"2024-09-10T05:55:33.636561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"36'39","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.441147+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:55:34.441147+0000","last_peered":"2024-09-10T05:55:34.441147+0000","last_clean":"2024-09-10T05:55:34.441147+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:55:34.441147+0000","last_undegraded":"2024-09-10T05:55:34.441147+0000","last_fullsized":"2024-09-10T05:55:34.441147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.621976+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:55:33.621976+0000","last_peered":"2024-09-10T05:55:33.621976+0000","last_clean":"2024-09-10T05:55:33.621976+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:55:33.621976+0000","last_undegraded":"2024-09-10T05:55:33.621976+0000","last_fullsized":"2024-09-10T05:55:33.621976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639001+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:55:33.639001+0000","last_peered":"2024-09-10T05:55:33.639001+0000","last_clean":"2024-09-10T05:55:33.639001+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:55:33.639001+0000","last_undegraded":"2024-09-10T05:55:33.639001+0000","last_fullsized":"2024-09-10T05:55:33.639001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653777+0000","last_change":"2024-09-10T05:55:24.554992+0000","last_active":"2024-09-10T05:55:33.653777+0000","last_peered":"2024-09-10T05:55:33.653777+0000","last_clean":"2024-09-10T05:55:33.653777+0000","last_became_active":"2024-09-10T05:55:24.554229+0000","last_became_peered":"2024-09-10T05:55:24.554229+0000","last_unstale":"2024-09-10T05:55:33.653777+0000","last_undegraded":"2024-09-10T05:55:33.653777+0000","last_fullsized":"2024-09-10T05:55:33.653777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609258+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:55:33.609258+0000","last_peered":"2024-09-10T05:55:33.609258+0000","last_clean":"2024-09-10T05:55:33.609258+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:55:33.609258+0000","last_undegraded":"2024-09-10T05:55:33.609258+0000","last_fullsized":"2024-09-10T05:55:33.609258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607427+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:55:33.607427+0000","last_peered":"2024-09-10T05:55:33.607427+0000","last_clean":"2024-09-10T05:55:33.607427+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:55:33.607427+0000","last_undegraded":"2024-09-10T05:55:33.607427+0000","last_fullsized":"2024-09-10T05:55:33.607427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.012202+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:55:34.012202+0000","last_peered":"2024-09-10T05:55:34.012202+0000","last_clean":"2024-09-10T05:55:34.012202+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:55:34.012202+0000","last_undegraded":"2024-09-10T05:55:34.012202+0000","last_fullsized":"2024-09-10T05:55:34.012202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645950+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:55:33.645950+0000","last_peered":"2024-09-10T05:55:33.645950+0000","last_clean":"2024-09-10T05:55:33.645950+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:55:33.645950+0000","last_undegraded":"2024-09-10T05:55:33.645950+0000","last_fullsized":"2024-09-10T05:55:33.645950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633681+0000","last_change":"2024-09-10T05:55:32.866310+0000","last_active":"2024-09-10T05:55:33.633681+0000","last_peered":"2024-09-10T05:55:33.633681+0000","last_clean":"2024-09-10T05:55:33.633681+0000","last_became_active":"2024-09-10T05:55:32.865414+0000","last_became_peered":"2024-09-10T05:55:32.865414+0000","last_unstale":"2024-09-10T05:55:33.633681+0000","last_undegraded":"2024-09-10T05:55:33.633681+0000","last_fullsized":"2024-09-10T05:55:33.633681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:50.899927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632068+0000","last_change":"2024-09-10T05:55:24.554383+0000","last_active":"2024-09-10T05:55:33.632068+0000","last_peered":"2024-09-10T05:55:33.632068+0000","last_clean":"2024-09-10T05:55:33.632068+0000","last_became_active":"2024-09-10T05:55:24.553962+0000","last_became_peered":"2024-09-10T05:55:24.553962+0000","last_unstale":"2024-09-10T05:55:33.632068+0000","last_undegraded":"2024-09-10T05:55:33.632068+0000","last_fullsized":"2024-09-10T05:55:33.632068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:55.226474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634150+0000","last_change":"2024-09-10T05:55:22.554679+0000","last_active":"2024-09-10T05:55:33.634150+0000","last_peered":"2024-09-10T05:55:33.634150+0000","last_clean":"2024-09-10T05:55:33.634150+0000","last_became_active":"2024-09-10T05:55:22.554111+0000","last_became_peered":"2024-09-10T05:55:22.554111+0000","last_unstale":"2024-09-10T05:55:33.634150+0000","last_undegraded":"2024-09-10T05:55:33.634150+0000","last_fullsized":"2024-09-10T05:55:33.634150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652601+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:55:33.652601+0000","last_peered":"2024-09-10T05:55:33.652601+0000","last_clean":"2024-09-10T05:55:33.652601+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:55:33.652601+0000","last_undegraded":"2024-09-10T05:55:33.652601+0000","last_fullsized":"2024-09-10T05:55:33.652601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"36'11","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.110153+0000","last_change":"2024-09-10T05:55:28.590320+0000","last_active":"2024-09-10T05:55:34.110153+0000","last_peered":"2024-09-10T05:55:34.110153+0000","last_clean":"2024-09-10T05:55:34.110153+0000","last_became_active":"2024-09-10T05:55:28.589157+0000","last_became_peered":"2024-09-10T05:55:28.589157+0000","last_unstale":"2024-09-10T05:55:34.110153+0000","last_undegraded":"2024-09-10T05:55:34.110153+0000","last_fullsized":"2024-09-10T05:55:34.110153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652988+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:55:33.652988+0000","last_peered":"2024-09-10T05:55:33.652988+0000","last_clean":"2024-09-10T05:55:33.652988+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:55:33.652988+0000","last_undegraded":"2024-09-10T05:55:33.652988+0000","last_fullsized":"2024-09-10T05:55:33.652988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638722+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:55:33.638722+0000","last_peered":"2024-09-10T05:55:33.638722+0000","last_clean":"2024-09-10T05:55:33.638722+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:55:33.638722+0000","last_undegraded":"2024-09-10T05:55:33.638722+0000","last_fullsized":"2024-09-10T05:55:33.638722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652986+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:55:33.652986+0000","last_peered":"2024-09-10T05:55:33.652986+0000","last_clean":"2024-09-10T05:55:33.652986+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:55:33.652986+0000","last_undegraded":"2024-09-10T05:55:33.652986+0000","last_fullsized":"2024-09-10T05:55:33.652986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625785+0000","last_change":"2024-09-10T05:55:22.561800+0000","last_active":"2024-09-10T05:55:33.625785+0000","last_peered":"2024-09-10T05:55:33.625785+0000","last_clean":"2024-09-10T05:55:33.625785+0000","last_became_active":"2024-09-10T05:55:22.561316+0000","last_became_peered":"2024-09-10T05:55:22.561316+0000","last_unstale":"2024-09-10T05:55:33.625785+0000","last_undegraded":"2024-09-10T05:55:33.625785+0000","last_fullsized":"2024-09-10T05:55:33.625785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:45.339840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609559+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:55:33.609559+0000","last_peered":"2024-09-10T05:55:33.609559+0000","last_clean":"2024-09-10T05:55:33.609559+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:55:33.609559+0000","last_undegraded":"2024-09-10T05:55:33.609559+0000","last_fullsized":"2024-09-10T05:55:33.609559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'21","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.158441+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:55:34.158441+0000","last_peered":"2024-09-10T05:55:34.158441+0000","last_clean":"2024-09-10T05:55:34.158441+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:55:34.158441+0000","last_undegraded":"2024-09-10T05:55:34.158441+0000","last_fullsized":"2024-09-10T05:55:34.158441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622588+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:55:33.622588+0000","last_peered":"2024-09-10T05:55:33.622588+0000","last_clean":"2024-09-10T05:55:33.622588+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:55:33.622588+0000","last_undegraded":"2024-09-10T05:55:33.622588+0000","last_fullsized":"2024-09-10T05:55:33.622588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655530+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:55:33.655530+0000","last_peered":"2024-09-10T05:55:33.655530+0000","last_clean":"2024-09-10T05:55:33.655530+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:55:33.655530+0000","last_undegraded":"2024-09-10T05:55:33.655530+0000","last_fullsized":"2024-09-10T05:55:33.655530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611101+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:55:33.611101+0000","last_peered":"2024-09-10T05:55:33.611101+0000","last_clean":"2024-09-10T05:55:33.611101+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:55:33.611101+0000","last_undegraded":"2024-09-10T05:55:33.611101+0000","last_fullsized":"2024-09-10T05:55:33.611101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645404+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:55:33.645404+0000","last_peered":"2024-09-10T05:55:33.645404+0000","last_clean":"2024-09-10T05:55:33.645404+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:55:33.645404+0000","last_undegraded":"2024-09-10T05:55:33.645404+0000","last_fullsized":"2024-09-10T05:55:33.645404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611317+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:55:33.611317+0000","last_peered":"2024-09-10T05:55:33.611317+0000","last_clean":"2024-09-10T05:55:33.611317+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:55:33.611317+0000","last_undegraded":"2024-09-10T05:55:33.611317+0000","last_fullsized":"2024-09-10T05:55:33.611317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670490+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:55:33.670490+0000","last_peered":"2024-09-10T05:55:33.670490+0000","last_clean":"2024-09-10T05:55:33.670490+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:55:33.670490+0000","last_undegraded":"2024-09-10T05:55:33.670490+0000","last_fullsized":"2024-09-10T05:55:33.670490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608514+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:55:33.608514+0000","last_peered":"2024-09-10T05:55:33.608514+0000","last_clean":"2024-09-10T05:55:33.608514+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:55:33.608514+0000","last_undegraded":"2024-09-10T05:55:33.608514+0000","last_fullsized":"2024-09-10T05:55:33.608514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608682+0000","last_change":"2024-09-10T05:55:22.565311+0000","last_active":"2024-09-10T05:55:33.608682+0000","last_peered":"2024-09-10T05:55:33.608682+0000","last_clean":"2024-09-10T05:55:33.608682+0000","last_became_active":"2024-09-10T05:55:22.553973+0000","last_became_peered":"2024-09-10T05:55:22.553973+0000","last_unstale":"2024-09-10T05:55:33.608682+0000","last_undegraded":"2024-09-10T05:55:33.608682+0000","last_fullsized":"2024-09-10T05:55:33.608682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:46.316825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611282+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:55:33.611282+0000","last_peered":"2024-09-10T05:55:33.611282+0000","last_clean":"2024-09-10T05:55:33.611282+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:55:33.611282+0000","last_undegraded":"2024-09-10T05:55:33.611282+0000","last_fullsized":"2024-09-10T05:55:33.611282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623385+0000","last_change":"2024-09-10T05:55:22.553110+0000","last_active":"2024-09-10T05:55:33.623385+0000","last_peered":"2024-09-10T05:55:33.623385+0000","last_clean":"2024-09-10T05:55:33.623385+0000","last_became_active":"2024-09-10T05:55:22.552040+0000","last_became_peered":"2024-09-10T05:55:22.552040+0000","last_unstale":"2024-09-10T05:55:33.623385+0000","last_undegraded":"2024-09-10T05:55:33.623385+0000","last_fullsized":"2024-09-10T05:55:33.623385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:15.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633096+0000","last_change":"2024-09-10T05:55:24.575761+0000","last_active":"2024-09-10T05:55:33.633096+0000","last_peered":"2024-09-10T05:55:33.633096+0000","last_clean":"2024-09-10T05:55:33.633096+0000","last_became_active":"2024-09-10T05:55:24.575067+0000","last_became_peered":"2024-09-10T05:55:24.575067+0000","last_unstale":"2024-09-10T05:55:33.633096+0000","last_undegraded":"2024-09-10T05:55:33.633096+0000","last_fullsized":"2024-09-10T05:55:33.633096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:27.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634152+0000","last_change":"2024-09-10T05:55:22.574898+0000","last_active":"2024-09-10T05:55:33.634152+0000","last_peered":"2024-09-10T05:55:33.634152+0000","last_clean":"2024-09-10T05:55:33.634152+0000","last_became_active":"2024-09-10T05:55:22.574453+0000","last_became_peered":"2024-09-10T05:55:22.574453+0000","last_unstale":"2024-09-10T05:55:33.634152+0000","last_undegraded":"2024-09-10T05:55:33.634152+0000","last_fullsized":"2024-09-10T05:55:33.634152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:43.643978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653898+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:55:33.653898+0000","last_peered":"2024-09-10T05:55:33.653898+0000","last_clean":"2024-09-10T05:55:33.653898+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:55:33.653898+0000","last_undegraded":"2024-09-10T05:55:33.653898+0000","last_fullsized":"2024-09-10T05:55:33.653898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612129+0000","last_change":"2024-09-10T05:55:22.544739+0000","last_active":"2024-09-10T05:55:33.612129+0000","last_peered":"2024-09-10T05:55:33.612129+0000","last_clean":"2024-09-10T05:55:33.612129+0000","last_became_active":"2024-09-10T05:55:22.544168+0000","last_became_peered":"2024-09-10T05:55:22.544168+0000","last_unstale":"2024-09-10T05:55:33.612129+0000","last_undegraded":"2024-09-10T05:55:33.612129+0000","last_fullsized":"2024-09-10T05:55:33.612129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631668+0000","last_change":"2024-09-10T05:55:24.567071+0000","last_active":"2024-09-10T05:55:33.631668+0000","last_peered":"2024-09-10T05:55:33.631668+0000","last_clean":"2024-09-10T05:55:33.631668+0000","last_became_active":"2024-09-10T05:55:24.566590+0000","last_became_peered":"2024-09-10T05:55:24.566590+0000","last_unstale":"2024-09-10T05:55:33.631668+0000","last_undegraded":"2024-09-10T05:55:33.631668+0000","last_fullsized":"2024-09-10T05:55:33.631668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:10.465413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647203+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:55:33.647203+0000","last_peered":"2024-09-10T05:55:33.647203+0000","last_clean":"2024-09-10T05:55:33.647203+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:55:33.647203+0000","last_undegraded":"2024-09-10T05:55:33.647203+0000","last_fullsized":"2024-09-10T05:55:33.647203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645395+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:55:33.645395+0000","last_peered":"2024-09-10T05:55:33.645395+0000","last_clean":"2024-09-10T05:55:33.645395+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:55:33.645395+0000","last_undegraded":"2024-09-10T05:55:33.645395+0000","last_fullsized":"2024-09-10T05:55:33.645395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634547+0000","last_change":"2024-09-10T05:55:22.573693+0000","last_active":"2024-09-10T05:55:33.634547+0000","last_peered":"2024-09-10T05:55:33.634547+0000","last_clean":"2024-09-10T05:55:33.634547+0000","last_became_active":"2024-09-10T05:55:22.573178+0000","last_became_peered":"2024-09-10T05:55:22.573178+0000","last_unstale":"2024-09-10T05:55:33.634547+0000","last_undegraded":"2024-09-10T05:55:33.634547+0000","last_fullsized":"2024-09-10T05:55:33.634547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:28.190362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625753+0000","last_change":"2024-09-10T05:55:24.561487+0000","last_active":"2024-09-10T05:55:33.625753+0000","last_peered":"2024-09-10T05:55:33.625753+0000","last_clean":"2024-09-10T05:55:33.625753+0000","last_became_active":"2024-09-10T05:55:24.560721+0000","last_became_peered":"2024-09-10T05:55:24.560721+0000","last_unstale":"2024-09-10T05:55:33.625753+0000","last_undegraded":"2024-09-10T05:55:33.625753+0000","last_fullsized":"2024-09-10T05:55:33.625753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609104+0000","last_change":"2024-09-10T05:55:22.561959+0000","last_active":"2024-09-10T05:55:33.609104+0000","last_peered":"2024-09-10T05:55:33.609104+0000","last_clean":"2024-09-10T05:55:33.609104+0000","last_became_active":"2024-09-10T05:55:22.561060+0000","last_became_peered":"2024-09-10T05:55:22.561060+0000","last_unstale":"2024-09-10T05:55:33.609104+0000","last_undegraded":"2024-09-10T05:55:33.609104+0000","last_fullsized":"2024-09-10T05:55:33.609104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655341+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:55:33.655341+0000","last_peered":"2024-09-10T05:55:33.655341+0000","last_clean":"2024-09-10T05:55:33.655341+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:55:33.655341+0000","last_undegraded":"2024-09-10T05:55:33.655341+0000","last_fullsized":"2024-09-10T05:55:33.655341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632201+0000","last_change":"2024-09-10T05:55:22.573494+0000","last_active":"2024-09-10T05:55:33.632201+0000","last_peered":"2024-09-10T05:55:33.632201+0000","last_clean":"2024-09-10T05:55:33.632201+0000","last_became_active":"2024-09-10T05:55:22.572978+0000","last_became_peered":"2024-09-10T05:55:22.572978+0000","last_unstale":"2024-09-10T05:55:33.632201+0000","last_undegraded":"2024-09-10T05:55:33.632201+0000","last_fullsized":"2024-09-10T05:55:33.632201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:54.896384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671647+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:55:33.671647+0000","last_peered":"2024-09-10T05:55:33.671647+0000","last_clean":"2024-09-10T05:55:33.671647+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:55:33.671647+0000","last_undegraded":"2024-09-10T05:55:33.671647+0000","last_fullsized":"2024-09-10T05:55:33.671647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608178+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:55:33.608178+0000","last_peered":"2024-09-10T05:55:33.608178+0000","last_clean":"2024-09-10T05:55:33.608178+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:55:33.608178+0000","last_undegraded":"2024-09-10T05:55:33.608178+0000","last_fullsized":"2024-09-10T05:55:33.608178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654837+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:55:33.654837+0000","last_peered":"2024-09-10T05:55:33.654837+0000","last_clean":"2024-09-10T05:55:33.654837+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:55:33.654837+0000","last_undegraded":"2024-09-10T05:55:33.654837+0000","last_fullsized":"2024-09-10T05:55:33.654837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623639+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:55:33.623639+0000","last_peered":"2024-09-10T05:55:33.623639+0000","last_clean":"2024-09-10T05:55:33.623639+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:55:33.623639+0000","last_undegraded":"2024-09-10T05:55:33.623639+0000","last_fullsized":"2024-09-10T05:55:33.623639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637300+0000","last_change":"2024-09-10T05:55:24.580883+0000","last_active":"2024-09-10T05:55:33.637300+0000","last_peered":"2024-09-10T05:55:33.637300+0000","last_clean":"2024-09-10T05:55:33.637300+0000","last_became_active":"2024-09-10T05:55:24.580203+0000","last_became_peered":"2024-09-10T05:55:24.580203+0000","last_unstale":"2024-09-10T05:55:33.637300+0000","last_undegraded":"2024-09-10T05:55:33.637300+0000","last_fullsized":"2024-09-10T05:55:33.637300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:12.571010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646749+0000","last_change":"2024-09-10T05:55:22.565433+0000","last_active":"2024-09-10T05:55:33.646749+0000","last_peered":"2024-09-10T05:55:33.646749+0000","last_clean":"2024-09-10T05:55:33.646749+0000","last_became_active":"2024-09-10T05:55:22.564640+0000","last_became_peered":"2024-09-10T05:55:22.564640+0000","last_unstale":"2024-09-10T05:55:33.646749+0000","last_undegraded":"2024-09-10T05:55:33.646749+0000","last_fullsized":"2024-09-10T05:55:33.646749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:43.825302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622600+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:55:33.622600+0000","last_peered":"2024-09-10T05:55:33.622600+0000","last_clean":"2024-09-10T05:55:33.622600+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:55:33.622600+0000","last_undegraded":"2024-09-10T05:55:33.622600+0000","last_fullsized":"2024-09-10T05:55:33.622600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639302+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:55:33.639302+0000","last_peered":"2024-09-10T05:55:33.639302+0000","last_clean":"2024-09-10T05:55:33.639302+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:55:33.639302+0000","last_undegraded":"2024-09-10T05:55:33.639302+0000","last_fullsized":"2024-09-10T05:55:33.639302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631669+0000","last_change":"2024-09-10T05:55:24.558453+0000","last_active":"2024-09-10T05:55:33.631669+0000","last_peered":"2024-09-10T05:55:33.631669+0000","last_clean":"2024-09-10T05:55:33.631669+0000","last_became_active":"2024-09-10T05:55:24.558058+0000","last_became_peered":"2024-09-10T05:55:24.558058+0000","last_unstale":"2024-09-10T05:55:33.631669+0000","last_undegraded":"2024-09-10T05:55:33.631669+0000","last_fullsized":"2024-09-10T05:55:33.631669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:12.571010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.672255+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:55:33.672255+0000","last_peered":"2024-09-10T05:55:33.672255+0000","last_clean":"2024-09-10T05:55:33.672255+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:55:33.672255+0000","last_undegraded":"2024-09-10T05:55:33.672255+0000","last_fullsized":"2024-09-10T05:55:33.672255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636145+0000","last_change":"2024-09-10T05:55:24.574106+0000","last_active":"2024-09-10T05:55:33.636145+0000","last_peered":"2024-09-10T05:55:33.636145+0000","last_clean":"2024-09-10T05:55:33.636145+0000","last_became_active":"2024-09-10T05:55:24.572550+0000","last_became_peered":"2024-09-10T05:55:24.572550+0000","last_unstale":"2024-09-10T05:55:33.636145+0000","last_undegraded":"2024-09-10T05:55:33.636145+0000","last_fullsized":"2024-09-10T05:55:33.636145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:01.134005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609805+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:55:33.609805+0000","last_peered":"2024-09-10T05:55:33.609805+0000","last_clean":"2024-09-10T05:55:33.609805+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:55:33.609805+0000","last_undegraded":"2024-09-10T05:55:33.609805+0000","last_fullsized":"2024-09-10T05:55:33.609805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608888+0000","last_change":"2024-09-10T05:55:22.567056+0000","last_active":"2024-09-10T05:55:33.608888+0000","last_peered":"2024-09-10T05:55:33.608888+0000","last_clean":"2024-09-10T05:55:33.608888+0000","last_became_active":"2024-09-10T05:55:22.563015+0000","last_became_peered":"2024-09-10T05:55:22.563015+0000","last_unstale":"2024-09-10T05:55:33.608888+0000","last_undegraded":"2024-09-10T05:55:33.608888+0000","last_fullsized":"2024-09-10T05:55:33.608888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:09.009494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625528+0000","last_change":"2024-09-10T05:55:24.561146+0000","last_active":"2024-09-10T05:55:33.625528+0000","last_peered":"2024-09-10T05:55:33.625528+0000","last_clean":"2024-09-10T05:55:33.625528+0000","last_became_active":"2024-09-10T05:55:24.560716+0000","last_became_peered":"2024-09-10T05:55:24.560716+0000","last_unstale":"2024-09-10T05:55:33.625528+0000","last_undegraded":"2024-09-10T05:55:33.625528+0000","last_fullsized":"2024-09-10T05:55:33.625528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:22.681220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610164+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:55:33.610164+0000","last_peered":"2024-09-10T05:55:33.610164+0000","last_clean":"2024-09-10T05:55:33.610164+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:55:33.610164+0000","last_undegraded":"2024-09-10T05:55:33.610164+0000","last_fullsized":"2024-09-10T05:55:33.610164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608358+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:55:33.608358+0000","last_peered":"2024-09-10T05:55:33.608358+0000","last_clean":"2024-09-10T05:55:33.608358+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:55:33.608358+0000","last_undegraded":"2024-09-10T05:55:33.608358+0000","last_fullsized":"2024-09-10T05:55:33.608358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":767489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":176897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":177308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":176952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":442368,"data_stored":177850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":409600,"data_stored":176023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":176730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":767331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:55:40.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:55:41.083 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:55:41.091 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:55:41.106 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-10T05:55:39.642662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":512,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249888,"kb_used_data":4560,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724832,"statfs":{"total":773094113280,"available":772838227968,"internally_reserved":0,"allocated":4669440,"data_stored":2596580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3548,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":973,"num_read_kb":702,"num_write":608,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004198"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638333+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:55:33.638333+0000","last_peered":"2024-09-10T05:55:33.638333+0000","last_clean":"2024-09-10T05:55:33.638333+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:55:33.638333+0000","last_undegraded":"2024-09-10T05:55:33.638333+0000","last_fullsized":"2024-09-10T05:55:33.638333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607171+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:55:33.607171+0000","last_peered":"2024-09-10T05:55:33.607171+0000","last_clean":"2024-09-10T05:55:33.607171+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:55:33.607171+0000","last_undegraded":"2024-09-10T05:55:33.607171+0000","last_fullsized":"2024-09-10T05:55:33.607171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612330+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:55:33.612330+0000","last_peered":"2024-09-10T05:55:33.612330+0000","last_clean":"2024-09-10T05:55:33.612330+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:55:33.612330+0000","last_undegraded":"2024-09-10T05:55:33.612330+0000","last_fullsized":"2024-09-10T05:55:33.612330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636323+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:55:33.636323+0000","last_peered":"2024-09-10T05:55:33.636323+0000","last_clean":"2024-09-10T05:55:33.636323+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:55:33.636323+0000","last_undegraded":"2024-09-10T05:55:33.636323+0000","last_fullsized":"2024-09-10T05:55:33.636323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624536+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:55:33.624536+0000","last_peered":"2024-09-10T05:55:33.624536+0000","last_clean":"2024-09-10T05:55:33.624536+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:55:33.624536+0000","last_undegraded":"2024-09-10T05:55:33.624536+0000","last_fullsized":"2024-09-10T05:55:33.624536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653499+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:55:33.653499+0000","last_peered":"2024-09-10T05:55:33.653499+0000","last_clean":"2024-09-10T05:55:33.653499+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:55:33.653499+0000","last_undegraded":"2024-09-10T05:55:33.653499+0000","last_fullsized":"2024-09-10T05:55:33.653499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608346+0000","last_change":"2024-09-10T05:55:22.559003+0000","last_active":"2024-09-10T05:55:33.608346+0000","last_peered":"2024-09-10T05:55:33.608346+0000","last_clean":"2024-09-10T05:55:33.608346+0000","last_became_active":"2024-09-10T05:55:22.558263+0000","last_became_peered":"2024-09-10T05:55:22.558263+0000","last_unstale":"2024-09-10T05:55:33.608346+0000","last_undegraded":"2024-09-10T05:55:33.608346+0000","last_fullsized":"2024-09-10T05:55:33.608346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623121+0000","last_change":"2024-09-10T05:55:24.571167+0000","last_active":"2024-09-10T05:55:33.623121+0000","last_peered":"2024-09-10T05:55:33.623121+0000","last_clean":"2024-09-10T05:55:33.623121+0000","last_became_active":"2024-09-10T05:55:24.570461+0000","last_became_peered":"2024-09-10T05:55:24.570461+0000","last_unstale":"2024-09-10T05:55:33.623121+0000","last_undegraded":"2024-09-10T05:55:33.623121+0000","last_fullsized":"2024-09-10T05:55:33.623121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:12.188381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637428+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:55:33.637428+0000","last_peered":"2024-09-10T05:55:33.637428+0000","last_clean":"2024-09-10T05:55:33.637428+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:55:33.637428+0000","last_undegraded":"2024-09-10T05:55:33.637428+0000","last_fullsized":"2024-09-10T05:55:33.637428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646345+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:55:33.646345+0000","last_peered":"2024-09-10T05:55:33.646345+0000","last_clean":"2024-09-10T05:55:33.646345+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:55:33.646345+0000","last_undegraded":"2024-09-10T05:55:33.646345+0000","last_fullsized":"2024-09-10T05:55:33.646345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607683+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:55:33.607683+0000","last_peered":"2024-09-10T05:55:33.607683+0000","last_clean":"2024-09-10T05:55:33.607683+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:55:33.607683+0000","last_undegraded":"2024-09-10T05:55:33.607683+0000","last_fullsized":"2024-09-10T05:55:33.607683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654672+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:55:33.654672+0000","last_peered":"2024-09-10T05:55:33.654672+0000","last_clean":"2024-09-10T05:55:33.654672+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:55:33.654672+0000","last_undegraded":"2024-09-10T05:55:33.654672+0000","last_fullsized":"2024-09-10T05:55:33.654672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636531+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:55:33.636531+0000","last_peered":"2024-09-10T05:55:33.636531+0000","last_clean":"2024-09-10T05:55:33.636531+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:55:33.636531+0000","last_undegraded":"2024-09-10T05:55:33.636531+0000","last_fullsized":"2024-09-10T05:55:33.636531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607910+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:55:33.607910+0000","last_peered":"2024-09-10T05:55:33.607910+0000","last_clean":"2024-09-10T05:55:33.607910+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:55:33.607910+0000","last_undegraded":"2024-09-10T05:55:33.607910+0000","last_fullsized":"2024-09-10T05:55:33.607910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632290+0000","last_change":"2024-09-10T05:55:22.557400+0000","last_active":"2024-09-10T05:55:33.632290+0000","last_peered":"2024-09-10T05:55:33.632290+0000","last_clean":"2024-09-10T05:55:33.632290+0000","last_became_active":"2024-09-10T05:55:22.557071+0000","last_became_peered":"2024-09-10T05:55:22.557071+0000","last_unstale":"2024-09-10T05:55:33.632290+0000","last_undegraded":"2024-09-10T05:55:33.632290+0000","last_fullsized":"2024-09-10T05:55:33.632290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:33.841554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.672091+0000","last_change":"2024-09-10T05:55:24.573619+0000","last_active":"2024-09-10T05:55:33.672091+0000","last_peered":"2024-09-10T05:55:33.672091+0000","last_clean":"2024-09-10T05:55:33.672091+0000","last_became_active":"2024-09-10T05:55:24.572932+0000","last_became_peered":"2024-09-10T05:55:24.572932+0000","last_unstale":"2024-09-10T05:55:33.672091+0000","last_undegraded":"2024-09-10T05:55:33.672091+0000","last_fullsized":"2024-09-10T05:55:33.672091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:45.073700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652921+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:55:33.652921+0000","last_peered":"2024-09-10T05:55:33.652921+0000","last_clean":"2024-09-10T05:55:33.652921+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:55:33.652921+0000","last_undegraded":"2024-09-10T05:55:33.652921+0000","last_fullsized":"2024-09-10T05:55:33.652921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638603+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:55:33.638603+0000","last_peered":"2024-09-10T05:55:33.638603+0000","last_clean":"2024-09-10T05:55:33.638603+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:55:33.638603+0000","last_undegraded":"2024-09-10T05:55:33.638603+0000","last_fullsized":"2024-09-10T05:55:33.638603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636453+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:55:33.636453+0000","last_peered":"2024-09-10T05:55:33.636453+0000","last_clean":"2024-09-10T05:55:33.636453+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:55:33.636453+0000","last_undegraded":"2024-09-10T05:55:33.636453+0000","last_fullsized":"2024-09-10T05:55:33.636453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646798+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:55:33.646798+0000","last_peered":"2024-09-10T05:55:33.646798+0000","last_clean":"2024-09-10T05:55:33.646798+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:55:33.646798+0000","last_undegraded":"2024-09-10T05:55:33.646798+0000","last_fullsized":"2024-09-10T05:55:33.646798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608161+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:55:33.608161+0000","last_peered":"2024-09-10T05:55:33.608161+0000","last_clean":"2024-09-10T05:55:33.608161+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:55:33.608161+0000","last_undegraded":"2024-09-10T05:55:33.608161+0000","last_fullsized":"2024-09-10T05:55:33.608161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647203+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:55:33.647203+0000","last_peered":"2024-09-10T05:55:33.647203+0000","last_clean":"2024-09-10T05:55:33.647203+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:55:33.647203+0000","last_undegraded":"2024-09-10T05:55:33.647203+0000","last_fullsized":"2024-09-10T05:55:33.647203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670995+0000","last_change":"2024-09-10T05:55:24.571973+0000","last_active":"2024-09-10T05:55:33.670995+0000","last_peered":"2024-09-10T05:55:33.670995+0000","last_clean":"2024-09-10T05:55:33.670995+0000","last_became_active":"2024-09-10T05:55:24.571283+0000","last_became_peered":"2024-09-10T05:55:24.571283+0000","last_unstale":"2024-09-10T05:55:33.670995+0000","last_undegraded":"2024-09-10T05:55:33.670995+0000","last_fullsized":"2024-09-10T05:55:33.670995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:51.405782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654255+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:55:33.654255+0000","last_peered":"2024-09-10T05:55:33.654255+0000","last_clean":"2024-09-10T05:55:33.654255+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:55:33.654255+0000","last_undegraded":"2024-09-10T05:55:33.654255+0000","last_fullsized":"2024-09-10T05:55:33.654255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671583+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:55:33.671583+0000","last_peered":"2024-09-10T05:55:33.671583+0000","last_clean":"2024-09-10T05:55:33.671583+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:55:33.671583+0000","last_undegraded":"2024-09-10T05:55:33.671583+0000","last_fullsized":"2024-09-10T05:55:33.671583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632544+0000","last_change":"2024-09-10T05:55:22.552632+0000","last_active":"2024-09-10T05:55:33.632544+0000","last_peered":"2024-09-10T05:55:33.632544+0000","last_clean":"2024-09-10T05:55:33.632544+0000","last_became_active":"2024-09-10T05:55:22.550781+0000","last_became_peered":"2024-09-10T05:55:22.550781+0000","last_unstale":"2024-09-10T05:55:33.632544+0000","last_undegraded":"2024-09-10T05:55:33.632544+0000","last_fullsized":"2024-09-10T05:55:33.632544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:50.331419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654811+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:55:33.654811+0000","last_peered":"2024-09-10T05:55:33.654811+0000","last_clean":"2024-09-10T05:55:33.654811+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:55:33.654811+0000","last_undegraded":"2024-09-10T05:55:33.654811+0000","last_fullsized":"2024-09-10T05:55:33.654811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623276+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:55:33.623276+0000","last_peered":"2024-09-10T05:55:33.623276+0000","last_clean":"2024-09-10T05:55:33.623276+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:55:33.623276+0000","last_undegraded":"2024-09-10T05:55:33.623276+0000","last_fullsized":"2024-09-10T05:55:33.623276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652818+0000","last_change":"2024-09-10T05:55:32.640522+0000","last_active":"2024-09-10T05:55:33.652818+0000","last_peered":"2024-09-10T05:55:33.652818+0000","last_clean":"2024-09-10T05:55:33.652818+0000","last_became_active":"2024-09-10T05:55:32.638735+0000","last_became_peered":"2024-09-10T05:55:32.638735+0000","last_unstale":"2024-09-10T05:55:33.652818+0000","last_undegraded":"2024-09-10T05:55:33.652818+0000","last_fullsized":"2024-09-10T05:55:33.652818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:26.363476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633459+0000","last_change":"2024-09-10T05:55:24.564828+0000","last_active":"2024-09-10T05:55:33.633459+0000","last_peered":"2024-09-10T05:55:33.633459+0000","last_clean":"2024-09-10T05:55:33.633459+0000","last_became_active":"2024-09-10T05:55:24.564473+0000","last_became_peered":"2024-09-10T05:55:24.564473+0000","last_unstale":"2024-09-10T05:55:33.633459+0000","last_undegraded":"2024-09-10T05:55:33.633459+0000","last_fullsized":"2024-09-10T05:55:33.633459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:54.332302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637651+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:55:33.637651+0000","last_peered":"2024-09-10T05:55:33.637651+0000","last_clean":"2024-09-10T05:55:33.637651+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:55:33.637651+0000","last_undegraded":"2024-09-10T05:55:33.637651+0000","last_fullsized":"2024-09-10T05:55:33.637651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608310+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:55:33.608310+0000","last_peered":"2024-09-10T05:55:33.608310+0000","last_clean":"2024-09-10T05:55:33.608310+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:55:33.608310+0000","last_undegraded":"2024-09-10T05:55:33.608310+0000","last_fullsized":"2024-09-10T05:55:33.608310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"36'21","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.022326+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:55:34.022326+0000","last_peered":"2024-09-10T05:55:34.022326+0000","last_clean":"2024-09-10T05:55:34.022326+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:55:34.022326+0000","last_undegraded":"2024-09-10T05:55:34.022326+0000","last_fullsized":"2024-09-10T05:55:34.022326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638093+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:55:33.638093+0000","last_peered":"2024-09-10T05:55:33.638093+0000","last_clean":"2024-09-10T05:55:33.638093+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:55:33.638093+0000","last_undegraded":"2024-09-10T05:55:33.638093+0000","last_fullsized":"2024-09-10T05:55:33.638093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607144+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:55:33.607144+0000","last_peered":"2024-09-10T05:55:33.607144+0000","last_clean":"2024-09-10T05:55:33.607144+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:55:33.607144+0000","last_undegraded":"2024-09-10T05:55:33.607144+0000","last_fullsized":"2024-09-10T05:55:33.607144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609183+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:55:33.609183+0000","last_peered":"2024-09-10T05:55:33.609183+0000","last_clean":"2024-09-10T05:55:33.609183+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:55:33.609183+0000","last_undegraded":"2024-09-10T05:55:33.609183+0000","last_fullsized":"2024-09-10T05:55:33.609183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623308+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:55:33.623308+0000","last_peered":"2024-09-10T05:55:33.623308+0000","last_clean":"2024-09-10T05:55:33.623308+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:55:33.623308+0000","last_undegraded":"2024-09-10T05:55:33.623308+0000","last_fullsized":"2024-09-10T05:55:33.623308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634366+0000","last_change":"2024-09-10T05:55:26.566912+0000","last_active":"2024-09-10T05:55:33.634366+0000","last_peered":"2024-09-10T05:55:33.634366+0000","last_clean":"2024-09-10T05:55:33.634366+0000","last_became_active":"2024-09-10T05:55:26.566305+0000","last_became_peered":"2024-09-10T05:55:26.566305+0000","last_unstale":"2024-09-10T05:55:33.634366+0000","last_undegraded":"2024-09-10T05:55:33.634366+0000","last_fullsized":"2024-09-10T05:55:33.634366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:56.014911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.314856+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:55:34.314856+0000","last_peered":"2024-09-10T05:55:34.314856+0000","last_clean":"2024-09-10T05:55:34.314856+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:55:34.314856+0000","last_undegraded":"2024-09-10T05:55:34.314856+0000","last_fullsized":"2024-09-10T05:55:34.314856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654743+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:55:33.654743+0000","last_peered":"2024-09-10T05:55:33.654743+0000","last_clean":"2024-09-10T05:55:33.654743+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:55:33.654743+0000","last_undegraded":"2024-09-10T05:55:33.654743+0000","last_fullsized":"2024-09-10T05:55:33.654743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623123+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:55:33.623123+0000","last_peered":"2024-09-10T05:55:33.623123+0000","last_clean":"2024-09-10T05:55:33.623123+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:55:33.623123+0000","last_undegraded":"2024-09-10T05:55:33.623123+0000","last_fullsized":"2024-09-10T05:55:33.623123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625966+0000","last_change":"2024-09-10T05:55:24.571856+0000","last_active":"2024-09-10T05:55:33.625966+0000","last_peered":"2024-09-10T05:55:33.625966+0000","last_clean":"2024-09-10T05:55:33.625966+0000","last_became_active":"2024-09-10T05:55:24.570838+0000","last_became_peered":"2024-09-10T05:55:24.570838+0000","last_unstale":"2024-09-10T05:55:33.625966+0000","last_undegraded":"2024-09-10T05:55:33.625966+0000","last_fullsized":"2024-09-10T05:55:33.625966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:05.305448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636754+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:55:33.636754+0000","last_peered":"2024-09-10T05:55:33.636754+0000","last_clean":"2024-09-10T05:55:33.636754+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:55:33.636754+0000","last_undegraded":"2024-09-10T05:55:33.636754+0000","last_fullsized":"2024-09-10T05:55:33.636754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634903+0000","last_change":"2024-09-10T05:55:26.567407+0000","last_active":"2024-09-10T05:55:33.634903+0000","last_peered":"2024-09-10T05:55:33.634903+0000","last_clean":"2024-09-10T05:55:33.634903+0000","last_became_active":"2024-09-10T05:55:26.566951+0000","last_became_peered":"2024-09-10T05:55:26.566951+0000","last_unstale":"2024-09-10T05:55:33.634903+0000","last_undegraded":"2024-09-10T05:55:33.634903+0000","last_fullsized":"2024-09-10T05:55:33.634903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'22","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.367131+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:55:34.367131+0000","last_peered":"2024-09-10T05:55:34.367131+0000","last_clean":"2024-09-10T05:55:34.367131+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:55:34.367131+0000","last_undegraded":"2024-09-10T05:55:34.367131+0000","last_fullsized":"2024-09-10T05:55:34.367131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637750+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:55:33.637750+0000","last_peered":"2024-09-10T05:55:33.637750+0000","last_clean":"2024-09-10T05:55:33.637750+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:55:33.637750+0000","last_undegraded":"2024-09-10T05:55:33.637750+0000","last_fullsized":"2024-09-10T05:55:33.637750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653697+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:55:33.653697+0000","last_peered":"2024-09-10T05:55:33.653697+0000","last_clean":"2024-09-10T05:55:33.653697+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:55:33.653697+0000","last_undegraded":"2024-09-10T05:55:33.653697+0000","last_fullsized":"2024-09-10T05:55:33.653697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634288+0000","last_change":"2024-09-10T05:55:24.556982+0000","last_active":"2024-09-10T05:55:33.634288+0000","last_peered":"2024-09-10T05:55:33.634288+0000","last_clean":"2024-09-10T05:55:33.634288+0000","last_became_active":"2024-09-10T05:55:24.556683+0000","last_became_peered":"2024-09-10T05:55:24.556683+0000","last_unstale":"2024-09-10T05:55:33.634288+0000","last_undegraded":"2024-09-10T05:55:33.634288+0000","last_fullsized":"2024-09-10T05:55:33.634288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:25.347351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645646+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:55:33.645646+0000","last_peered":"2024-09-10T05:55:33.645646+0000","last_clean":"2024-09-10T05:55:33.645646+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:55:33.645646+0000","last_undegraded":"2024-09-10T05:55:33.645646+0000","last_fullsized":"2024-09-10T05:55:33.645646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607818+0000","last_change":"2024-09-10T05:55:26.573512+0000","last_active":"2024-09-10T05:55:33.607818+0000","last_peered":"2024-09-10T05:55:33.607818+0000","last_clean":"2024-09-10T05:55:33.607818+0000","last_became_active":"2024-09-10T05:55:26.572502+0000","last_became_peered":"2024-09-10T05:55:26.572502+0000","last_unstale":"2024-09-10T05:55:33.607818+0000","last_undegraded":"2024-09-10T05:55:33.607818+0000","last_fullsized":"2024-09-10T05:55:33.607818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:26.420995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.370313+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:55:34.370313+0000","last_peered":"2024-09-10T05:55:34.370313+0000","last_clean":"2024-09-10T05:55:34.370313+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:55:34.370313+0000","last_undegraded":"2024-09-10T05:55:34.370313+0000","last_fullsized":"2024-09-10T05:55:34.370313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632798+0000","last_change":"2024-09-10T05:55:30.608079+0000","last_active":"2024-09-10T05:55:33.632798+0000","last_peered":"2024-09-10T05:55:33.632798+0000","last_clean":"2024-09-10T05:55:33.632798+0000","last_became_active":"2024-09-10T05:55:30.607194+0000","last_became_peered":"2024-09-10T05:55:30.607194+0000","last_unstale":"2024-09-10T05:55:33.632798+0000","last_undegraded":"2024-09-10T05:55:33.632798+0000","last_fullsized":"2024-09-10T05:55:33.632798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:44.793013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609103+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:55:33.609103+0000","last_peered":"2024-09-10T05:55:33.609103+0000","last_clean":"2024-09-10T05:55:33.609103+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:55:33.609103+0000","last_undegraded":"2024-09-10T05:55:33.609103+0000","last_fullsized":"2024-09-10T05:55:33.609103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638758+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:55:33.638758+0000","last_peered":"2024-09-10T05:55:33.638758+0000","last_clean":"2024-09-10T05:55:33.638758+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:55:33.638758+0000","last_undegraded":"2024-09-10T05:55:33.638758+0000","last_fullsized":"2024-09-10T05:55:33.638758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636031+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:55:33.636031+0000","last_peered":"2024-09-10T05:55:33.636031+0000","last_clean":"2024-09-10T05:55:33.636031+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:55:33.636031+0000","last_undegraded":"2024-09-10T05:55:33.636031+0000","last_fullsized":"2024-09-10T05:55:33.636031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"36'25","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.459585+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:55:34.459585+0000","last_peered":"2024-09-10T05:55:34.459585+0000","last_clean":"2024-09-10T05:55:34.459585+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:55:34.459585+0000","last_undegraded":"2024-09-10T05:55:34.459585+0000","last_fullsized":"2024-09-10T05:55:34.459585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610507+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:55:33.610507+0000","last_peered":"2024-09-10T05:55:33.610507+0000","last_clean":"2024-09-10T05:55:33.610507+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:55:33.610507+0000","last_undegraded":"2024-09-10T05:55:33.610507+0000","last_fullsized":"2024-09-10T05:55:33.610507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607765+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:55:33.607765+0000","last_peered":"2024-09-10T05:55:33.607765+0000","last_clean":"2024-09-10T05:55:33.607765+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:55:33.607765+0000","last_undegraded":"2024-09-10T05:55:33.607765+0000","last_fullsized":"2024-09-10T05:55:33.607765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653237+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:55:33.653237+0000","last_peered":"2024-09-10T05:55:33.653237+0000","last_clean":"2024-09-10T05:55:33.653237+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:55:33.653237+0000","last_undegraded":"2024-09-10T05:55:33.653237+0000","last_fullsized":"2024-09-10T05:55:33.653237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638435+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:55:33.638435+0000","last_peered":"2024-09-10T05:55:33.638435+0000","last_clean":"2024-09-10T05:55:33.638435+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:55:33.638435+0000","last_undegraded":"2024-09-10T05:55:33.638435+0000","last_fullsized":"2024-09-10T05:55:33.638435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670520+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:55:33.670520+0000","last_peered":"2024-09-10T05:55:33.670520+0000","last_clean":"2024-09-10T05:55:33.670520+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:55:33.670520+0000","last_undegraded":"2024-09-10T05:55:33.670520+0000","last_fullsized":"2024-09-10T05:55:33.670520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.348474+0000","last_change":"2024-09-10T05:55:28.588127+0000","last_active":"2024-09-10T05:55:34.348474+0000","last_peered":"2024-09-10T05:55:34.348474+0000","last_clean":"2024-09-10T05:55:34.348474+0000","last_became_active":"2024-09-10T05:55:28.587370+0000","last_became_peered":"2024-09-10T05:55:28.587370+0000","last_unstale":"2024-09-10T05:55:34.348474+0000","last_undegraded":"2024-09-10T05:55:34.348474+0000","last_fullsized":"2024-09-10T05:55:34.348474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:12.868467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631518+0000","last_change":"2024-09-10T05:55:30.607579+0000","last_active":"2024-09-10T05:55:33.631518+0000","last_peered":"2024-09-10T05:55:33.631518+0000","last_clean":"2024-09-10T05:55:33.631518+0000","last_became_active":"2024-09-10T05:55:30.606853+0000","last_became_peered":"2024-09-10T05:55:30.606853+0000","last_unstale":"2024-09-10T05:55:33.631518+0000","last_undegraded":"2024-09-10T05:55:33.631518+0000","last_fullsized":"2024-09-10T05:55:33.631518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:26.576932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646702+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:55:33.646702+0000","last_peered":"2024-09-10T05:55:33.646702+0000","last_clean":"2024-09-10T05:55:33.646702+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:55:33.646702+0000","last_undegraded":"2024-09-10T05:55:33.646702+0000","last_fullsized":"2024-09-10T05:55:33.646702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648721+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:55:33.648721+0000","last_peered":"2024-09-10T05:55:33.648721+0000","last_clean":"2024-09-10T05:55:33.648721+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:55:33.648721+0000","last_undegraded":"2024-09-10T05:55:33.648721+0000","last_fullsized":"2024-09-10T05:55:33.648721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639031+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:55:33.639031+0000","last_peered":"2024-09-10T05:55:33.639031+0000","last_clean":"2024-09-10T05:55:33.639031+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:55:33.639031+0000","last_undegraded":"2024-09-10T05:55:33.639031+0000","last_fullsized":"2024-09-10T05:55:33.639031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671324+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:55:33.671324+0000","last_peered":"2024-09-10T05:55:33.671324+0000","last_clean":"2024-09-10T05:55:33.671324+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:55:33.671324+0000","last_undegraded":"2024-09-10T05:55:33.671324+0000","last_fullsized":"2024-09-10T05:55:33.671324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'27","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.269694+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:55:34.269694+0000","last_peered":"2024-09-10T05:55:34.269694+0000","last_clean":"2024-09-10T05:55:34.269694+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:55:34.269694+0000","last_undegraded":"2024-09-10T05:55:34.269694+0000","last_fullsized":"2024-09-10T05:55:34.269694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622183+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:55:33.622183+0000","last_peered":"2024-09-10T05:55:33.622183+0000","last_clean":"2024-09-10T05:55:33.622183+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:55:33.622183+0000","last_undegraded":"2024-09-10T05:55:33.622183+0000","last_fullsized":"2024-09-10T05:55:33.622183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625299+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:55:33.625299+0000","last_peered":"2024-09-10T05:55:33.625299+0000","last_clean":"2024-09-10T05:55:33.625299+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:55:33.625299+0000","last_undegraded":"2024-09-10T05:55:33.625299+0000","last_fullsized":"2024-09-10T05:55:33.625299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624073+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:55:33.624073+0000","last_peered":"2024-09-10T05:55:33.624073+0000","last_clean":"2024-09-10T05:55:33.624073+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:55:33.624073+0000","last_undegraded":"2024-09-10T05:55:33.624073+0000","last_fullsized":"2024-09-10T05:55:33.624073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609006+0000","last_change":"2024-09-10T05:55:22.559608+0000","last_active":"2024-09-10T05:55:33.609006+0000","last_peered":"2024-09-10T05:55:33.609006+0000","last_clean":"2024-09-10T05:55:33.609006+0000","last_became_active":"2024-09-10T05:55:22.558802+0000","last_became_peered":"2024-09-10T05:55:22.558802+0000","last_unstale":"2024-09-10T05:55:33.609006+0000","last_undegraded":"2024-09-10T05:55:33.609006+0000","last_fullsized":"2024-09-10T05:55:33.609006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670947+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:55:33.670947+0000","last_peered":"2024-09-10T05:55:33.670947+0000","last_clean":"2024-09-10T05:55:33.670947+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:55:33.670947+0000","last_undegraded":"2024-09-10T05:55:33.670947+0000","last_fullsized":"2024-09-10T05:55:33.670947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'24","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.047956+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:55:34.047956+0000","last_peered":"2024-09-10T05:55:34.047956+0000","last_clean":"2024-09-10T05:55:34.047956+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:55:34.047956+0000","last_undegraded":"2024-09-10T05:55:34.047956+0000","last_fullsized":"2024-09-10T05:55:34.047956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670332+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:55:33.670332+0000","last_peered":"2024-09-10T05:55:33.670332+0000","last_clean":"2024-09-10T05:55:33.670332+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:55:33.670332+0000","last_undegraded":"2024-09-10T05:55:33.670332+0000","last_fullsized":"2024-09-10T05:55:33.670332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610937+0000","last_change":"2024-09-10T05:55:32.625390+0000","last_active":"2024-09-10T05:55:33.610937+0000","last_peered":"2024-09-10T05:55:33.610937+0000","last_clean":"2024-09-10T05:55:33.610937+0000","last_became_active":"2024-09-10T05:55:32.624651+0000","last_became_peered":"2024-09-10T05:55:32.624651+0000","last_unstale":"2024-09-10T05:55:33.610937+0000","last_undegraded":"2024-09-10T05:55:33.610937+0000","last_fullsized":"2024-09-10T05:55:33.610937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:21.472496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654430+0000","last_change":"2024-09-10T05:55:24.559341+0000","last_active":"2024-09-10T05:55:33.654430+0000","last_peered":"2024-09-10T05:55:33.654430+0000","last_clean":"2024-09-10T05:55:33.654430+0000","last_became_active":"2024-09-10T05:55:24.558589+0000","last_became_peered":"2024-09-10T05:55:24.558589+0000","last_unstale":"2024-09-10T05:55:33.654430+0000","last_undegraded":"2024-09-10T05:55:33.654430+0000","last_fullsized":"2024-09-10T05:55:33.654430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:59.318764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632024+0000","last_change":"2024-09-10T05:55:22.555183+0000","last_active":"2024-09-10T05:55:33.632024+0000","last_peered":"2024-09-10T05:55:33.632024+0000","last_clean":"2024-09-10T05:55:33.632024+0000","last_became_active":"2024-09-10T05:55:22.554019+0000","last_became_peered":"2024-09-10T05:55:22.554019+0000","last_unstale":"2024-09-10T05:55:33.632024+0000","last_undegraded":"2024-09-10T05:55:33.632024+0000","last_fullsized":"2024-09-10T05:55:33.632024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:04.308909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671379+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:55:33.671379+0000","last_peered":"2024-09-10T05:55:33.671379+0000","last_clean":"2024-09-10T05:55:33.671379+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:55:33.671379+0000","last_undegraded":"2024-09-10T05:55:33.671379+0000","last_fullsized":"2024-09-10T05:55:33.671379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'19","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.402075+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:55:34.402075+0000","last_peered":"2024-09-10T05:55:34.402075+0000","last_clean":"2024-09-10T05:55:34.402075+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:55:34.402075+0000","last_undegraded":"2024-09-10T05:55:34.402075+0000","last_fullsized":"2024-09-10T05:55:34.402075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625369+0000","last_change":"2024-09-10T05:55:30.627775+0000","last_active":"2024-09-10T05:55:33.625369+0000","last_peered":"2024-09-10T05:55:33.625369+0000","last_clean":"2024-09-10T05:55:33.625369+0000","last_became_active":"2024-09-10T05:55:30.617486+0000","last_became_peered":"2024-09-10T05:55:30.617486+0000","last_unstale":"2024-09-10T05:55:33.625369+0000","last_undegraded":"2024-09-10T05:55:33.625369+0000","last_fullsized":"2024-09-10T05:55:33.625369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:42.641816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631783+0000","last_change":"2024-09-10T05:55:32.622452+0000","last_active":"2024-09-10T05:55:33.631783+0000","last_peered":"2024-09-10T05:55:33.631783+0000","last_clean":"2024-09-10T05:55:33.631783+0000","last_became_active":"2024-09-10T05:55:32.621526+0000","last_became_peered":"2024-09-10T05:55:32.621526+0000","last_unstale":"2024-09-10T05:55:33.631783+0000","last_undegraded":"2024-09-10T05:55:33.631783+0000","last_fullsized":"2024-09-10T05:55:33.631783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:10.744428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654962+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:55:33.654962+0000","last_peered":"2024-09-10T05:55:33.654962+0000","last_clean":"2024-09-10T05:55:33.654962+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:55:33.654962+0000","last_undegraded":"2024-09-10T05:55:33.654962+0000","last_fullsized":"2024-09-10T05:55:33.654962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.649026+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:55:33.649026+0000","last_peered":"2024-09-10T05:55:33.649026+0000","last_clean":"2024-09-10T05:55:33.649026+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:55:33.649026+0000","last_undegraded":"2024-09-10T05:55:33.649026+0000","last_fullsized":"2024-09-10T05:55:33.649026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610316+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:55:33.610316+0000","last_peered":"2024-09-10T05:55:33.610316+0000","last_clean":"2024-09-10T05:55:33.610316+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:55:33.610316+0000","last_undegraded":"2024-09-10T05:55:33.610316+0000","last_fullsized":"2024-09-10T05:55:33.610316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.468548+0000","last_change":"2024-09-10T05:55:28.590795+0000","last_active":"2024-09-10T05:55:34.468548+0000","last_peered":"2024-09-10T05:55:34.468548+0000","last_clean":"2024-09-10T05:55:34.468548+0000","last_became_active":"2024-09-10T05:55:28.590012+0000","last_became_peered":"2024-09-10T05:55:28.590012+0000","last_unstale":"2024-09-10T05:55:34.468548+0000","last_undegraded":"2024-09-10T05:55:34.468548+0000","last_fullsized":"2024-09-10T05:55:34.468548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:11.582824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671697+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:55:33.671697+0000","last_peered":"2024-09-10T05:55:33.671697+0000","last_clean":"2024-09-10T05:55:33.671697+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:55:33.671697+0000","last_undegraded":"2024-09-10T05:55:33.671697+0000","last_fullsized":"2024-09-10T05:55:33.671697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612520+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:55:33.612520+0000","last_peered":"2024-09-10T05:55:33.612520+0000","last_clean":"2024-09-10T05:55:33.612520+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:55:33.612520+0000","last_undegraded":"2024-09-10T05:55:33.612520+0000","last_fullsized":"2024-09-10T05:55:33.612520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655417+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:55:33.655417+0000","last_peered":"2024-09-10T05:55:33.655417+0000","last_clean":"2024-09-10T05:55:33.655417+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:55:33.655417+0000","last_undegraded":"2024-09-10T05:55:33.655417+0000","last_fullsized":"2024-09-10T05:55:33.655417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653831+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:55:33.653831+0000","last_peered":"2024-09-10T05:55:33.653831+0000","last_clean":"2024-09-10T05:55:33.653831+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:55:33.653831+0000","last_undegraded":"2024-09-10T05:55:33.653831+0000","last_fullsized":"2024-09-10T05:55:33.653831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608543+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:55:33.608543+0000","last_peered":"2024-09-10T05:55:33.608543+0000","last_clean":"2024-09-10T05:55:33.608543+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:55:33.608543+0000","last_undegraded":"2024-09-10T05:55:33.608543+0000","last_fullsized":"2024-09-10T05:55:33.608543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.279949+0000","last_change":"2024-09-10T05:55:28.613924+0000","last_active":"2024-09-10T05:55:34.279949+0000","last_peered":"2024-09-10T05:55:34.279949+0000","last_clean":"2024-09-10T05:55:34.279949+0000","last_became_active":"2024-09-10T05:55:28.613419+0000","last_became_peered":"2024-09-10T05:55:28.613419+0000","last_unstale":"2024-09-10T05:55:34.279949+0000","last_undegraded":"2024-09-10T05:55:34.279949+0000","last_fullsized":"2024-09-10T05:55:34.279949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646485+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:55:33.646485+0000","last_peered":"2024-09-10T05:55:33.646485+0000","last_clean":"2024-09-10T05:55:33.646485+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:55:33.646485+0000","last_undegraded":"2024-09-10T05:55:33.646485+0000","last_fullsized":"2024-09-10T05:55:33.646485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653579+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:55:33.653579+0000","last_peered":"2024-09-10T05:55:33.653579+0000","last_clean":"2024-09-10T05:55:33.653579+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:55:33.653579+0000","last_undegraded":"2024-09-10T05:55:33.653579+0000","last_fullsized":"2024-09-10T05:55:33.653579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611352+0000","last_change":"2024-09-10T05:55:24.572073+0000","last_active":"2024-09-10T05:55:33.611352+0000","last_peered":"2024-09-10T05:55:33.611352+0000","last_clean":"2024-09-10T05:55:33.611352+0000","last_became_active":"2024-09-10T05:55:24.571749+0000","last_became_peered":"2024-09-10T05:55:24.571749+0000","last_unstale":"2024-09-10T05:55:33.611352+0000","last_undegraded":"2024-09-10T05:55:33.611352+0000","last_fullsized":"2024-09-10T05:55:33.611352+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632552+0000","last_change":"2024-09-10T05:55:22.545583+0000","last_active":"2024-09-10T05:55:33.632552+0000","last_peered":"2024-09-10T05:55:33.632552+0000","last_clean":"2024-09-10T05:55:33.632552+0000","last_became_active":"2024-09-10T05:55:22.545064+0000","last_became_peered":"2024-09-10T05:55:22.545064+0000","last_unstale":"2024-09-10T05:55:33.632552+0000","last_undegraded":"2024-09-10T05:55:33.632552+0000","last_fullsized":"2024-09-10T05:55:33.632552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655223+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:55:33.655223+0000","last_peered":"2024-09-10T05:55:33.655223+0000","last_clean":"2024-09-10T05:55:33.655223+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:55:33.655223+0000","last_undegraded":"2024-09-10T05:55:33.655223+0000","last_fullsized":"2024-09-10T05:55:33.655223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.394996+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:55:34.394996+0000","last_peered":"2024-09-10T05:55:34.394996+0000","last_clean":"2024-09-10T05:55:34.394996+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:55:34.394996+0000","last_undegraded":"2024-09-10T05:55:34.394996+0000","last_fullsized":"2024-09-10T05:55:34.394996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645807+0000","last_change":"2024-09-10T05:55:30.609186+0000","last_active":"2024-09-10T05:55:33.645807+0000","last_peered":"2024-09-10T05:55:33.645807+0000","last_clean":"2024-09-10T05:55:33.645807+0000","last_became_active":"2024-09-10T05:55:30.608639+0000","last_became_peered":"2024-09-10T05:55:30.608639+0000","last_unstale":"2024-09-10T05:55:33.645807+0000","last_undegraded":"2024-09-10T05:55:33.645807+0000","last_fullsized":"2024-09-10T05:55:33.645807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:31.395218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610452+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:55:33.610452+0000","last_peered":"2024-09-10T05:55:33.610452+0000","last_clean":"2024-09-10T05:55:33.610452+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:55:33.610452+0000","last_undegraded":"2024-09-10T05:55:33.610452+0000","last_fullsized":"2024-09-10T05:55:33.610452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646956+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:55:33.646956+0000","last_peered":"2024-09-10T05:55:33.646956+0000","last_clean":"2024-09-10T05:55:33.646956+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:55:33.646956+0000","last_undegraded":"2024-09-10T05:55:33.646956+0000","last_fullsized":"2024-09-10T05:55:33.646956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636549+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:55:33.636549+0000","last_peered":"2024-09-10T05:55:33.636549+0000","last_clean":"2024-09-10T05:55:33.636549+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:55:33.636549+0000","last_undegraded":"2024-09-10T05:55:33.636549+0000","last_fullsized":"2024-09-10T05:55:33.636549+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607657+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:55:33.607657+0000","last_peered":"2024-09-10T05:55:33.607657+0000","last_clean":"2024-09-10T05:55:33.607657+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:55:33.607657+0000","last_undegraded":"2024-09-10T05:55:33.607657+0000","last_fullsized":"2024-09-10T05:55:33.607657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632336+0000","last_change":"2024-09-10T05:55:22.569046+0000","last_active":"2024-09-10T05:55:33.632336+0000","last_peered":"2024-09-10T05:55:33.632336+0000","last_clean":"2024-09-10T05:55:33.632336+0000","last_became_active":"2024-09-10T05:55:22.568467+0000","last_became_peered":"2024-09-10T05:55:22.568467+0000","last_unstale":"2024-09-10T05:55:33.632336+0000","last_undegraded":"2024-09-10T05:55:33.632336+0000","last_fullsized":"2024-09-10T05:55:33.632336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637177+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:55:33.637177+0000","last_peered":"2024-09-10T05:55:33.637177+0000","last_clean":"2024-09-10T05:55:33.637177+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:55:33.637177+0000","last_undegraded":"2024-09-10T05:55:33.637177+0000","last_fullsized":"2024-09-10T05:55:33.637177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"36'19","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.211432+0000","last_change":"2024-09-10T05:55:28.588054+0000","last_active":"2024-09-10T05:55:34.211432+0000","last_peered":"2024-09-10T05:55:34.211432+0000","last_clean":"2024-09-10T05:55:34.211432+0000","last_became_active":"2024-09-10T05:55:28.587107+0000","last_became_peered":"2024-09-10T05:55:28.587107+0000","last_unstale":"2024-09-10T05:55:34.211432+0000","last_undegraded":"2024-09-10T05:55:34.211432+0000","last_fullsized":"2024-09-10T05:55:34.211432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:12.868467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624963+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:55:33.624963+0000","last_peered":"2024-09-10T05:55:33.624963+0000","last_clean":"2024-09-10T05:55:33.624963+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:55:33.624963+0000","last_undegraded":"2024-09-10T05:55:33.624963+0000","last_fullsized":"2024-09-10T05:55:33.624963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645845+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:55:33.645845+0000","last_peered":"2024-09-10T05:55:33.645845+0000","last_clean":"2024-09-10T05:55:33.645845+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:55:33.645845+0000","last_undegraded":"2024-09-10T05:55:33.645845+0000","last_fullsized":"2024-09-10T05:55:33.645845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625598+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:55:33.625598+0000","last_peered":"2024-09-10T05:55:33.625598+0000","last_clean":"2024-09-10T05:55:33.625598+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:55:33.625598+0000","last_undegraded":"2024-09-10T05:55:33.625598+0000","last_fullsized":"2024-09-10T05:55:33.625598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636270+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:55:33.636270+0000","last_peered":"2024-09-10T05:55:33.636270+0000","last_clean":"2024-09-10T05:55:33.636270+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:55:33.636270+0000","last_undegraded":"2024-09-10T05:55:33.636270+0000","last_fullsized":"2024-09-10T05:55:33.636270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622848+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:55:33.622848+0000","last_peered":"2024-09-10T05:55:33.622848+0000","last_clean":"2024-09-10T05:55:33.622848+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:55:33.622848+0000","last_undegraded":"2024-09-10T05:55:33.622848+0000","last_fullsized":"2024-09-10T05:55:33.622848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609552+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:55:33.609552+0000","last_peered":"2024-09-10T05:55:33.609552+0000","last_clean":"2024-09-10T05:55:33.609552+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:55:33.609552+0000","last_undegraded":"2024-09-10T05:55:33.609552+0000","last_fullsized":"2024-09-10T05:55:33.609552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"36'29","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.386373+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:55:34.386373+0000","last_peered":"2024-09-10T05:55:34.386373+0000","last_clean":"2024-09-10T05:55:34.386373+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:55:34.386373+0000","last_undegraded":"2024-09-10T05:55:34.386373+0000","last_fullsized":"2024-09-10T05:55:34.386373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637759+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:55:33.637759+0000","last_peered":"2024-09-10T05:55:33.637759+0000","last_clean":"2024-09-10T05:55:33.637759+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:55:33.637759+0000","last_undegraded":"2024-09-10T05:55:33.637759+0000","last_fullsized":"2024-09-10T05:55:33.637759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612467+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:55:33.612467+0000","last_peered":"2024-09-10T05:55:33.612467+0000","last_clean":"2024-09-10T05:55:33.612467+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:55:33.612467+0000","last_undegraded":"2024-09-10T05:55:33.612467+0000","last_fullsized":"2024-09-10T05:55:33.612467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611575+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:55:33.611575+0000","last_peered":"2024-09-10T05:55:33.611575+0000","last_clean":"2024-09-10T05:55:33.611575+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:55:33.611575+0000","last_undegraded":"2024-09-10T05:55:33.611575+0000","last_fullsized":"2024-09-10T05:55:33.611575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670773+0000","last_change":"2024-09-10T05:55:14.253426+0000","last_active":"2024-09-10T05:55:33.670773+0000","last_peered":"2024-09-10T05:55:33.670773+0000","last_clean":"2024-09-10T05:55:33.670773+0000","last_became_active":"2024-09-10T05:55:12.625451+0000","last_became_peered":"2024-09-10T05:55:12.625451+0000","last_unstale":"2024-09-10T05:55:33.670773+0000","last_undegraded":"2024-09-10T05:55:33.670773+0000","last_fullsized":"2024-09-10T05:55:33.670773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:39.260823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609221+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:55:33.609221+0000","last_peered":"2024-09-10T05:55:33.609221+0000","last_clean":"2024-09-10T05:55:33.609221+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:55:33.609221+0000","last_undegraded":"2024-09-10T05:55:33.609221+0000","last_fullsized":"2024-09-10T05:55:33.609221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671993+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:55:33.671993+0000","last_peered":"2024-09-10T05:55:33.671993+0000","last_clean":"2024-09-10T05:55:33.671993+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:55:33.671993+0000","last_undegraded":"2024-09-10T05:55:33.671993+0000","last_fullsized":"2024-09-10T05:55:33.671993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.389111+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:55:34.389111+0000","last_peered":"2024-09-10T05:55:34.389111+0000","last_clean":"2024-09-10T05:55:34.389111+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:55:34.389111+0000","last_undegraded":"2024-09-10T05:55:34.389111+0000","last_fullsized":"2024-09-10T05:55:34.389111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623093+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:55:33.623093+0000","last_peered":"2024-09-10T05:55:33.623093+0000","last_clean":"2024-09-10T05:55:33.623093+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:55:33.623093+0000","last_undegraded":"2024-09-10T05:55:33.623093+0000","last_fullsized":"2024-09-10T05:55:33.623093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633050+0000","last_change":"2024-09-10T05:55:32.642991+0000","last_active":"2024-09-10T05:55:33.633050+0000","last_peered":"2024-09-10T05:55:33.633050+0000","last_clean":"2024-09-10T05:55:33.633050+0000","last_became_active":"2024-09-10T05:55:32.642276+0000","last_became_peered":"2024-09-10T05:55:32.642276+0000","last_unstale":"2024-09-10T05:55:33.633050+0000","last_undegraded":"2024-09-10T05:55:33.633050+0000","last_fullsized":"2024-09-10T05:55:33.633050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:41.787760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610771+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:55:33.610771+0000","last_peered":"2024-09-10T05:55:33.610771+0000","last_clean":"2024-09-10T05:55:33.610771+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:55:33.610771+0000","last_undegraded":"2024-09-10T05:55:33.610771+0000","last_fullsized":"2024-09-10T05:55:33.610771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608518+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:55:33.608518+0000","last_peered":"2024-09-10T05:55:33.608518+0000","last_clean":"2024-09-10T05:55:33.608518+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:55:33.608518+0000","last_undegraded":"2024-09-10T05:55:33.608518+0000","last_fullsized":"2024-09-10T05:55:33.608518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654431+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:55:33.654431+0000","last_peered":"2024-09-10T05:55:33.654431+0000","last_clean":"2024-09-10T05:55:33.654431+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:55:33.654431+0000","last_undegraded":"2024-09-10T05:55:33.654431+0000","last_fullsized":"2024-09-10T05:55:33.654431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624410+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:55:33.624410+0000","last_peered":"2024-09-10T05:55:33.624410+0000","last_clean":"2024-09-10T05:55:33.624410+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:55:33.624410+0000","last_undegraded":"2024-09-10T05:55:33.624410+0000","last_fullsized":"2024-09-10T05:55:33.624410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.248402+0000","last_change":"2024-09-10T05:55:28.588230+0000","last_active":"2024-09-10T05:55:34.248402+0000","last_peered":"2024-09-10T05:55:34.248402+0000","last_clean":"2024-09-10T05:55:34.248402+0000","last_became_active":"2024-09-10T05:55:28.587443+0000","last_became_peered":"2024-09-10T05:55:28.587443+0000","last_unstale":"2024-09-10T05:55:34.248402+0000","last_undegraded":"2024-09-10T05:55:34.248402+0000","last_fullsized":"2024-09-10T05:55:34.248402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646687+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:55:33.646687+0000","last_peered":"2024-09-10T05:55:33.646687+0000","last_clean":"2024-09-10T05:55:33.646687+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:55:33.646687+0000","last_undegraded":"2024-09-10T05:55:33.646687+0000","last_fullsized":"2024-09-10T05:55:33.646687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.606978+0000","last_change":"2024-09-10T05:55:32.623633+0000","last_active":"2024-09-10T05:55:33.606978+0000","last_peered":"2024-09-10T05:55:33.606978+0000","last_clean":"2024-09-10T05:55:33.606978+0000","last_became_active":"2024-09-10T05:55:32.621769+0000","last_became_peered":"2024-09-10T05:55:32.621769+0000","last_unstale":"2024-09-10T05:55:33.606978+0000","last_undegraded":"2024-09-10T05:55:33.606978+0000","last_fullsized":"2024-09-10T05:55:33.606978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:27.593293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611495+0000","last_change":"2024-09-10T05:55:24.564966+0000","last_active":"2024-09-10T05:55:33.611495+0000","last_peered":"2024-09-10T05:55:33.611495+0000","last_clean":"2024-09-10T05:55:33.611495+0000","last_became_active":"2024-09-10T05:55:24.564572+0000","last_became_peered":"2024-09-10T05:55:24.564572+0000","last_unstale":"2024-09-10T05:55:33.611495+0000","last_undegraded":"2024-09-10T05:55:33.611495+0000","last_fullsized":"2024-09-10T05:55:33.611495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609466+0000","last_change":"2024-09-10T05:55:22.558913+0000","last_active":"2024-09-10T05:55:33.609466+0000","last_peered":"2024-09-10T05:55:33.609466+0000","last_clean":"2024-09-10T05:55:33.609466+0000","last_became_active":"2024-09-10T05:55:22.558172+0000","last_became_peered":"2024-09-10T05:55:22.558172+0000","last_unstale":"2024-09-10T05:55:33.609466+0000","last_undegraded":"2024-09-10T05:55:33.609466+0000","last_fullsized":"2024-09-10T05:55:33.609466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611512+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:55:33.611512+0000","last_peered":"2024-09-10T05:55:33.611512+0000","last_clean":"2024-09-10T05:55:33.611512+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:55:33.611512+0000","last_undegraded":"2024-09-10T05:55:33.611512+0000","last_fullsized":"2024-09-10T05:55:33.611512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623613+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:55:33.623613+0000","last_peered":"2024-09-10T05:55:33.623613+0000","last_clean":"2024-09-10T05:55:33.623613+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:55:33.623613+0000","last_undegraded":"2024-09-10T05:55:33.623613+0000","last_fullsized":"2024-09-10T05:55:33.623613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'30","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.329982+0000","last_change":"2024-09-10T05:55:28.591664+0000","last_active":"2024-09-10T05:55:34.329982+0000","last_peered":"2024-09-10T05:55:34.329982+0000","last_clean":"2024-09-10T05:55:34.329982+0000","last_became_active":"2024-09-10T05:55:28.590273+0000","last_became_peered":"2024-09-10T05:55:28.590273+0000","last_unstale":"2024-09-10T05:55:34.329982+0000","last_undegraded":"2024-09-10T05:55:34.329982+0000","last_fullsized":"2024-09-10T05:55:34.329982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:46.079078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652809+0000","last_change":"2024-09-10T05:55:30.595410+0000","last_active":"2024-09-10T05:55:33.652809+0000","last_peered":"2024-09-10T05:55:33.652809+0000","last_clean":"2024-09-10T05:55:33.652809+0000","last_became_active":"2024-09-10T05:55:30.594589+0000","last_became_peered":"2024-09-10T05:55:30.594589+0000","last_unstale":"2024-09-10T05:55:33.652809+0000","last_undegraded":"2024-09-10T05:55:33.652809+0000","last_fullsized":"2024-09-10T05:55:33.652809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:56.649903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624803+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:55:33.624803+0000","last_peered":"2024-09-10T05:55:33.624803+0000","last_clean":"2024-09-10T05:55:33.624803+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:55:33.624803+0000","last_undegraded":"2024-09-10T05:55:33.624803+0000","last_fullsized":"2024-09-10T05:55:33.624803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.624076+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:55:33.624076+0000","last_peered":"2024-09-10T05:55:33.624076+0000","last_clean":"2024-09-10T05:55:33.624076+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:55:33.624076+0000","last_undegraded":"2024-09-10T05:55:33.624076+0000","last_fullsized":"2024-09-10T05:55:33.624076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611049+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:55:33.611049+0000","last_peered":"2024-09-10T05:55:33.611049+0000","last_clean":"2024-09-10T05:55:33.611049+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:55:33.611049+0000","last_undegraded":"2024-09-10T05:55:33.611049+0000","last_fullsized":"2024-09-10T05:55:33.611049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639312+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:55:33.639312+0000","last_peered":"2024-09-10T05:55:33.639312+0000","last_clean":"2024-09-10T05:55:33.639312+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:55:33.639312+0000","last_undegraded":"2024-09-10T05:55:33.639312+0000","last_fullsized":"2024-09-10T05:55:33.639312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648365+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:55:33.648365+0000","last_peered":"2024-09-10T05:55:33.648365+0000","last_clean":"2024-09-10T05:55:33.648365+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:55:33.648365+0000","last_undegraded":"2024-09-10T05:55:33.648365+0000","last_fullsized":"2024-09-10T05:55:33.648365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.418787+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:55:34.418787+0000","last_peered":"2024-09-10T05:55:34.418787+0000","last_clean":"2024-09-10T05:55:34.418787+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:55:34.418787+0000","last_undegraded":"2024-09-10T05:55:34.418787+0000","last_fullsized":"2024-09-10T05:55:34.418787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607865+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:55:33.607865+0000","last_peered":"2024-09-10T05:55:33.607865+0000","last_clean":"2024-09-10T05:55:33.607865+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:55:33.607865+0000","last_undegraded":"2024-09-10T05:55:33.607865+0000","last_fullsized":"2024-09-10T05:55:33.607865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634889+0000","last_change":"2024-09-10T05:55:32.863868+0000","last_active":"2024-09-10T05:55:33.634889+0000","last_peered":"2024-09-10T05:55:33.634889+0000","last_clean":"2024-09-10T05:55:33.634889+0000","last_became_active":"2024-09-10T05:55:32.862966+0000","last_became_peered":"2024-09-10T05:55:32.862966+0000","last_unstale":"2024-09-10T05:55:33.634889+0000","last_undegraded":"2024-09-10T05:55:33.634889+0000","last_fullsized":"2024-09-10T05:55:33.634889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:42.616817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632028+0000","last_change":"2024-09-10T05:55:24.552746+0000","last_active":"2024-09-10T05:55:33.632028+0000","last_peered":"2024-09-10T05:55:33.632028+0000","last_clean":"2024-09-10T05:55:33.632028+0000","last_became_active":"2024-09-10T05:55:24.552326+0000","last_became_peered":"2024-09-10T05:55:24.552326+0000","last_unstale":"2024-09-10T05:55:33.632028+0000","last_undegraded":"2024-09-10T05:55:33.632028+0000","last_fullsized":"2024-09-10T05:55:33.632028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:39.661302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633749+0000","last_change":"2024-09-10T05:55:22.571302+0000","last_active":"2024-09-10T05:55:33.633749+0000","last_peered":"2024-09-10T05:55:33.633749+0000","last_clean":"2024-09-10T05:55:33.633749+0000","last_became_active":"2024-09-10T05:55:22.570586+0000","last_became_peered":"2024-09-10T05:55:22.570586+0000","last_unstale":"2024-09-10T05:55:33.633749+0000","last_undegraded":"2024-09-10T05:55:33.633749+0000","last_fullsized":"2024-09-10T05:55:33.633749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:43.825302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611877+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:55:33.611877+0000","last_peered":"2024-09-10T05:55:33.611877+0000","last_clean":"2024-09-10T05:55:33.611877+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:55:33.611877+0000","last_undegraded":"2024-09-10T05:55:33.611877+0000","last_fullsized":"2024-09-10T05:55:33.611877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653075+0000","last_change":"2024-09-10T05:55:26.567267+0000","last_active":"2024-09-10T05:55:33.653075+0000","last_peered":"2024-09-10T05:55:33.653075+0000","last_clean":"2024-09-10T05:55:33.653075+0000","last_became_active":"2024-09-10T05:55:26.566406+0000","last_became_peered":"2024-09-10T05:55:26.566406+0000","last_unstale":"2024-09-10T05:55:33.653075+0000","last_undegraded":"2024-09-10T05:55:33.653075+0000","last_fullsized":"2024-09-10T05:55:33.653075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:00.428645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.377319+0000","last_change":"2024-09-10T05:55:28.588437+0000","last_active":"2024-09-10T05:55:34.377319+0000","last_peered":"2024-09-10T05:55:34.377319+0000","last_clean":"2024-09-10T05:55:34.377319+0000","last_became_active":"2024-09-10T05:55:28.587136+0000","last_became_peered":"2024-09-10T05:55:28.587136+0000","last_unstale":"2024-09-10T05:55:34.377319+0000","last_undegraded":"2024-09-10T05:55:34.377319+0000","last_fullsized":"2024-09-10T05:55:34.377319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:40:32.880337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633842+0000","last_change":"2024-09-10T05:55:30.616043+0000","last_active":"2024-09-10T05:55:33.633842+0000","last_peered":"2024-09-10T05:55:33.633842+0000","last_clean":"2024-09-10T05:55:33.633842+0000","last_became_active":"2024-09-10T05:55:30.615332+0000","last_became_peered":"2024-09-10T05:55:30.615332+0000","last_unstale":"2024-09-10T05:55:33.633842+0000","last_undegraded":"2024-09-10T05:55:33.633842+0000","last_fullsized":"2024-09-10T05:55:33.633842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:07.408810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623656+0000","last_change":"2024-09-10T05:55:32.627524+0000","last_active":"2024-09-10T05:55:33.623656+0000","last_peered":"2024-09-10T05:55:33.623656+0000","last_clean":"2024-09-10T05:55:33.623656+0000","last_became_active":"2024-09-10T05:55:32.626785+0000","last_became_peered":"2024-09-10T05:55:32.626785+0000","last_unstale":"2024-09-10T05:55:33.623656+0000","last_undegraded":"2024-09-10T05:55:33.623656+0000","last_fullsized":"2024-09-10T05:55:33.623656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:51.953007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653316+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:55:33.653316+0000","last_peered":"2024-09-10T05:55:33.653316+0000","last_clean":"2024-09-10T05:55:33.653316+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:55:33.653316+0000","last_undegraded":"2024-09-10T05:55:33.653316+0000","last_fullsized":"2024-09-10T05:55:33.653316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.626231+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:55:33.626231+0000","last_peered":"2024-09-10T05:55:33.626231+0000","last_clean":"2024-09-10T05:55:33.626231+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:55:33.626231+0000","last_undegraded":"2024-09-10T05:55:33.626231+0000","last_fullsized":"2024-09-10T05:55:33.626231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647268+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:55:33.647268+0000","last_peered":"2024-09-10T05:55:33.647268+0000","last_clean":"2024-09-10T05:55:33.647268+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:55:33.647268+0000","last_undegraded":"2024-09-10T05:55:33.647268+0000","last_fullsized":"2024-09-10T05:55:33.647268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631782+0000","last_change":"2024-09-10T05:55:26.567071+0000","last_active":"2024-09-10T05:55:33.631782+0000","last_peered":"2024-09-10T05:55:33.631782+0000","last_clean":"2024-09-10T05:55:33.631782+0000","last_became_active":"2024-09-10T05:55:26.566699+0000","last_became_peered":"2024-09-10T05:55:26.566699+0000","last_unstale":"2024-09-10T05:55:33.631782+0000","last_undegraded":"2024-09-10T05:55:33.631782+0000","last_fullsized":"2024-09-10T05:55:33.631782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:06.770848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'26","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.358023+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:55:34.358023+0000","last_peered":"2024-09-10T05:55:34.358023+0000","last_clean":"2024-09-10T05:55:34.358023+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:55:34.358023+0000","last_undegraded":"2024-09-10T05:55:34.358023+0000","last_fullsized":"2024-09-10T05:55:34.358023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631522+0000","last_change":"2024-09-10T05:55:30.617156+0000","last_active":"2024-09-10T05:55:33.631522+0000","last_peered":"2024-09-10T05:55:33.631522+0000","last_clean":"2024-09-10T05:55:33.631522+0000","last_became_active":"2024-09-10T05:55:30.616444+0000","last_became_peered":"2024-09-10T05:55:30.616444+0000","last_unstale":"2024-09-10T05:55:33.631522+0000","last_undegraded":"2024-09-10T05:55:33.631522+0000","last_fullsized":"2024-09-10T05:55:33.631522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:27.529277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608141+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:55:33.608141+0000","last_peered":"2024-09-10T05:55:33.608141+0000","last_clean":"2024-09-10T05:55:33.608141+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:55:33.608141+0000","last_undegraded":"2024-09-10T05:55:33.608141+0000","last_fullsized":"2024-09-10T05:55:33.608141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625538+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:55:33.625538+0000","last_peered":"2024-09-10T05:55:33.625538+0000","last_clean":"2024-09-10T05:55:33.625538+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:55:33.625538+0000","last_undegraded":"2024-09-10T05:55:33.625538+0000","last_fullsized":"2024-09-10T05:55:33.625538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654035+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:55:33.654035+0000","last_peered":"2024-09-10T05:55:33.654035+0000","last_clean":"2024-09-10T05:55:33.654035+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:55:33.654035+0000","last_undegraded":"2024-09-10T05:55:33.654035+0000","last_fullsized":"2024-09-10T05:55:33.654035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654100+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:55:33.654100+0000","last_peered":"2024-09-10T05:55:33.654100+0000","last_clean":"2024-09-10T05:55:33.654100+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:55:33.654100+0000","last_undegraded":"2024-09-10T05:55:33.654100+0000","last_fullsized":"2024-09-10T05:55:33.654100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611761+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:55:33.611761+0000","last_peered":"2024-09-10T05:55:33.611761+0000","last_clean":"2024-09-10T05:55:33.611761+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:55:33.611761+0000","last_undegraded":"2024-09-10T05:55:33.611761+0000","last_fullsized":"2024-09-10T05:55:33.611761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'17","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.425615+0000","last_change":"2024-09-10T05:55:28.588559+0000","last_active":"2024-09-10T05:55:34.425615+0000","last_peered":"2024-09-10T05:55:34.425615+0000","last_clean":"2024-09-10T05:55:34.425615+0000","last_became_active":"2024-09-10T05:55:28.587805+0000","last_became_peered":"2024-09-10T05:55:28.587805+0000","last_unstale":"2024-09-10T05:55:34.425615+0000","last_undegraded":"2024-09-10T05:55:34.425615+0000","last_fullsized":"2024-09-10T05:55:34.425615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:19.106173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631330+0000","last_change":"2024-09-10T05:55:30.604838+0000","last_active":"2024-09-10T05:55:33.631330+0000","last_peered":"2024-09-10T05:55:33.631330+0000","last_clean":"2024-09-10T05:55:33.631330+0000","last_became_active":"2024-09-10T05:55:30.603989+0000","last_became_peered":"2024-09-10T05:55:30.603989+0000","last_unstale":"2024-09-10T05:55:33.631330+0000","last_undegraded":"2024-09-10T05:55:33.631330+0000","last_fullsized":"2024-09-10T05:55:33.631330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:55.306195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633762+0000","last_change":"2024-09-10T05:55:32.621971+0000","last_active":"2024-09-10T05:55:33.633762+0000","last_peered":"2024-09-10T05:55:33.633762+0000","last_clean":"2024-09-10T05:55:33.633762+0000","last_became_active":"2024-09-10T05:55:32.621237+0000","last_became_peered":"2024-09-10T05:55:32.621237+0000","last_unstale":"2024-09-10T05:55:33.633762+0000","last_undegraded":"2024-09-10T05:55:33.633762+0000","last_fullsized":"2024-09-10T05:55:33.633762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:53.481428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611272+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:55:33.611272+0000","last_peered":"2024-09-10T05:55:33.611272+0000","last_clean":"2024-09-10T05:55:33.611272+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:55:33.611272+0000","last_undegraded":"2024-09-10T05:55:33.611272+0000","last_fullsized":"2024-09-10T05:55:33.611272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638951+0000","last_change":"2024-09-10T05:55:22.572808+0000","last_active":"2024-09-10T05:55:33.638951+0000","last_peered":"2024-09-10T05:55:33.638951+0000","last_clean":"2024-09-10T05:55:33.638951+0000","last_became_active":"2024-09-10T05:55:22.572130+0000","last_became_peered":"2024-09-10T05:55:22.572130+0000","last_unstale":"2024-09-10T05:55:33.638951+0000","last_undegraded":"2024-09-10T05:55:33.638951+0000","last_fullsized":"2024-09-10T05:55:33.638951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:09.009494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632708+0000","last_change":"2024-09-10T05:55:26.570811+0000","last_active":"2024-09-10T05:55:33.632708+0000","last_peered":"2024-09-10T05:55:33.632708+0000","last_clean":"2024-09-10T05:55:33.632708+0000","last_became_active":"2024-09-10T05:55:26.570227+0000","last_became_peered":"2024-09-10T05:55:26.570227+0000","last_unstale":"2024-09-10T05:55:33.632708+0000","last_undegraded":"2024-09-10T05:55:33.632708+0000","last_fullsized":"2024-09-10T05:55:33.632708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:33.508950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'4","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.997331+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:55:33.997331+0000","last_peered":"2024-09-10T05:55:33.997331+0000","last_clean":"2024-09-10T05:55:33.997331+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:55:33.997331+0000","last_undegraded":"2024-09-10T05:55:33.997331+0000","last_fullsized":"2024-09-10T05:55:33.997331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636228+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:55:33.636228+0000","last_peered":"2024-09-10T05:55:33.636228+0000","last_clean":"2024-09-10T05:55:33.636228+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:55:33.636228+0000","last_undegraded":"2024-09-10T05:55:33.636228+0000","last_fullsized":"2024-09-10T05:55:33.636228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623485+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:55:33.623485+0000","last_peered":"2024-09-10T05:55:33.623485+0000","last_clean":"2024-09-10T05:55:33.623485+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:55:33.623485+0000","last_undegraded":"2024-09-10T05:55:33.623485+0000","last_fullsized":"2024-09-10T05:55:33.623485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633491+0000","last_change":"2024-09-10T05:55:24.557478+0000","last_active":"2024-09-10T05:55:33.633491+0000","last_peered":"2024-09-10T05:55:33.633491+0000","last_clean":"2024-09-10T05:55:33.633491+0000","last_became_active":"2024-09-10T05:55:24.557026+0000","last_became_peered":"2024-09-10T05:55:24.557026+0000","last_unstale":"2024-09-10T05:55:33.633491+0000","last_undegraded":"2024-09-10T05:55:33.633491+0000","last_fullsized":"2024-09-10T05:55:33.633491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:16.764319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608808+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:55:33.608808+0000","last_peered":"2024-09-10T05:55:33.608808+0000","last_clean":"2024-09-10T05:55:33.608808+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:55:33.608808+0000","last_undegraded":"2024-09-10T05:55:33.608808+0000","last_fullsized":"2024-09-10T05:55:33.608808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.635529+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:55:33.635529+0000","last_peered":"2024-09-10T05:55:33.635529+0000","last_clean":"2024-09-10T05:55:33.635529+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:55:33.635529+0000","last_undegraded":"2024-09-10T05:55:33.635529+0000","last_fullsized":"2024-09-10T05:55:33.635529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.342459+0000","last_change":"2024-09-10T05:55:28.582238+0000","last_active":"2024-09-10T05:55:34.342459+0000","last_peered":"2024-09-10T05:55:34.342459+0000","last_clean":"2024-09-10T05:55:34.342459+0000","last_became_active":"2024-09-10T05:55:28.581532+0000","last_became_peered":"2024-09-10T05:55:28.581532+0000","last_unstale":"2024-09-10T05:55:34.342459+0000","last_undegraded":"2024-09-10T05:55:34.342459+0000","last_fullsized":"2024-09-10T05:55:34.342459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:18.922489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648181+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:55:33.648181+0000","last_peered":"2024-09-10T05:55:33.648181+0000","last_clean":"2024-09-10T05:55:33.648181+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:55:33.648181+0000","last_undegraded":"2024-09-10T05:55:33.648181+0000","last_fullsized":"2024-09-10T05:55:33.648181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609401+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:55:33.609401+0000","last_peered":"2024-09-10T05:55:33.609401+0000","last_clean":"2024-09-10T05:55:33.609401+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:55:33.609401+0000","last_undegraded":"2024-09-10T05:55:33.609401+0000","last_fullsized":"2024-09-10T05:55:33.609401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632222+0000","last_change":"2024-09-10T05:55:24.565846+0000","last_active":"2024-09-10T05:55:33.632222+0000","last_peered":"2024-09-10T05:55:33.632222+0000","last_clean":"2024-09-10T05:55:33.632222+0000","last_became_active":"2024-09-10T05:55:24.565138+0000","last_became_peered":"2024-09-10T05:55:24.565138+0000","last_unstale":"2024-09-10T05:55:33.632222+0000","last_undegraded":"2024-09-10T05:55:33.632222+0000","last_fullsized":"2024-09-10T05:55:33.632222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:43.891979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625980+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:55:33.625980+0000","last_peered":"2024-09-10T05:55:33.625980+0000","last_clean":"2024-09-10T05:55:33.625980+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:55:33.625980+0000","last_undegraded":"2024-09-10T05:55:33.625980+0000","last_fullsized":"2024-09-10T05:55:33.625980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646965+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:55:33.646965+0000","last_peered":"2024-09-10T05:55:33.646965+0000","last_clean":"2024-09-10T05:55:33.646965+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:55:33.646965+0000","last_undegraded":"2024-09-10T05:55:33.646965+0000","last_fullsized":"2024-09-10T05:55:33.646965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.139119+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:55:34.139119+0000","last_peered":"2024-09-10T05:55:34.139119+0000","last_clean":"2024-09-10T05:55:34.139119+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:55:34.139119+0000","last_undegraded":"2024-09-10T05:55:34.139119+0000","last_fullsized":"2024-09-10T05:55:34.139119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622864+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:55:33.622864+0000","last_peered":"2024-09-10T05:55:33.622864+0000","last_clean":"2024-09-10T05:55:33.622864+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:55:33.622864+0000","last_undegraded":"2024-09-10T05:55:33.622864+0000","last_fullsized":"2024-09-10T05:55:33.622864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647005+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:55:33.647005+0000","last_peered":"2024-09-10T05:55:33.647005+0000","last_clean":"2024-09-10T05:55:33.647005+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:55:33.647005+0000","last_undegraded":"2024-09-10T05:55:33.647005+0000","last_fullsized":"2024-09-10T05:55:33.647005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632483+0000","last_change":"2024-09-10T05:55:22.555925+0000","last_active":"2024-09-10T05:55:33.632483+0000","last_peered":"2024-09-10T05:55:33.632483+0000","last_clean":"2024-09-10T05:55:33.632483+0000","last_became_active":"2024-09-10T05:55:22.555404+0000","last_became_peered":"2024-09-10T05:55:22.555404+0000","last_unstale":"2024-09-10T05:55:33.632483+0000","last_undegraded":"2024-09-10T05:55:33.632483+0000","last_fullsized":"2024-09-10T05:55:33.632483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625186+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:55:33.625186+0000","last_peered":"2024-09-10T05:55:33.625186+0000","last_clean":"2024-09-10T05:55:33.625186+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:55:33.625186+0000","last_undegraded":"2024-09-10T05:55:33.625186+0000","last_fullsized":"2024-09-10T05:55:33.625186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'18","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.450599+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:55:34.450599+0000","last_peered":"2024-09-10T05:55:34.450599+0000","last_clean":"2024-09-10T05:55:34.450599+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:55:34.450599+0000","last_undegraded":"2024-09-10T05:55:34.450599+0000","last_fullsized":"2024-09-10T05:55:34.450599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607949+0000","last_change":"2024-09-10T05:55:30.604845+0000","last_active":"2024-09-10T05:55:33.607949+0000","last_peered":"2024-09-10T05:55:33.607949+0000","last_clean":"2024-09-10T05:55:33.607949+0000","last_became_active":"2024-09-10T05:55:30.604134+0000","last_became_peered":"2024-09-10T05:55:30.604134+0000","last_unstale":"2024-09-10T05:55:33.607949+0000","last_undegraded":"2024-09-10T05:55:33.607949+0000","last_fullsized":"2024-09-10T05:55:33.607949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632386+0000","last_change":"2024-09-10T05:55:32.866321+0000","last_active":"2024-09-10T05:55:33.632386+0000","last_peered":"2024-09-10T05:55:33.632386+0000","last_clean":"2024-09-10T05:55:33.632386+0000","last_became_active":"2024-09-10T05:55:32.865490+0000","last_became_peered":"2024-09-10T05:55:32.865490+0000","last_unstale":"2024-09-10T05:55:33.632386+0000","last_undegraded":"2024-09-10T05:55:33.632386+0000","last_fullsized":"2024-09-10T05:55:33.632386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:03.601742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625482+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:55:33.625482+0000","last_peered":"2024-09-10T05:55:33.625482+0000","last_clean":"2024-09-10T05:55:33.625482+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:55:33.625482+0000","last_undegraded":"2024-09-10T05:55:33.625482+0000","last_fullsized":"2024-09-10T05:55:33.625482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611612+0000","last_change":"2024-09-10T05:55:22.545969+0000","last_active":"2024-09-10T05:55:33.611612+0000","last_peered":"2024-09-10T05:55:33.611612+0000","last_clean":"2024-09-10T05:55:33.611612+0000","last_became_active":"2024-09-10T05:55:22.544732+0000","last_became_peered":"2024-09-10T05:55:22.544732+0000","last_unstale":"2024-09-10T05:55:33.611612+0000","last_undegraded":"2024-09-10T05:55:33.611612+0000","last_fullsized":"2024-09-10T05:55:33.611612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:39.644138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646765+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:55:33.646765+0000","last_peered":"2024-09-10T05:55:33.646765+0000","last_clean":"2024-09-10T05:55:33.646765+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:55:33.646765+0000","last_undegraded":"2024-09-10T05:55:33.646765+0000","last_fullsized":"2024-09-10T05:55:33.646765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.251765+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:55:34.251765+0000","last_peered":"2024-09-10T05:55:34.251765+0000","last_clean":"2024-09-10T05:55:34.251765+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:55:34.251765+0000","last_undegraded":"2024-09-10T05:55:34.251765+0000","last_fullsized":"2024-09-10T05:55:34.251765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610964+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:55:33.610964+0000","last_peered":"2024-09-10T05:55:33.610964+0000","last_clean":"2024-09-10T05:55:33.610964+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:55:33.610964+0000","last_undegraded":"2024-09-10T05:55:33.610964+0000","last_fullsized":"2024-09-10T05:55:33.610964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.648023+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:55:33.648023+0000","last_peered":"2024-09-10T05:55:33.648023+0000","last_clean":"2024-09-10T05:55:33.648023+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:55:33.648023+0000","last_undegraded":"2024-09-10T05:55:33.648023+0000","last_fullsized":"2024-09-10T05:55:33.648023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633234+0000","last_change":"2024-09-10T05:55:24.565289+0000","last_active":"2024-09-10T05:55:33.633234+0000","last_peered":"2024-09-10T05:55:33.633234+0000","last_clean":"2024-09-10T05:55:33.633234+0000","last_became_active":"2024-09-10T05:55:24.564280+0000","last_became_peered":"2024-09-10T05:55:24.564280+0000","last_unstale":"2024-09-10T05:55:33.633234+0000","last_undegraded":"2024-09-10T05:55:33.633234+0000","last_fullsized":"2024-09-10T05:55:33.633234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:13.779901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654009+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:55:33.654009+0000","last_peered":"2024-09-10T05:55:33.654009+0000","last_clean":"2024-09-10T05:55:33.654009+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:55:33.654009+0000","last_undegraded":"2024-09-10T05:55:33.654009+0000","last_fullsized":"2024-09-10T05:55:33.654009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655134+0000","last_change":"2024-09-10T05:55:26.565035+0000","last_active":"2024-09-10T05:55:33.655134+0000","last_peered":"2024-09-10T05:55:33.655134+0000","last_clean":"2024-09-10T05:55:33.655134+0000","last_became_active":"2024-09-10T05:55:26.564334+0000","last_became_peered":"2024-09-10T05:55:26.564334+0000","last_unstale":"2024-09-10T05:55:33.655134+0000","last_undegraded":"2024-09-10T05:55:33.655134+0000","last_fullsized":"2024-09-10T05:55:33.655134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:56.748091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"36'17","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.432513+0000","last_change":"2024-09-10T05:55:28.614053+0000","last_active":"2024-09-10T05:55:34.432513+0000","last_peered":"2024-09-10T05:55:34.432513+0000","last_clean":"2024-09-10T05:55:34.432513+0000","last_became_active":"2024-09-10T05:55:28.613481+0000","last_became_peered":"2024-09-10T05:55:28.613481+0000","last_unstale":"2024-09-10T05:55:34.432513+0000","last_undegraded":"2024-09-10T05:55:34.432513+0000","last_fullsized":"2024-09-10T05:55:34.432513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:19.110667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610832+0000","last_change":"2024-09-10T05:55:30.622398+0000","last_active":"2024-09-10T05:55:33.610832+0000","last_peered":"2024-09-10T05:55:33.610832+0000","last_clean":"2024-09-10T05:55:33.610832+0000","last_became_active":"2024-09-10T05:55:30.621878+0000","last_became_peered":"2024-09-10T05:55:30.621878+0000","last_unstale":"2024-09-10T05:55:33.610832+0000","last_undegraded":"2024-09-10T05:55:33.610832+0000","last_fullsized":"2024-09-10T05:55:33.610832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:40.030654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607525+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:55:33.607525+0000","last_peered":"2024-09-10T05:55:33.607525+0000","last_clean":"2024-09-10T05:55:33.607525+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:55:33.607525+0000","last_undegraded":"2024-09-10T05:55:33.607525+0000","last_fullsized":"2024-09-10T05:55:33.607525+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671702+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:55:33.671702+0000","last_peered":"2024-09-10T05:55:33.671702+0000","last_clean":"2024-09-10T05:55:33.671702+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:55:33.671702+0000","last_undegraded":"2024-09-10T05:55:33.671702+0000","last_fullsized":"2024-09-10T05:55:33.671702+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623366+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:55:33.623366+0000","last_peered":"2024-09-10T05:55:33.623366+0000","last_clean":"2024-09-10T05:55:33.623366+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:55:33.623366+0000","last_undegraded":"2024-09-10T05:55:33.623366+0000","last_fullsized":"2024-09-10T05:55:33.623366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611477+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:55:33.611477+0000","last_peered":"2024-09-10T05:55:33.611477+0000","last_clean":"2024-09-10T05:55:33.611477+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:55:33.611477+0000","last_undegraded":"2024-09-10T05:55:33.611477+0000","last_fullsized":"2024-09-10T05:55:33.611477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.409055+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:55:34.409055+0000","last_peered":"2024-09-10T05:55:34.409055+0000","last_clean":"2024-09-10T05:55:34.409055+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:55:34.409055+0000","last_undegraded":"2024-09-10T05:55:34.409055+0000","last_fullsized":"2024-09-10T05:55:34.409055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646446+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:55:33.646446+0000","last_peered":"2024-09-10T05:55:33.646446+0000","last_clean":"2024-09-10T05:55:33.646446+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:55:33.646446+0000","last_undegraded":"2024-09-10T05:55:33.646446+0000","last_fullsized":"2024-09-10T05:55:33.646446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.635981+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:55:33.635981+0000","last_peered":"2024-09-10T05:55:33.635981+0000","last_clean":"2024-09-10T05:55:33.635981+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:55:33.635981+0000","last_undegraded":"2024-09-10T05:55:33.635981+0000","last_fullsized":"2024-09-10T05:55:33.635981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653905+0000","last_change":"2024-09-10T05:55:24.554255+0000","last_active":"2024-09-10T05:55:33.653905+0000","last_peered":"2024-09-10T05:55:33.653905+0000","last_clean":"2024-09-10T05:55:33.653905+0000","last_became_active":"2024-09-10T05:55:24.544039+0000","last_became_peered":"2024-09-10T05:55:24.544039+0000","last_unstale":"2024-09-10T05:55:33.653905+0000","last_undegraded":"2024-09-10T05:55:33.653905+0000","last_fullsized":"2024-09-10T05:55:33.653905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608580+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:55:33.608580+0000","last_peered":"2024-09-10T05:55:33.608580+0000","last_clean":"2024-09-10T05:55:33.608580+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:55:33.608580+0000","last_undegraded":"2024-09-10T05:55:33.608580+0000","last_fullsized":"2024-09-10T05:55:33.608580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636561+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:55:33.636561+0000","last_peered":"2024-09-10T05:55:33.636561+0000","last_clean":"2024-09-10T05:55:33.636561+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:55:33.636561+0000","last_undegraded":"2024-09-10T05:55:33.636561+0000","last_fullsized":"2024-09-10T05:55:33.636561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"36'39","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.441147+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:55:34.441147+0000","last_peered":"2024-09-10T05:55:34.441147+0000","last_clean":"2024-09-10T05:55:34.441147+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:55:34.441147+0000","last_undegraded":"2024-09-10T05:55:34.441147+0000","last_fullsized":"2024-09-10T05:55:34.441147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.621976+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:55:33.621976+0000","last_peered":"2024-09-10T05:55:33.621976+0000","last_clean":"2024-09-10T05:55:33.621976+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:55:33.621976+0000","last_undegraded":"2024-09-10T05:55:33.621976+0000","last_fullsized":"2024-09-10T05:55:33.621976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639001+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:55:33.639001+0000","last_peered":"2024-09-10T05:55:33.639001+0000","last_clean":"2024-09-10T05:55:33.639001+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:55:33.639001+0000","last_undegraded":"2024-09-10T05:55:33.639001+0000","last_fullsized":"2024-09-10T05:55:33.639001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653777+0000","last_change":"2024-09-10T05:55:24.554992+0000","last_active":"2024-09-10T05:55:33.653777+0000","last_peered":"2024-09-10T05:55:33.653777+0000","last_clean":"2024-09-10T05:55:33.653777+0000","last_became_active":"2024-09-10T05:55:24.554229+0000","last_became_peered":"2024-09-10T05:55:24.554229+0000","last_unstale":"2024-09-10T05:55:33.653777+0000","last_undegraded":"2024-09-10T05:55:33.653777+0000","last_fullsized":"2024-09-10T05:55:33.653777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609258+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:55:33.609258+0000","last_peered":"2024-09-10T05:55:33.609258+0000","last_clean":"2024-09-10T05:55:33.609258+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:55:33.609258+0000","last_undegraded":"2024-09-10T05:55:33.609258+0000","last_fullsized":"2024-09-10T05:55:33.609258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.607427+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:55:33.607427+0000","last_peered":"2024-09-10T05:55:33.607427+0000","last_clean":"2024-09-10T05:55:33.607427+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:55:33.607427+0000","last_undegraded":"2024-09-10T05:55:33.607427+0000","last_fullsized":"2024-09-10T05:55:33.607427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"36'15","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.012202+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:55:34.012202+0000","last_peered":"2024-09-10T05:55:34.012202+0000","last_clean":"2024-09-10T05:55:34.012202+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:55:34.012202+0000","last_undegraded":"2024-09-10T05:55:34.012202+0000","last_fullsized":"2024-09-10T05:55:34.012202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645950+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:55:33.645950+0000","last_peered":"2024-09-10T05:55:33.645950+0000","last_clean":"2024-09-10T05:55:33.645950+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:55:33.645950+0000","last_undegraded":"2024-09-10T05:55:33.645950+0000","last_fullsized":"2024-09-10T05:55:33.645950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633681+0000","last_change":"2024-09-10T05:55:32.866310+0000","last_active":"2024-09-10T05:55:33.633681+0000","last_peered":"2024-09-10T05:55:33.633681+0000","last_clean":"2024-09-10T05:55:33.633681+0000","last_became_active":"2024-09-10T05:55:32.865414+0000","last_became_peered":"2024-09-10T05:55:32.865414+0000","last_unstale":"2024-09-10T05:55:33.633681+0000","last_undegraded":"2024-09-10T05:55:33.633681+0000","last_fullsized":"2024-09-10T05:55:33.633681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:50.899927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632068+0000","last_change":"2024-09-10T05:55:24.554383+0000","last_active":"2024-09-10T05:55:33.632068+0000","last_peered":"2024-09-10T05:55:33.632068+0000","last_clean":"2024-09-10T05:55:33.632068+0000","last_became_active":"2024-09-10T05:55:24.553962+0000","last_became_peered":"2024-09-10T05:55:24.553962+0000","last_unstale":"2024-09-10T05:55:33.632068+0000","last_undegraded":"2024-09-10T05:55:33.632068+0000","last_fullsized":"2024-09-10T05:55:33.632068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:55.226474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634150+0000","last_change":"2024-09-10T05:55:22.554679+0000","last_active":"2024-09-10T05:55:33.634150+0000","last_peered":"2024-09-10T05:55:33.634150+0000","last_clean":"2024-09-10T05:55:33.634150+0000","last_became_active":"2024-09-10T05:55:22.554111+0000","last_became_peered":"2024-09-10T05:55:22.554111+0000","last_unstale":"2024-09-10T05:55:33.634150+0000","last_undegraded":"2024-09-10T05:55:33.634150+0000","last_fullsized":"2024-09-10T05:55:33.634150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652601+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:55:33.652601+0000","last_peered":"2024-09-10T05:55:33.652601+0000","last_clean":"2024-09-10T05:55:33.652601+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:55:33.652601+0000","last_undegraded":"2024-09-10T05:55:33.652601+0000","last_fullsized":"2024-09-10T05:55:33.652601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"36'11","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.110153+0000","last_change":"2024-09-10T05:55:28.590320+0000","last_active":"2024-09-10T05:55:34.110153+0000","last_peered":"2024-09-10T05:55:34.110153+0000","last_clean":"2024-09-10T05:55:34.110153+0000","last_became_active":"2024-09-10T05:55:28.589157+0000","last_became_peered":"2024-09-10T05:55:28.589157+0000","last_unstale":"2024-09-10T05:55:34.110153+0000","last_undegraded":"2024-09-10T05:55:34.110153+0000","last_fullsized":"2024-09-10T05:55:34.110153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652988+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:55:33.652988+0000","last_peered":"2024-09-10T05:55:33.652988+0000","last_clean":"2024-09-10T05:55:33.652988+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:55:33.652988+0000","last_undegraded":"2024-09-10T05:55:33.652988+0000","last_fullsized":"2024-09-10T05:55:33.652988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.638722+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:55:33.638722+0000","last_peered":"2024-09-10T05:55:33.638722+0000","last_clean":"2024-09-10T05:55:33.638722+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:55:33.638722+0000","last_undegraded":"2024-09-10T05:55:33.638722+0000","last_fullsized":"2024-09-10T05:55:33.638722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.652986+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:55:33.652986+0000","last_peered":"2024-09-10T05:55:33.652986+0000","last_clean":"2024-09-10T05:55:33.652986+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:55:33.652986+0000","last_undegraded":"2024-09-10T05:55:33.652986+0000","last_fullsized":"2024-09-10T05:55:33.652986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625785+0000","last_change":"2024-09-10T05:55:22.561800+0000","last_active":"2024-09-10T05:55:33.625785+0000","last_peered":"2024-09-10T05:55:33.625785+0000","last_clean":"2024-09-10T05:55:33.625785+0000","last_became_active":"2024-09-10T05:55:22.561316+0000","last_became_peered":"2024-09-10T05:55:22.561316+0000","last_unstale":"2024-09-10T05:55:33.625785+0000","last_undegraded":"2024-09-10T05:55:33.625785+0000","last_fullsized":"2024-09-10T05:55:33.625785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:45.339840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609559+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:55:33.609559+0000","last_peered":"2024-09-10T05:55:33.609559+0000","last_clean":"2024-09-10T05:55:33.609559+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:55:33.609559+0000","last_undegraded":"2024-09-10T05:55:33.609559+0000","last_fullsized":"2024-09-10T05:55:33.609559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'21","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:34.158441+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:55:34.158441+0000","last_peered":"2024-09-10T05:55:34.158441+0000","last_clean":"2024-09-10T05:55:34.158441+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:55:34.158441+0000","last_undegraded":"2024-09-10T05:55:34.158441+0000","last_fullsized":"2024-09-10T05:55:34.158441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622588+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:55:33.622588+0000","last_peered":"2024-09-10T05:55:33.622588+0000","last_clean":"2024-09-10T05:55:33.622588+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:55:33.622588+0000","last_undegraded":"2024-09-10T05:55:33.622588+0000","last_fullsized":"2024-09-10T05:55:33.622588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655530+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:55:33.655530+0000","last_peered":"2024-09-10T05:55:33.655530+0000","last_clean":"2024-09-10T05:55:33.655530+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:55:33.655530+0000","last_undegraded":"2024-09-10T05:55:33.655530+0000","last_fullsized":"2024-09-10T05:55:33.655530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611101+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:55:33.611101+0000","last_peered":"2024-09-10T05:55:33.611101+0000","last_clean":"2024-09-10T05:55:33.611101+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:55:33.611101+0000","last_undegraded":"2024-09-10T05:55:33.611101+0000","last_fullsized":"2024-09-10T05:55:33.611101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645404+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:55:33.645404+0000","last_peered":"2024-09-10T05:55:33.645404+0000","last_clean":"2024-09-10T05:55:33.645404+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:55:33.645404+0000","last_undegraded":"2024-09-10T05:55:33.645404+0000","last_fullsized":"2024-09-10T05:55:33.645404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611317+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:55:33.611317+0000","last_peered":"2024-09-10T05:55:33.611317+0000","last_clean":"2024-09-10T05:55:33.611317+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:55:33.611317+0000","last_undegraded":"2024-09-10T05:55:33.611317+0000","last_fullsized":"2024-09-10T05:55:33.611317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.670490+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:55:33.670490+0000","last_peered":"2024-09-10T05:55:33.670490+0000","last_clean":"2024-09-10T05:55:33.670490+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:55:33.670490+0000","last_undegraded":"2024-09-10T05:55:33.670490+0000","last_fullsized":"2024-09-10T05:55:33.670490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608514+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:55:33.608514+0000","last_peered":"2024-09-10T05:55:33.608514+0000","last_clean":"2024-09-10T05:55:33.608514+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:55:33.608514+0000","last_undegraded":"2024-09-10T05:55:33.608514+0000","last_fullsized":"2024-09-10T05:55:33.608514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608682+0000","last_change":"2024-09-10T05:55:22.565311+0000","last_active":"2024-09-10T05:55:33.608682+0000","last_peered":"2024-09-10T05:55:33.608682+0000","last_clean":"2024-09-10T05:55:33.608682+0000","last_became_active":"2024-09-10T05:55:22.553973+0000","last_became_peered":"2024-09-10T05:55:22.553973+0000","last_unstale":"2024-09-10T05:55:33.608682+0000","last_undegraded":"2024-09-10T05:55:33.608682+0000","last_fullsized":"2024-09-10T05:55:33.608682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:46.316825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.611282+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:55:33.611282+0000","last_peered":"2024-09-10T05:55:33.611282+0000","last_clean":"2024-09-10T05:55:33.611282+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:55:33.611282+0000","last_undegraded":"2024-09-10T05:55:33.611282+0000","last_fullsized":"2024-09-10T05:55:33.611282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623385+0000","last_change":"2024-09-10T05:55:22.553110+0000","last_active":"2024-09-10T05:55:33.623385+0000","last_peered":"2024-09-10T05:55:33.623385+0000","last_clean":"2024-09-10T05:55:33.623385+0000","last_became_active":"2024-09-10T05:55:22.552040+0000","last_became_peered":"2024-09-10T05:55:22.552040+0000","last_unstale":"2024-09-10T05:55:33.623385+0000","last_undegraded":"2024-09-10T05:55:33.623385+0000","last_fullsized":"2024-09-10T05:55:33.623385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:15.164842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.633096+0000","last_change":"2024-09-10T05:55:24.575761+0000","last_active":"2024-09-10T05:55:33.633096+0000","last_peered":"2024-09-10T05:55:33.633096+0000","last_clean":"2024-09-10T05:55:33.633096+0000","last_became_active":"2024-09-10T05:55:24.575067+0000","last_became_peered":"2024-09-10T05:55:24.575067+0000","last_unstale":"2024-09-10T05:55:33.633096+0000","last_undegraded":"2024-09-10T05:55:33.633096+0000","last_fullsized":"2024-09-10T05:55:33.633096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:27.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634152+0000","last_change":"2024-09-10T05:55:22.574898+0000","last_active":"2024-09-10T05:55:33.634152+0000","last_peered":"2024-09-10T05:55:33.634152+0000","last_clean":"2024-09-10T05:55:33.634152+0000","last_became_active":"2024-09-10T05:55:22.574453+0000","last_became_peered":"2024-09-10T05:55:22.574453+0000","last_unstale":"2024-09-10T05:55:33.634152+0000","last_undegraded":"2024-09-10T05:55:33.634152+0000","last_fullsized":"2024-09-10T05:55:33.634152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:43.643978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.653898+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:55:33.653898+0000","last_peered":"2024-09-10T05:55:33.653898+0000","last_clean":"2024-09-10T05:55:33.653898+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:55:33.653898+0000","last_undegraded":"2024-09-10T05:55:33.653898+0000","last_fullsized":"2024-09-10T05:55:33.653898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.612129+0000","last_change":"2024-09-10T05:55:22.544739+0000","last_active":"2024-09-10T05:55:33.612129+0000","last_peered":"2024-09-10T05:55:33.612129+0000","last_clean":"2024-09-10T05:55:33.612129+0000","last_became_active":"2024-09-10T05:55:22.544168+0000","last_became_peered":"2024-09-10T05:55:22.544168+0000","last_unstale":"2024-09-10T05:55:33.612129+0000","last_undegraded":"2024-09-10T05:55:33.612129+0000","last_fullsized":"2024-09-10T05:55:33.612129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631668+0000","last_change":"2024-09-10T05:55:24.567071+0000","last_active":"2024-09-10T05:55:33.631668+0000","last_peered":"2024-09-10T05:55:33.631668+0000","last_clean":"2024-09-10T05:55:33.631668+0000","last_became_active":"2024-09-10T05:55:24.566590+0000","last_became_peered":"2024-09-10T05:55:24.566590+0000","last_unstale":"2024-09-10T05:55:33.631668+0000","last_undegraded":"2024-09-10T05:55:33.631668+0000","last_fullsized":"2024-09-10T05:55:33.631668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:10.465413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.647203+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:55:33.647203+0000","last_peered":"2024-09-10T05:55:33.647203+0000","last_clean":"2024-09-10T05:55:33.647203+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:55:33.647203+0000","last_undegraded":"2024-09-10T05:55:33.647203+0000","last_fullsized":"2024-09-10T05:55:33.647203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.645395+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:55:33.645395+0000","last_peered":"2024-09-10T05:55:33.645395+0000","last_clean":"2024-09-10T05:55:33.645395+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:55:33.645395+0000","last_undegraded":"2024-09-10T05:55:33.645395+0000","last_fullsized":"2024-09-10T05:55:33.645395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.634547+0000","last_change":"2024-09-10T05:55:22.573693+0000","last_active":"2024-09-10T05:55:33.634547+0000","last_peered":"2024-09-10T05:55:33.634547+0000","last_clean":"2024-09-10T05:55:33.634547+0000","last_became_active":"2024-09-10T05:55:22.573178+0000","last_became_peered":"2024-09-10T05:55:22.573178+0000","last_unstale":"2024-09-10T05:55:33.634547+0000","last_undegraded":"2024-09-10T05:55:33.634547+0000","last_fullsized":"2024-09-10T05:55:33.634547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:02:28.190362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625753+0000","last_change":"2024-09-10T05:55:24.561487+0000","last_active":"2024-09-10T05:55:33.625753+0000","last_peered":"2024-09-10T05:55:33.625753+0000","last_clean":"2024-09-10T05:55:33.625753+0000","last_became_active":"2024-09-10T05:55:24.560721+0000","last_became_peered":"2024-09-10T05:55:24.560721+0000","last_unstale":"2024-09-10T05:55:33.625753+0000","last_undegraded":"2024-09-10T05:55:33.625753+0000","last_fullsized":"2024-09-10T05:55:33.625753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609104+0000","last_change":"2024-09-10T05:55:22.561959+0000","last_active":"2024-09-10T05:55:33.609104+0000","last_peered":"2024-09-10T05:55:33.609104+0000","last_clean":"2024-09-10T05:55:33.609104+0000","last_became_active":"2024-09-10T05:55:22.561060+0000","last_became_peered":"2024-09-10T05:55:22.561060+0000","last_unstale":"2024-09-10T05:55:33.609104+0000","last_undegraded":"2024-09-10T05:55:33.609104+0000","last_fullsized":"2024-09-10T05:55:33.609104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.655341+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:55:33.655341+0000","last_peered":"2024-09-10T05:55:33.655341+0000","last_clean":"2024-09-10T05:55:33.655341+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:55:33.655341+0000","last_undegraded":"2024-09-10T05:55:33.655341+0000","last_fullsized":"2024-09-10T05:55:33.655341+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.632201+0000","last_change":"2024-09-10T05:55:22.573494+0000","last_active":"2024-09-10T05:55:33.632201+0000","last_peered":"2024-09-10T05:55:33.632201+0000","last_clean":"2024-09-10T05:55:33.632201+0000","last_became_active":"2024-09-10T05:55:22.572978+0000","last_became_peered":"2024-09-10T05:55:22.572978+0000","last_unstale":"2024-09-10T05:55:33.632201+0000","last_undegraded":"2024-09-10T05:55:33.632201+0000","last_fullsized":"2024-09-10T05:55:33.632201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:54.896384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.671647+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:55:33.671647+0000","last_peered":"2024-09-10T05:55:33.671647+0000","last_clean":"2024-09-10T05:55:33.671647+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:55:33.671647+0000","last_undegraded":"2024-09-10T05:55:33.671647+0000","last_fullsized":"2024-09-10T05:55:33.671647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608178+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:55:33.608178+0000","last_peered":"2024-09-10T05:55:33.608178+0000","last_clean":"2024-09-10T05:55:33.608178+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:55:33.608178+0000","last_undegraded":"2024-09-10T05:55:33.608178+0000","last_fullsized":"2024-09-10T05:55:33.608178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.654837+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:55:33.654837+0000","last_peered":"2024-09-10T05:55:33.654837+0000","last_clean":"2024-09-10T05:55:33.654837+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:55:33.654837+0000","last_undegraded":"2024-09-10T05:55:33.654837+0000","last_fullsized":"2024-09-10T05:55:33.654837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.623639+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:55:33.623639+0000","last_peered":"2024-09-10T05:55:33.623639+0000","last_clean":"2024-09-10T05:55:33.623639+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:55:33.623639+0000","last_undegraded":"2024-09-10T05:55:33.623639+0000","last_fullsized":"2024-09-10T05:55:33.623639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.637300+0000","last_change":"2024-09-10T05:55:24.580883+0000","last_active":"2024-09-10T05:55:33.637300+0000","last_peered":"2024-09-10T05:55:33.637300+0000","last_clean":"2024-09-10T05:55:33.637300+0000","last_became_active":"2024-09-10T05:55:24.580203+0000","last_became_peered":"2024-09-10T05:55:24.580203+0000","last_unstale":"2024-09-10T05:55:33.637300+0000","last_undegraded":"2024-09-10T05:55:33.637300+0000","last_fullsized":"2024-09-10T05:55:33.637300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:12.571010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.646749+0000","last_change":"2024-09-10T05:55:22.565433+0000","last_active":"2024-09-10T05:55:33.646749+0000","last_peered":"2024-09-10T05:55:33.646749+0000","last_clean":"2024-09-10T05:55:33.646749+0000","last_became_active":"2024-09-10T05:55:22.564640+0000","last_became_peered":"2024-09-10T05:55:22.564640+0000","last_unstale":"2024-09-10T05:55:33.646749+0000","last_undegraded":"2024-09-10T05:55:33.646749+0000","last_fullsized":"2024-09-10T05:55:33.646749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:43.825302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.622600+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:55:33.622600+0000","last_peered":"2024-09-10T05:55:33.622600+0000","last_clean":"2024-09-10T05:55:33.622600+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:55:33.622600+0000","last_undegraded":"2024-09-10T05:55:33.622600+0000","last_fullsized":"2024-09-10T05:55:33.622600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.639302+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:55:33.639302+0000","last_peered":"2024-09-10T05:55:33.639302+0000","last_clean":"2024-09-10T05:55:33.639302+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:55:33.639302+0000","last_undegraded":"2024-09-10T05:55:33.639302+0000","last_fullsized":"2024-09-10T05:55:33.639302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.631669+0000","last_change":"2024-09-10T05:55:24.558453+0000","last_active":"2024-09-10T05:55:33.631669+0000","last_peered":"2024-09-10T05:55:33.631669+0000","last_clean":"2024-09-10T05:55:33.631669+0000","last_became_active":"2024-09-10T05:55:24.558058+0000","last_became_peered":"2024-09-10T05:55:24.558058+0000","last_unstale":"2024-09-10T05:55:33.631669+0000","last_undegraded":"2024-09-10T05:55:33.631669+0000","last_fullsized":"2024-09-10T05:55:33.631669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:12.571010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.672255+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:55:33.672255+0000","last_peered":"2024-09-10T05:55:33.672255+0000","last_clean":"2024-09-10T05:55:33.672255+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:55:33.672255+0000","last_undegraded":"2024-09-10T05:55:33.672255+0000","last_fullsized":"2024-09-10T05:55:33.672255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.636145+0000","last_change":"2024-09-10T05:55:24.574106+0000","last_active":"2024-09-10T05:55:33.636145+0000","last_peered":"2024-09-10T05:55:33.636145+0000","last_clean":"2024-09-10T05:55:33.636145+0000","last_became_active":"2024-09-10T05:55:24.572550+0000","last_became_peered":"2024-09-10T05:55:24.572550+0000","last_unstale":"2024-09-10T05:55:33.636145+0000","last_undegraded":"2024-09-10T05:55:33.636145+0000","last_fullsized":"2024-09-10T05:55:33.636145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:01.134005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.609805+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:55:33.609805+0000","last_peered":"2024-09-10T05:55:33.609805+0000","last_clean":"2024-09-10T05:55:33.609805+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:55:33.609805+0000","last_undegraded":"2024-09-10T05:55:33.609805+0000","last_fullsized":"2024-09-10T05:55:33.609805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608888+0000","last_change":"2024-09-10T05:55:22.567056+0000","last_active":"2024-09-10T05:55:33.608888+0000","last_peered":"2024-09-10T05:55:33.608888+0000","last_clean":"2024-09-10T05:55:33.608888+0000","last_became_active":"2024-09-10T05:55:22.563015+0000","last_became_peered":"2024-09-10T05:55:22.563015+0000","last_unstale":"2024-09-10T05:55:33.608888+0000","last_undegraded":"2024-09-10T05:55:33.608888+0000","last_fullsized":"2024-09-10T05:55:33.608888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:09.009494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.625528+0000","last_change":"2024-09-10T05:55:24.561146+0000","last_active":"2024-09-10T05:55:33.625528+0000","last_peered":"2024-09-10T05:55:33.625528+0000","last_clean":"2024-09-10T05:55:33.625528+0000","last_became_active":"2024-09-10T05:55:24.560716+0000","last_became_peered":"2024-09-10T05:55:24.560716+0000","last_unstale":"2024-09-10T05:55:33.625528+0000","last_undegraded":"2024-09-10T05:55:33.625528+0000","last_fullsized":"2024-09-10T05:55:33.625528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:22.681220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.610164+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:55:33.610164+0000","last_peered":"2024-09-10T05:55:33.610164+0000","last_clean":"2024-09-10T05:55:33.610164+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:55:33.610164+0000","last_undegraded":"2024-09-10T05:55:33.610164+0000","last_fullsized":"2024-09-10T05:55:33.610164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-10T05:55:33.608358+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:55:33.608358+0000","last_peered":"2024-09-10T05:55:33.608358+0000","last_clean":"2024-09-10T05:55:33.608358+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:55:33.608358+0000","last_undegraded":"2024-09-10T05:55:33.608358+0000","last_fullsized":"2024-09-10T05:55:33.608358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1040384,"data_stored":767489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":176897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":177308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":176952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":442368,"data_stored":177850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":409600,"data_stored":176023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":176730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":767331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:55:41.116 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T05:55:41.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-10T05:55:41.448 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 36 2024-09-10T05:55:41.448 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 64591990-2498-4479-bfa8-9a8cb8fcb29f 2024-09-10T05:55:41.448 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-10T05:54:52.845539+0000 2024-09-10T05:55:41.448 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-10T05:55:33.601322+0000 2024-09-10T05:55:41.448 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 5 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client jewel 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 23 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-10T05:55:41.449 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 34 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 36 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 8 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/3378450542,v1:172.21.15.70:6801/3378450542] [v2:172.21.15.70:6802/3378450542,v1:172.21.15.70:6803/3378450542] exists,up 7de4b4d6-bddb-415b-ac33-62eda22b0fc5 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6808/841653474,v1:172.21.15.70:6809/841653474] [v2:172.21.15.70:6810/841653474,v1:172.21.15.70:6811/841653474] exists,up e1d81852-e81f-4738-bc5c-acf3a2a5b5de 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6816/2429334233,v1:172.21.15.70:6817/2429334233] [v2:172.21.15.70:6818/2429334233,v1:172.21.15.70:6819/2429334233] exists,up 405e0867-aba2-42fe-bdf6-4be0de0860d7 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6824/128774917,v1:172.21.15.70:6825/128774917] [v2:172.21.15.70:6826/128774917,v1:172.21.15.70:6827/128774917] exists,up d57b60c0-744b-4d58-bb15-b3cffc9083bd 2024-09-10T05:55:41.450 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/2565298170,v1:172.21.15.98:6801/2565298170] [v2:172.21.15.98:6802/2565298170,v1:172.21.15.98:6803/2565298170] exists,up b6988baa-4417-4899-9adf-7832c70b4eb4 2024-09-10T05:55:41.451 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/1681543764,v1:172.21.15.98:6825/1681543764] [v2:172.21.15.98:6826/1681543764,v1:172.21.15.98:6827/1681543764] exists,up f215d032-5868-49d0-8238-19a0c9476b4e 2024-09-10T05:55:41.451 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/2743355861,v1:172.21.15.98:6817/2743355861] [v2:172.21.15.98:6818/2743355861,v1:172.21.15.98:6819/2743355861] exists,up 878c5865-fed4-48f5-8b7c-c4ca199a2737 2024-09-10T05:55:41.451 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/134608104,v1:172.21.15.98:6809/134608104] [v2:172.21.15.98:6810/134608104,v1:172.21.15.98:6811/134608104] exists,up b98908e9-8169-41e3-8239-ea1d729d36af 2024-09-10T05:55:41.465 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/3378450542,v1:172.21.15.70:6801/3378450542] [v2:172.21.15.70:6802/3378450542,v1:172.21.15.70:6803/3378450542] exists,up 7de4b4d6-bddb-415b-ac33-62eda22b0fc5', 'osd.1 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6808/841653474,v1:172.21.15.70:6809/841653474] [v2:172.21.15.70:6810/841653474,v1:172.21.15.70:6811/841653474] exists,up e1d81852-e81f-4738-bc5c-acf3a2a5b5de', 'osd.2 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6816/2429334233,v1:172.21.15.70:6817/2429334233] [v2:172.21.15.70:6818/2429334233,v1:172.21.15.70:6819/2429334233] exists,up 405e0867-aba2-42fe-bdf6-4be0de0860d7', 'osd.3 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6824/128774917,v1:172.21.15.70:6825/128774917] [v2:172.21.15.70:6826/128774917,v1:172.21.15.70:6827/128774917] exists,up d57b60c0-744b-4d58-bb15-b3cffc9083bd', 'osd.4 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/2565298170,v1:172.21.15.98:6801/2565298170] [v2:172.21.15.98:6802/2565298170,v1:172.21.15.98:6803/2565298170] exists,up b6988baa-4417-4899-9adf-7832c70b4eb4', 'osd.5 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/1681543764,v1:172.21.15.98:6825/1681543764] [v2:172.21.15.98:6826/1681543764,v1:172.21.15.98:6827/1681543764] exists,up f215d032-5868-49d0-8238-19a0c9476b4e', 'osd.6 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/2743355861,v1:172.21.15.98:6817/2743355861] [v2:172.21.15.98:6818/2743355861,v1:172.21.15.98:6819/2743355861] exists,up 878c5865-fed4-48f5-8b7c-c4ca199a2737', 'osd.7 up in weight 1 up_from 15 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/134608104,v1:172.21.15.98:6809/134608104] [v2:172.21.15.98:6810/134608104,v1:172.21.15.98:6811/134608104] exists,up b98908e9-8169-41e3-8239-ea1d729d36af'] 2024-09-10T05:55:41.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-10T05:55:41.576 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:41.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mon.a", 2024-09-10T05:55:41.576 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster": "ceph", 2024-09-10T05:55:41.576 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-10T05:55:41.576 INFO:teuthology.orchestra.run.smithi070.stdout: "admin_socket_mode": "", 2024-09-10T05:55:41.576 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_client_required": "cephx, none", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_cluster_required": "cephx", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_debug": "true", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_required": "cephx", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "auth_supported": "cephx", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio": "true", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_poll_ms": "250", 2024-09-10T05:55:41.577 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_aio_reap_max": "16", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_async_discard_threads": "0", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_block_size": "4096", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio": "false", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_debug_inflight_ios": "false", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_enable_discard": "false", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry": "3", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash": "0", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring": "false", 2024-09-10T05:55:41.578 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_hipri": "false", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bdev_type": "", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_alloc_size": "1048576", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_allocator": "hybrid", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_buffered_io": "true", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_for_zeros": "false", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-10T05:55:41.579 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_compact_log_sync": "false", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_log_runway": "4194304", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_max_prefetch": "1048576", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_flush_size": "524288", 2024-09-10T05:55:41.580 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_min_log_runway": "1048576", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery": "false", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_sync_write": "false", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocation_from_file": "true", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_allocator": "hybrid", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_async_db_compaction": "true", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-10T05:55:41.581 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi": "true", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_create": "true", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_create": "false", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_path": "", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_db_size": "0", 2024-09-10T05:55:41.582 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_path": "", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_preallocate_file": "false", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_size": "107374182400", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_create": "false", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_path": "", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_block_wal_size": "100663296", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs": "true", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T05:55:41.583 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune": "true", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size": "0", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-10T05:55:41.584 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_type": "2q", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_clone_cow": "true", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-10T05:55:41.585 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_mode": "none", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_csum_type": "crc32c", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_freelist": "false", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-10T05:55:41.586 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_small_allocations": "0", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_read": "true", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_default_buffered_write": "false", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-10T05:55:41.587 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fail_eio": "false", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount": "false", 2024-09-10T05:55:41.588 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount": "false", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_ignore_data_csum": "false", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-10T05:55:41.589 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_log_op_age": "5.000000", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_alloc_size": "0", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size": "0", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_max_deferred_txc": "32", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size": "0", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_nid_prealloc": "1024", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-10T05:55:41.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_retry_disk_reads": "3", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cf": "true", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-10T05:55:41.591 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_spdk_mem": "512", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_tracing": "false", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-10T05:55:41.592 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_write_v2": "false", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_write_v2_random": "false", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_zero_block_detection": "false", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-10T05:55:41.593 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_signatures": "false", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_cluster_require_version": "2", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_signatures": "false", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_require_version": "2", 2024-09-10T05:55:41.594 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_signatures": "false", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_service_require_version": "2", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "cephx_sign_messages": "true", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "chdir": "", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_acl_type": "", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_asio_thread_count": "2", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_mid": "0.750000", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_cache_size": "16384", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_caps_release_delay": "5", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_check_pool_perm": "true", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_force_sync_read": "false", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_getattr_caps": "false", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_features": "", 2024-09-10T05:55:41.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_debug_inject_tick_delay": "0", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_die_on_failed_remount": "false", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_dirsize_rbytes": "true", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_force_lazyio": "false", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_fs": "", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_inject_release_failure": "false", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_inline_size": "4096", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mds_namespace": "", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_metadata": "", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_gid": "-1", 2024-09-10T05:55:41.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_timeout": "300", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mount_uid": "-1", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_mountpoint": "/", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_notify_timeout": "10", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc": "true", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty": "104857600", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_max_objects": "1000", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_size": "209715200", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_oc_target_dirty": "8388608", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_permissions": "true", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota": "true", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_quota_df": "true", 2024-09-10T05:55:41.597 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_bytes": "0", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_max_periods": "4", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_readahead_min": "131072", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_reconnect_stale": "false", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_shutdown_timeout": "30", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_snapdir": ".snap", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_tick_interval": "1", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_trace": "", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_try_dentry_invalidate": "false", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_faked_inos": "false", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_use_random_mds": "false", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog": "false", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_graylog_port": "12201", 2024-09-10T05:55:41.598 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_monitors": "default=true", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog": "false", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "clog_to_syslog_level": "info", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "-", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network": "", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_network_interface": "", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_isal": "false", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_level": "5", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zlib_winsize": "-15", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "compressor_zstd_level": "1", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-10T05:55:41.599 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_op_num_threads": "6", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_osd_stat_interval": "0", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_cpu_cores": "", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crimson_seastar_num_threads": "0", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location": "", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook": "", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_location_hook_timeout": "10", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "daemonize": "false", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "daos_pool": "tank", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-10T05:55:41.600 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_alienstore": "0/5", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_allow_any_pool_priority": "false", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok": "1/5", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asok_assert_abort": "false", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_asserts_on_shutdown": "true", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_auth": "20/20", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bdev": "1/3", 2024-09-10T05:55:41.601 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluefs": "1/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_bluestore": "1/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_buffer": "0/1", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ceph_dedup": "0/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ceph_exporter": "1/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephfs_mirror": "0/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cephsqlite": "0/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_client": "0/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_compressor": "1/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_context": "0/1", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crimson_interrupt": "0/5", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crush": "1/1", 2024-09-10T05:55:41.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_crypto": "1/5", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_cyanstore": "0/5", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_deliberately_leak_memory": "false", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_disable_randomized_ping": "false", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_dpdk": "1/5", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_eventtrace": "1/5", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filer": "0/1", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_filestore": "1/3", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_finisher": "1/1", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_fuse": "1/5", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeat_testing_span": "0", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_heartbeatmap": "1/5", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-10T05:55:41.603 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_javaclient": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journal": "1/3", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_journaler": "0/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_kstore": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_lockdep": "0/1", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mclock": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_balancer": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_locker": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_log_expire": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_migrator": "1/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mds_quiesce": "3/5", 2024-09-10T05:55:41.604 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_memstore": "1/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgr": "2/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mgrc": "1/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_mon": "20/20", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_monc": "0/10", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_ms": "1/1", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_none": "0/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objclass": "0/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objectcacher": "0/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_objecter": "0/1", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_optracker": "0/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_osd": "1/5", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_paxos": "20/20", 2024-09-10T05:55:41.605 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_perfcounter": "1/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_prioritycache": "1/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rados": "0/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd": "0/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_mirror": "0/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_pwl": "0/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rbd_replay": "0/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_refs": "0/0", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_reserver": "1/1", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw": "1/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_access": "1/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_datacache": "1/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_dbstore": "1/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_flight": "1/5", 2024-09-10T05:55:41.606 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_notification": "1/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rgw_sync": "1/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_rocksdb": "4/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore": "0/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_backref": "0/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cache": "0/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_cleaner": "0/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_device": "0/5", 2024-09-10T05:55:41.607 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_epm": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_journal": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_lba": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_odata": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_omap": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_onode": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_t": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_seastore_tm": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_striper": "0/1", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_test": "0/5", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_throttle": "1/1", 2024-09-10T05:55:41.608 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_timer": "0/1", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_tp": "0/5", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "debug_trace": "1/5", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "device_failure_prediction_mode": "none", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_graylog": "false", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_journald": "false", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_stderr": "true", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "err_to_syslog": "false", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event_tracing": "false", 2024-09-10T05:55:41.609 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_addr": "0.0.0.0", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_cert_file": "", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_http_port": "9926", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_key_file": "", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_prio_limit": "5", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_sort_metrics": "true", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "exporter_stats_period": "5", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "fake_statfs_for_testing": "0", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "fatal_signal_handlers": "true", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_purge_ops": "10", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "filer_max_truncate_ops": "128", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_apply_finisher_threads": "1", 2024-09-10T05:55:41.610 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_blackhole": "false", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_clone_range": "true", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_btrfs_snap": "true", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_caller_concurrency": "10", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_collect_device_partition_information": "true", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_commit_timeout": "600.000000", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_inject_read_err": "false", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_omap_check": "false", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_debug_verify_split": "false", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_dump_file": "", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fadvise": "true", 2024-09-10T05:55:41.611 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fail_eio": "true", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_shards": "16", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fd_cache_size": "128", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap": "false", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fiemap_threshold": "4096", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_inject_stall": "0", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_parallel": "false", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_trailing": "false", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_journal_writeahead": "false", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_kill_at": "0", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-10T05:55:41.612 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs": "0", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size": "0", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-10T05:55:41.613 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_merge_threshold": "-10", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_odsync_write": "false", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend": "rocksdb", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_backend_path": "", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_thread_timeout": "60", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_op_threads": "2", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_punch_hole": "false", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-10T05:55:41.614 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_queue_max_ops": "50", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_seek_data_hole": "false", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc": "false", 2024-09-10T05:55:41.615 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_splice": "false", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_multiple": "2", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_split_rand_factor": "20", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_update_to": "1000", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_enable": "true", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-10T05:55:41.616 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-10T05:55:41.617 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-10T05:55:41.617 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-10T05:55:41.617 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-10T05:55:41.617 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-10T05:55:41.617 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_xfs_extsize": "false", 2024-09-10T05:55:41.617 INFO:teuthology.orchestra.run.smithi070.stdout: "filestore_zfs_snap": "false", 2024-09-10T05:55:41.617 INFO:teuthology.orchestra.run.smithi070.stdout: "fio_dir": "/tmp/fio", 2024-09-10T05:55:41.620 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "64591990-2498-4479-bfa8-9a8cb8fcb29f", 2024-09-10T05:55:41.620 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_allow_other": "true", 2024-09-10T05:55:41.620 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_atomic_o_trunc": "true", 2024-09-10T05:55:41.620 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_big_writes": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_debug": "false", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_default_permissions": "false", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_disable_pagecache": "false", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_max_write": "0", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_multithreaded": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_require_active_mds": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_set_user_groups": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_move": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_read": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_splice_write": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "fuse_use_invalidate_cb": "true", 2024-09-10T05:55:41.621 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "gss_target_name": "ceph", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_file": "", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_inject_failure": "0", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_interval": "5", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "host": "smithi070", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-10T05:55:41.622 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "inject_early_sigterm": "false", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_agent_port": "6799", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "jaeger_tracing_enable": "false", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_aio": "true", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_align_min_size": "65536", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_align": "true", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_block_size": "4096", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_dio": "true", 2024-09-10T05:55:41.623 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_discard": "false", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_force_aio": "false", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_ignore_corruption": "false", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_bytes": "10485760", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_max_write_entries": "100", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_replay_from": "0", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_write_header_frequency": "0", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journal_zero_on_create": "false", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prefetch_periods": "10", 2024-09-10T05:55:41.624 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_prezero_periods": "5", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "journaler_write_head_interval": "15", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "key": "", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "keyfile": "", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_backend": "rocksdb", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_default_stripe_size": "65536", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount": "false", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_bytes": "67108864", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_max_ops": "512", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_nid_prealloc": "1024", 2024-09-10T05:55:41.625 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_onode_map_size": "1024", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_submit_transaction": "false", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "kstore_sync_transaction": "false", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "librados_thread_count": "2", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep": "false", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "lockdep_force_backtrace": "false", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_coarse_timestamps": "true", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_flush_on_exit": "false", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_host": "127.0.0.1", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_graylog_port": "12201", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_new": "1000", 2024-09-10T05:55:41.626 INFO:teuthology.orchestra.run.smithi070.stdout: "log_max_recent": "10000", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stderr_prefix": "", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_stop_at_utilization": "0.970000", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": "true", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_graylog": "false", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_journald": "false", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_stderr": "false", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_syslog": "false", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "max_rotating_auth_attempts": "10", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_action_on_write_error": "1", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_alternate_name_max": "8192", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_asio_thread_count": "2", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_export_pin": "true", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_dirs": "true", 2024-09-10T05:55:41.627 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_interval": "5", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_interval": "10", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max": "-1", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_max_until": "-1", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_merge_size": "50", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_midchunk": "0.300000", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_min_start": "0.200000", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_minchunk": "0.001000", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_mode": "0", 2024-09-10T05:55:41.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_max": "1.200000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_need_min": "0.800000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_overload_epochs": "2", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_bits": "3", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_size": "10000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_target_decay": "10.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_grace": "15.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_interval": "4.000000", 2024-09-10T05:55:41.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_mid": "0.700000", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_delay": "0", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_release_free_interval": "10", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_reservation": "0.050000", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_interval": "1", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache_trim_threshold": "262144", 2024-09-10T05:55:41.630 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_prealloc_inos": "1000", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_connect_bootstrapping": "false", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_damage_table_max_entries": "10000", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_auth_pins": "false", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_frag": "false", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_scatterstat": "false", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_debug_subtrees": "false", 2024-09-10T05:55:41.631 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_decay_halflife": "5.000000", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_default_dir_hash": "2", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_defer_session_stale": "true", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_deny_all_reconnect": "false", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_keys_per_op": "16384", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_commit_size": "10", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_max_entries": "0", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dir_prefetch": "true", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-10T05:55:41.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_on_map": "false", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_early_reply": "true", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enable_op_tracker": "true", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_enforce_unique_name": "true", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random": "true", 2024-09-10T05:55:41.633 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-10T05:55:41.634 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-10T05:55:41.634 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-10T05:55:41.634 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_health_summarize_threshold": "10", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_health_dummy": "false", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_migrator_session_race": "false", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-10T05:55:41.635 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_join_fs": "", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_journal_format": "1", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_create_at": "0", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_dirfrag_at": "0", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_export_at": "0", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_import_at": "0", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_at": "0", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_expire_at": "0", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_journal_replay_at": "0", 2024-09-10T05:55:41.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_link_at": "0", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_mdstable_at": "0", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_openc_at": "0", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_rename_at": "0", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_kill_shutdown_at": "0", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_event_large_threshold": "524288", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_events_per_segment": "1024", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_events": "-1", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_max_segments": "128", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_pause": "false", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_segment_size": "0", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-10T05:55:41.637 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_threshold": "128", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log_warn_factor": "2.000000", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_caps_per_client": "1048576", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_flushes": "100000", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_completed_requests": "100000", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_export_size": "20971520", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_file_recover": "32", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_files": "64", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops": "8192", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-10T05:55:41.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_max_snaps_per_dir": "100", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_metrics_update_interval": "2", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_per_client": "100", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_min_caps_working_set": "10000", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_numa_node": "-1", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_complaint_time": "30.000000", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_duration": "600", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_size": "20", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_size": "20", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-10T05:55:41.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_op_log_threshold": "5", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_grace": "15", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_ping_interval": "5", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_caps": "30000", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_recall_warning_threshold": "262144", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_interval": "1.000000", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-10T05:55:41.640 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_gid": "0", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_root_ino_uid": "0", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-10T05:55:41.641 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_shutdown_check": "0", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_skip_ino": "0", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_max_uid": "4294967294", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_min_uid": "0", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_snap_rstat": "false", 2024-09-10T05:55:41.642 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_standby_replay_damaged": "false", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_symlink_recovery": "true", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_exports": "0", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_thrash_fragments": "0", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_tick_interval": "5.000000", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_valgrind_exit": "false", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_backtrace": "1", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_verify_scatter": "false", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_wipe_sessions": "false", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool_debug": "false", 2024-09-10T05:55:41.643 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_device_bytes": "1073741824", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_set": "false", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "memstore_page_size": "65536", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_bytes": "134217728", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_messages": "512", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_disabled_modules": "", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_enable_op_tracker": "true", 2024-09-10T05:55:41.644 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_max_pg_creating": "1024", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_max_pg_num_change": "128", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_bytes": "134217728", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mds_messages": "128", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_bytes": "134217728", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_mon_messages": "128", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_duration": "600", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_size": "20", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-10T05:55:41.645 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_op_log_threshold": "5", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_bytes": "536870912", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_osd_messages": "8192", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_pool": "true", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_standby_modules": "true", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_period": "5", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_stats_threshold": "5", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_tick_period": "2", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_delete": "true", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_allow_pool_size_one": "true", 2024-09-10T05:55:41.646 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_auth_validate_all_caps": "true", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_bytes": "104857600", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_directed_command_retry": "2", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_hunt_parallel": "3", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_log_interval": "1.000000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_interval": "10.000000", 2024-09-10T05:55:41.647 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_client_target_rank": "-1", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_level": "debug", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_file": "true", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_journald": "false", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-10T05:55:41.648 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_bootstrap": "false", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_start": "false", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_compact_on_trim": "true", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_cpu_threads": "4", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_crush_min_required_version": "hammer", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_daemon_bytes": "419430400", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_crit": "5", 2024-09-10T05:55:41.649 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_avail_warn": "5", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_data_size_warn": "16106127360", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_json": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_dump_transactions": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_extra_checks": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_reef": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_no_require_squid": "false", 2024-09-10T05:55:41.650 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_mkfs_grace": "120", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_down_uptime_grace": "60", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_default_strategy": "1", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_election_timeout": "5.000000", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_divisor": "2", 2024-09-10T05:55:41.651 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_enable_op_tracker": "true", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fake_pool_delete": "false", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_force_quorum_join": "false", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_globalid_prealloc": "10000", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_detail_to_clog": "false", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_log_update_period": "5", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_max_detail": "50", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog": "true", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_interval": "600", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-10T05:55:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host": "172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790],172.21.15.98", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_host_override": "", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_initial_members": "", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease": "5.000000", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_full_interval": "50", 2024-09-10T05:55:41.653 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max": "10000", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_log_max_summary": "50", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_log_epochs": "500", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_osd": "10000", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pg_per_osd": "10000", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_pool_pg_num": "65536", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_force_trim_to": "0", 2024-09-10T05:55:41.654 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mds_skip_sanity": "false", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_autotune": "true", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_memory_target": "2147483648", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_beacon_grace": "30", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_digest_period": "5", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_inactive_grace": "60", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_min_osdmap_epochs": "500", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_complaint_time": "30", 2024-09-10T05:55:41.655 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_duration": "600", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_size": "20", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_size": "20", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_op_log_threshold": "5", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_in": "false", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size": "500", 2024-09-10T05:55:41.656 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_interval": "600", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_force_trim_to": "0", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-10T05:55:41.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_down_reporters": "2", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_report_timeout": "900", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-10T05:55:41.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_stuck_threshold": "60", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-10T05:55:41.659 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_probe_timeout": "2.000000", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_change": "0.050000", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_max_osds": "4", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_interval": "86400", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_max_keys": "100", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_scrub_timeout": "300", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_session_timeout": "300", 2024-09-10T05:55:41.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_smart_report_timeout": "5", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stat_smooth_intervals": "6", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_min_size": "2", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_pool_size": "4", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_debug": "false", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_provider_kill_at": "0", 2024-09-10T05:55:41.661 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_requester_kill_at": "0", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_sync_timeout": "60.000000", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_target_pg_per_osd": "100", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_tick_interval": "5", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_interval": "300.000000", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_use_min_delay_socket": "false", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_older_version_delay": "604800", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-10T05:55:41.662 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_misplaced": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_older_version": "true", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-10T05:55:41.663 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "monmap": "", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-10T05:55:41.664 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "motr_tracing_enabled": "false", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_op_threads": "3", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_cm": "false", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_device_name": "", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_dscp": "96", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_local_gid": "", 2024-09-10T05:55:41.665 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_port_num": "1", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_sl": "3", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_support_srq": "true", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_rdma_type": "ib", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_async_reap_threshold": "5", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_before_connect": "false", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv4": "true", 2024-09-10T05:55:41.666 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_ipv6": "false", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr1": "true", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_msgr2": "true", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_max": "7568", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_port_min": "6800", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_count": "3", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_bind_retry_delay": "5", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_client": "false", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mds": "false", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mgr": "false", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_mon": "false", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_blackhole_osd": "false", 2024-09-10T05:55:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_client_mode": "crc secure", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_mode": "crc secure", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_cluster_type": "", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_compress_secure": "false", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_idle_timeout": "900", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_connection_ready_timeout": "10", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_data": "true", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_crc_header": "true", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bad_msg": "false", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_bug": "true", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_old_message": "true", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_skipped_message": "false", 2024-09-10T05:55:41.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_coremask": "0xF", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_enable_tso": "true", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hugepages": "", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_lro": "true", 2024-09-10T05:55:41.669 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_memory_channel": "4", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_pmd": "", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_port_id": "0", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_dump_on_send": "false", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_initial_backoff": "0.200000", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_max": "1.000000", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_delay_type": "", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_network_congestion": "0", 2024-09-10T05:55:41.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_inject_socket_failures": "0", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_learn_addr_from_peer": "true", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_accept_failures": "4", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_max_backoff": "15.000000", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_client_mode": "secure crc", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_mon_service_mode": "secure crc", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_min_size": "1024", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compress_mode": "none", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_pq_min_cost": "65536", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_public_type": "", 2024-09-10T05:55:41.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_service_mode": "crc secure", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_listen_backlog": "512", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_nodelay": "true", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_tcp_rcvbuf": "0", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "ms_type": "async+posix", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "no_config_file": "false", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_completion_locks_per_session": "32", 2024-09-10T05:55:41.672 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inflight_ops": "1024", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_tick_interval": "5.000000", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter_timeout": "10.000000", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_blackhole": "false", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "openssl_engine_opts": "", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_delay_time": "5.000000", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_hist_halflife": "1000", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_low_ops": "2", 2024-09-10T05:55:41.673 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_max_ops": "4", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_agent_slop": "0.020000", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_asio_thread_count": "2", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_async_recovery_min_cost": "100", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_max": "512", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backfill_scan_min": "64", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_degraded": "false", 2024-09-10T05:55:41.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_peering": "false", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_backoff_on_unfound": "true", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_beacon_report_interval": "300", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_duration": "30", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_max_block_size": "67108864", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blkin_trace_all": "false", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-10T05:55:41.675 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_for_log_corruption": "false", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_class_update_on_start": "true", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_cap": "256", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_message_size_cap": "524288000", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_op_priority": "63", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_client_watch_timeout": "30", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_command_max_records": "256", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_compact_on_start": "false", 2024-09-10T05:55:41.676 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_on_start": "true", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_crush_update_weight_set": "true", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_feed_pullee": "-1", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-10T05:55:41.677 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_misdirected_ops": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_acting_change": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_no_purge_strays": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_op_order": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_shutdown": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-10T05:55:41.678 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_trim_objects": "false", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_snaps": "false", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_keys": "1024", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_stride": "524288", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-10T05:55:41.679 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_default_notify_timeout": "30", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep": "0.000000", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_discard_disconnected_ops": "true", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ec_partial_reads": "true", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_enable_op_tracker": "true", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-10T05:55:41.680 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_info": "true", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown": "true", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_function_tracing": "false", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_grace": "20", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_interval": "6", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-10T05:55:41.681 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_peers": "10", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_min_size": "2000", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_stale": "600", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_max_size": "100000", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_min_size": "1000", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_journal_size": "5120", 2024-09-10T05:55:41.682 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_kill_backfill_at": "0", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_cache_size": "50", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_dedup": "true", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max": "40", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_map_share_max_epochs": "40", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_name_len": "100", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_attr_size": "0", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_backfills": "1", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_count": "5", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_markdown_period": "600", 2024-09-10T05:55:41.683 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_name_len": "2048", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_namespace_len": "256", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_object_size": "134217728", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_blocked_by": "16", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_log_entries": "10000", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_pgls": "1024", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_cost": "8388608", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_push_objects": "10", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_scrubs": "3", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-10T05:55:41.684 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_trimming_pgs": "2", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_op_reply_len": "64", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_max_write_size": "90", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_profile": "balanced", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-10T05:55:41.685 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_base": "805306368", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_min": "134217728", 2024-09-10T05:55:41.686 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target": "4294967296", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_autotune": "false", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_pg_log_entries": "250", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_min_recovery_priority": "0", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_interval": "5", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-10T05:55:41.687 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_cache_shards": "32", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_num_op_tracker_shard": "32", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_auto_affinity": "true", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_node": "-1", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_numa_prefer_iface": "true", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objecter_finishers": "1", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore": "bluestore", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_fuse": "false", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_objectstore_tracing": "false", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_complaint_time": "30.000000", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_duration": "600", 2024-09-10T05:55:41.688 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_size": "20", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_size": "20", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_log_threshold": "5", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards": "0", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_hdd": "5", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_shards_ssd": "8", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_pq_min_cost": "65536", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-10T05:55:41.689 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_queue_cut_off": "high", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_op_thread_timeout": "15", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_open_classes_on_start": "true", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_os_flags": "0", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_peering_op_priority": "255", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_cost": "1048576", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_delete_priority": "5", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-10T05:55:41.690 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_max": "10000", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_log_trim_min": "100", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crimson": "false", 2024-09-10T05:55:41.691 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_flags": "0", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-10T05:55:41.692 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_min_size": "0", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pg_num": "32", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_pgp_num": "0", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_read_ratio": "70", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_size": "2", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_default_type": "replicated", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_push_per_object_cost": "1000", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap": "true", 2024-09-10T05:55:41.693 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_cost": "20971520", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active": "0", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_max_single_start": "1", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_priority": "3", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-10T05:55:41.694 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_priority": "5", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep": "0.000000", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_repair_during_recovery": "false", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_requested_scrub_priority": "120", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair": "false", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-10T05:55:41.695 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_hour": "0", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_begin_week_day": "0", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_max": "25", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_chunk_min": "5", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_cost": "52428800", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_during_recovery": "false", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_hour": "0", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_end_week_day": "0", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_event_cost": "4096", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-10T05:55:41.696 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_invalid_stats": "true", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_max_preemptions": "5", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_priority": "5", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_scrub_sleep": "0.000000", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_skip_data_digest": "false", 2024-09-10T05:55:41.697 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_smart_report_timeout": "5", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_cost": "1048576", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_priority": "5", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_target_transaction_size": "30", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-10T05:55:41.698 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_tracing": "false", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_use_stale_snap": "false", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T05:55:41.699 INFO:teuthology.orchestra.run.smithi070.stdout: "osdc_blkin_trace_all": "false", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_kill_at": "0", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_max_join_drift": "10", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min": "500", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_min_wait": "0.050000", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_propose_interval": "1.000000", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max": "500", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_service_trim_min": "250", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_stash_full_interval": "25", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_max": "500", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "paxos_trim_min": "250", 2024-09-10T05:55:41.700 INFO:teuthology.orchestra.run.smithi070.stdout: "perf": "true", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "-", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrv": "", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "public_bind_addr": "-", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network": "", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "public_network_interface": "", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_busy_polling": "false", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_enabled": "false", 2024-09-10T05:55:41.701 INFO:teuthology.orchestra.run.smithi070.stdout: "qat_compressor_session_max_number": "256", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_mon_op_timeout": "0", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_osd_op_timeout": "0", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rados_tracing": "false", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_atime_update_interval": "60", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_parent_reads": "false", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_balance_snap_reads": "false", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blkin_trace_all": "false", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache": "true", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-10T05:55:41.702 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_policy": "writearound", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_size": "33554432", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_clone_copy_on_read": "false", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_compression_hint": "none", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_concurrent_management_ops": "10", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_clone_format": "auto", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_data_pool": "", 2024-09-10T05:55:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_features": "61", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_format": "2", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_map_options": "", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_order": "22", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_pool": "rbd", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_count": "0", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_default_stripe_unit": "0", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_enable_alloc_hint": "true", 2024-09-10T05:55:41.704 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler": "simple", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_order": "24", 2024-09-10T05:55:41.705 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_pool": "", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_journal_splay_width": "4", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_parent_reads": "false", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_localize_snap_reads": "false", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-10T05:55:41.706 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-10T05:55:41.707 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_mtime_update_interval": "60", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_non_blocking_aio": "true", 2024-09-10T05:55:41.708 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_thread_timeout": "60", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_op_threads": "1", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_parent_cache_enabled": "false", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_plugins": "", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst": "0", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_bps_limit": "0", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_exclude_ops": "0", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst": "0", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-10T05:55:41.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_iops_limit": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-10T05:55:41.710 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_read_from_replica_policy": "default", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_skip_partial_discard": "true", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_tracing": "false", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_names": "true", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_validate_pool": "true", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_base_url": "", 2024-09-10T05:55:41.711 INFO:teuthology.orchestra.run.smithi070.stdout: "restapi_log_level": "", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_acl_grants_max_num": "100", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_admin_entry": "admin", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_asio_assert_yielding": "false", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_backend_store": "rados", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_barbican_url": "", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_beast_enable_async": "true", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache": "false", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-10T05:55:41.712 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_enabled": "true", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_expiry_interval": "900", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cache_lru_size": "25000", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_config_store": "rados", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_content_length_compat": "false", 2024-09-10T05:55:41.713 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress": "true", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cors_rules_max_num": "100", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_cross_domain_policy": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_addr": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_password": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_kmip_username": "", 2024-09-10T05:55:41.714 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_require_ssl": "true", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-10T05:55:41.715 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_addr": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_auth": "token", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_namespace": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_prefix": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-10T05:55:41.716 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_token_file": "", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_buffersize": "524288", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_low_speed_time": "300", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-10T05:55:41.717 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_changes_size": "1000", 2024-09-10T05:55:41.718 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_num_shards": "128", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_log_window": "30", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-10T05:55:41.719 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_disable_s3select": "false", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-10T05:55:41.720 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_name": "", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dns_s3website_name": "", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dynamic_resharding": "true", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_gc_threads": "true", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_lc_threads": "true", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_mdsearch": "true", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_ops_log": "false", 2024-09-10T05:55:41.721 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_quota_threads": "true", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_static_website": "false", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enable_usage_log": "false", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_enforce_swift_acls": "true", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_exit_timeout_secs": "120", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_expose_bucket": "false", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_extended_http_attrs": "", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_filter": "none", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_frontends": "beast port=7480", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred": "50", 2024-09-10T05:55:41.722 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_objs": "32", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_gc_processor_period": "3600", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_init_timeout": "300", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-10T05:55:41.723 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_connection_idle": "300", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_domain": "", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password": "", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_password_path": "", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_project": "", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_tenant": "", 2024-09-10T05:55:41.724 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_token_path": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_admin_user": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_domain": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_password": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_project": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_barbican_user": "", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-10T05:55:41.725 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_url": "", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_debug_interval": "-1", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_lock_max_time": "90", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_objs": "32", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_rules": "1000", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_worker": "3", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lc_thread_delay": "0", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_dnattr": "uid", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-10T05:55:41.726 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_searchfilter": "", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ldap_uri": "", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_http_headers": "", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_log_object_name_utc": "false", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-10T05:55:41.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_name_len": "0", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attr_size": "0", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_chunk_size": "4194304", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_listing_results": "1000", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_notify_retries": "10", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_param_size": "1048576", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_put_size": "5368709120", 2024-09-10T05:55:41.728 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_max_slo_entries": "1000", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_log_max_shards": "64", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_mp_lock_max_time": "600", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-10T05:55:41.729 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_max_gc": "300", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_async_rados_threads": "32", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_num_control_oids": "8", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_numa_node": "-1", 2024-09-10T05:55:41.730 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_chunk_size": "100", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_gc_interval": "600", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_thread_timeout": "600", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_op_tracing": "false", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_token": "", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_url": "", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_opa_verify_ssl": "true", 2024-09-10T05:55:41.731 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_rados": "false", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_ops_log_socket_path": "", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval": "2.000000", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-10T05:55:41.732 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lanes": "3", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_cache_partitions": "3", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_continue": "true", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-10T05:55:41.733 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rados_tracing": "false", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm": "", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_id": "", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region": "", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_request_uri": "", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_batch_size": "64", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-10T05:55:41.734 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_max_aio": "128", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_num_logs": "16", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshard_thread_interval": "600", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_resolve_cname": "false", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_run_sync_thread": "true", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-10T05:55:41.735 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_scheduler_type": "throttler", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_script_uri": "", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_service_provider_name": "", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_id": "", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_client_secret": "", 2024-09-10T05:55:41.736 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_entry": "sts", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_key": "sts", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_min_session_duration": "900", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sts_token_introspection_url": "", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_account_in_url": "false", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_entry": "auth", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_auth_url": "", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_custom_header": "", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_need_stats": "true", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_tenant_name": "", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_token_expiration": "86400", 2024-09-10T05:55:41.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url": "", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_url_prefix": "swift", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_lease_period": "120", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-10T05:55:41.738 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_thread_pool_size": "512", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_comment": "", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_createby": "", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_encoding": "", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_flag": "false", 2024-09-10T05:55:41.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_origin": "", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_torrent_tracker": "", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_trust_forwarded_https": "false", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_shards": "32", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_usage_max_user_shards": "1", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_use_opa_authz": "false", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache": "false", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-10T05:55:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_max_buckets": "1000", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_policies_max_num": "100", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_user_unique_email": "true", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_verify_ssl": "true", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone": "", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_id": "", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-10T05:55:41.741 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup": "", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_id": "", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_auto_session_clear": "true", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_block_size": "4096", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_size": "536870912", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-10T05:55:41.742 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_index_type": "binary_search", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_partition_filters": "false", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_perf": "false", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-10T05:55:41.743 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "run_dir": "/var/run/ceph", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_block_create": "true", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cache_lru_size": "67108864", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_max_object_size": "16777216", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_device_size": "53687091200", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_full_integrity_check": "false", 2024-09-10T05:55:41.744 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_capacity": "16", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_main_device_type": "SSD", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "seastore_segment_size": "67108864", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "set_keepcaps": "false", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "setgroup": "", 2024-09-10T05:55:41.745 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser": "", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "setuser_match_path": "", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "thp": "false", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_default_timeout": "60", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "throttler_perf_counter": "true", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tmp_dir": "/tmp", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "uadk_compressor_enabled": "false", 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-10T05:55:41.746 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:41.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-10T05:55:41.887 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-10T05:55:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T05:55:41.899 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-10T05:55:41.900 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T05:55:41.908 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-10T05:55:41.908 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T05:55:41.923 DEBUG:teuthology.orchestra.run.smithi098:> type ceph-objectstore-tool 2024-09-10T05:55:41.929 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-10T05:55:41.929 DEBUG:teuthology.orchestra.run.smithi070:> type ceph-objectstore-tool 2024-09-10T05:55:41.933 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-10T05:55:41.933 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T05:55:41.952 INFO:tasks.workunit:Pulling workunits from ref d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T05:55:41.953 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T05:55:41.953 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T05:55:41.953 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-10T05:55:41.953 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T05:55:41.954 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T05:55:41.954 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T05:55:41.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-10T05:55:41.954 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-10T05:55:41.955 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-10T05:55:41.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:55:41.955 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-10T05:55:41.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:55:41.956 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-10T05:55:41.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:55:41.977 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:41.977+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:41.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T05:55:41.982 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-10T05:55:41.982 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T05:55:42.030 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-10T05:55:42.030 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-10T05:55:42.072 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:42.073+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:42.076 INFO:tasks.workunit:timeout=3h 2024-09-10T05:55:42.077 INFO:tasks.workunit:cleanup=True 2024-09-10T05:55:42.077 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T05:55:42.098 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:42.098 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:42.098 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:42.104 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T05:55:42.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:55:42.118 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:42.119 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:42.140 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:42.157 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:42.157+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:42.157 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:42.158 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:42.177 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:42.177 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:42.203 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:42.204 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:42.235 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:42.235 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:42.258 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:42.257+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:42.267 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:42.267 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:42.285 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:42.285 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:42.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:55:42.302 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-10T05:55:42.301+0000 7fa00a078640 -1 mon.a@0(leader).osd e36 definitely_dead 0 2024-09-10T05:55:42.302 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:42.303 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:42.372 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:42.373+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:42.410 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:42.410 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:42.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:55:42.461 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:42.459+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:42.562 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:42.563+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:42.586 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:42.587 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:42.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:55:42.663 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:42.663+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:42.710 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:42.710 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.3. 2024-09-10T05:55:42.719 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:55:42.727 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:55:42.764 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:42.763+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:42.847 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:42.847 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:42.859 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:55:42.908 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:42.909+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:42.965 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:42.965+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:42.974 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:42.974 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:42.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:55:43.066 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:43.067+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:43.152 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:43.152 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:43.165 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:55:43.167 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:43.167+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:43.268 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:43.269+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:43.271 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:43.271 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:43.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:55:43.369 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:43.367+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:43.443 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:43.443 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:43.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:55:43.470 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:43.467+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:43.562 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:43.562 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:43.571 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:43.569+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:43.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:55:43.672 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:43.673+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:43.746 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:43.746 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:43.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:55:43.790 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:43.771+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:43.877 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:43.875+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:43.914 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:43.914 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:43.928 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:55:44.014 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:44.015+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:44.079 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:44.079+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:44.090 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:44.090 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:44.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:55:44.180 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:44.181+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:44.268 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:44.268 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:44.281 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:44.281+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:44.282 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:55:44.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:55:44.381 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:44.379+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:44.403 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:44.403 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:44.417 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:55:44.483 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:44.483 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:44.499 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:44.500 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:44.506 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:44.507+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:44.516 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:44.532 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:44.532 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:44.551 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:44.551 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:44.569 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:44.569 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:44.583 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:44.581+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:44.588 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:44.588 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:44.588 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:55:44.588 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:55:44.588 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:44.591 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:44.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:55:44.610 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:44.610 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:44.685 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:44.685+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:44.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4251.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:55:44.781 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.533916151, 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088920690000000007, 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4251", 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/1145776937", 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243750+0000", 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0137e-05 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243764+0000", 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3343000000000001e-05 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243794+0000", 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0239999999999998e-05 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243817+0000", 2024-09-10T05:55:44.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824e-05 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.246388+0000", 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025713670000000002 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.246410+0000", 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2480000000000002e-05 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249256+0000", 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002845509 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249567+0000", 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031058799999999999 2024-09-10T05:55:44.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249992+0000", 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042563699999999998 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252356+0000", 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002363502 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252407+0000", 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1165999999999998e-05 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252528+0000", 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121363 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252632+0000", 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010391300000000001 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.788 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4251.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.525583922999999, 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010958255, 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4251", 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/1145776937", 2024-09-10T05:55:44.789 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252076+0000", 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252099+0000", 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3153e-05 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252137+0000", 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7666999999999997e-05 2024-09-10T05:55:44.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252155+0000", 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8609000000000001e-05 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252327+0000", 2024-09-10T05:55:44.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171569 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252348+0000", 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1263999999999998e-05 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.259952+0000", 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076040960000000003 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.260114+0000", 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161886 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.260335+0000", 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022080099999999999 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.261869+0000", 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001534058 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.262871+0000", 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001001643 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.262960+0000", 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9666000000000005e-05 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.263031+0000", 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0290000000000006e-05 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.16072071, 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010468468, 2024-09-10T05:55:44.796 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 48 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616939+0000", 2024-09-10T05:55:44.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4599999999999999e-06 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616954+0000", 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4610000000000001e-05 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616989+0000", 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5797000000000003e-05 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617046+0000", 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6433e-05 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617244+0000", 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019829299999999999 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617263+0000", 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9125000000000001e-05 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621042+0000", 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003778965 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621238+0000", 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019574800000000001 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621490+0000", 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025198700000000001 2024-09-10T05:55:44.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.623910+0000", 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024204529999999999 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627203+0000", 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032926129999999998 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627317+0000", 2024-09-10T05:55:44.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114281 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627404+0000", 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6703e-05 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:381 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:55:44.803 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.000001726000001, 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065762249999999998, 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 381 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777656+0000", 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.826e-06 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777668+0000", 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1963999999999999e-05 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777693+0000", 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4640000000000001e-05 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777712+0000", 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9193000000000001e-05 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777906+0000", 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019432799999999999 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.778802+0000", 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00089519199999999995 2024-09-10T05:55:44.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.779325+0000", 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052333600000000001 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.780468+0000", 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001142716 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783996+0000", 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003528411 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784121+0000", 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124843 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784231+0000", 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109776 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.809 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:390 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.996026991000001, 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055076079999999998, 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.810 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 390 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781631+0000", 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.61e-06 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781639+0000", 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2230000000000007e-06 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781664+0000", 2024-09-10T05:55:44.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5092999999999998e-05 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781682+0000", 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7487e-05 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781823+0000", 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014109499999999999 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782162+0000", 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033949099999999998 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782672+0000", 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050964000000000001 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784363+0000", 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016913799999999999 2024-09-10T05:55:44.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786905+0000", 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025418870000000001 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787043+0000", 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013796899999999999 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787137+0000", 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3733000000000005e-05 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:393 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.816 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.995089183999999, 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077284750000000003, 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 393 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782570+0000", 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9500000000000001e-06 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782585+0000", 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4610000000000001e-05 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782659+0000", 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4536000000000006e-05 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782685+0000", 2024-09-10T05:55:44.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6210000000000001e-05 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782834+0000", 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148422 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783053+0000", 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021885200000000001 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783516+0000", 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046384699999999998 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784646+0000", 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001129283 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789993+0000", 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005347437 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790140+0000", 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014694299999999999 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790295+0000", 2024-09-10T05:55:44.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015538499999999999 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:396 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.992305199, 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051714830000000002, 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 396 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785354+0000", 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785366+0000", 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2310000000000001e-05 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785400+0000", 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3696999999999999e-05 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785423+0000", 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3099999999999999e-05 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785532+0000", 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010885199999999999 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785678+0000", 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014572599999999999 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785955+0000", 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000277285 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787555+0000", 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00160023 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790318+0000", 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027628000000000002 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790435+0000", 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117068 2024-09-10T05:55:44.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790522+0000", 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7287999999999995e-05 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:407 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.987291383000001, 2024-09-10T05:55:44.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006264721, 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 407 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790367+0000", 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790377+0000", 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8400000000000007e-06 2024-09-10T05:55:44.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790400+0000", 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3597000000000001e-05 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790421+0000", 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0265999999999999e-05 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790569+0000", 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014849899999999999 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790848+0000", 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000278845 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791347+0000", 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049885700000000001 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792836+0000", 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014886579999999999 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796350+0000", 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035142009999999998 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796503+0000", 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015316200000000001 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796630+0000", 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126556 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.835 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:411 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.790726+0000", 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.986929772, 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048050999999999996, 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 411 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790726+0000", 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790726+0000", 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790729+0000", 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790741+0000", 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790768+0000", 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7047e-05 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790807+0000", 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8726000000000002e-05 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790941+0000", 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013471199999999999 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791137+0000", 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195241 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791520+0000", 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038314099999999998 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793053+0000", 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015332410000000001 2024-09-10T05:55:44.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795302+0000", 2024-09-10T05:55:44.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002248683 2024-09-10T05:55:44.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795448+0000", 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014611600000000001 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795532+0000", 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3622999999999995e-05 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:428 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.981915386000001, 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066193700000000003, 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 428 2024-09-10T05:55:44.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795742+0000", 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5859999999999999e-06 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795751+0000", 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4630000000000001e-06 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795777+0000", 2024-09-10T05:55:44.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795795+0000", 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8604e-05 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795908+0000", 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112161 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796099+0000", 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019159600000000001 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796749+0000", 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065039299999999998 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.798354+0000", 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016048569999999999 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802104+0000", 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037494389999999998 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802245+0000", 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141433 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802360+0000", 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114945 2024-09-10T05:55:44.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:510 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.962270627000001, 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060473189999999998, 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 510 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:55:44.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815388+0000", 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5840000000000002e-06 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815401+0000", 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2768e-05 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815420+0000", 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9585999999999998e-05 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815433+0000", 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2882e-05 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815534+0000", 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100849 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815790+0000", 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025556100000000002 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816121+0000", 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000331016 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.817470+0000", 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013493439999999999 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821255+0000", 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037850499999999999 2024-09-10T05:55:44.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821358+0000", 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102737 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821433+0000", 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4942000000000002e-05 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:516 6.1a e36/30 6:5be42343:lc::lc.11:head v 36'4, mlcod=36'2)", 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.819416+0000", 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.958240687, 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048896690000000001, 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819416+0000", 2024-09-10T05:55:44.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819416+0000", 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819418+0000", 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.04e-06 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819432+0000", 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4795e-05 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819463+0000", 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0304e-05 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819494+0000", 2024-09-10T05:55:44.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1588999999999999e-05 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819640+0000", 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014558600000000001 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819677+0000", 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7076000000000002e-05 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824105+0000", 2024-09-10T05:55:44.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044283220000000002 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824305+0000", 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019995700000000001 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:530 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.860 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.955893094, 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051103920000000001, 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 530 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821764+0000", 2024-09-10T05:55:44.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2780000000000001e-06 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821772+0000", 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6639999999999998e-06 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821806+0000", 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4264000000000003e-05 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821829+0000", 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2691999999999999e-05 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821928+0000", 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8968999999999994e-05 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822167+0000", 2024-09-10T05:55:44.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023884199999999999 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822520+0000", 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035353400000000002 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824363+0000", 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018423619999999999 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826759+0000", 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023964469999999999 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826828+0000", 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9035999999999994e-05 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826873+0000", 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5303999999999999e-05 2024-09-10T05:55:44.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:531 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.822256+0000", 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.955400373, 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047360340000000001, 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.867 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 531 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822256+0000", 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822256+0000", 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822258+0000", 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0040000000000002e-06 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822268+0000", 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0165e-05 2024-09-10T05:55:44.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822288+0000", 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9757000000000001e-05 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822299+0000", 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0951000000000001e-05 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822429+0000", 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013045999999999999 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822623+0000", 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019373900000000001 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823021+0000", 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039819699999999998 2024-09-10T05:55:44.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824087+0000", 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010661170000000001 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826819+0000", 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027318709999999999 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826920+0000", 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101399 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826992+0000", 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1373999999999998e-05 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:547 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.873 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.827552+0000", 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.950104203, 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045487770000000004, 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 547 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827552+0000", 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827552+0000", 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827553+0000", 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3799999999999999e-06 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827560+0000", 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.336e-06 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827572+0000", 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.206e-05 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827579+0000", 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4959999999999999e-06 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828261+0000", 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00068208400000000001 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828362+0000", 2024-09-10T05:55:44.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010084100000000001 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828530+0000", 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016769699999999999 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831541+0000", 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030107839999999999 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831903+0000", 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036238900000000002 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831995+0000", 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2186000000000001e-05 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.832101+0000", 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105524 2024-09-10T05:55:44.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:564 6.4 e36/30 6:2166d8e1:gc::gc.3:head v 36'11, mlcod=36'9)", 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.944109874, 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061892409999999998, 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833547+0000", 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833560+0000", 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2405999999999999e-05 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833576+0000", 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6409000000000002e-05 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833588+0000", 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1419e-05 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833675+0000", 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7739999999999997e-05 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833709+0000", 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3303999999999998e-05 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839674+0000", 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059653070000000004 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839736+0000", 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1686999999999994e-05 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.884 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:566 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.943323058000001, 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054717589999999997, 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 566 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834335+0000", 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7260000000000001e-06 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834351+0000", 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6415000000000001e-05 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834376+0000", 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4615000000000001e-05 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834397+0000", 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1083000000000001e-05 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834495+0000", 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7805000000000003e-05 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834630+0000", 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135594 2024-09-10T05:55:44.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834912+0000", 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028163199999999998 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.835936+0000", 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001024205 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839651+0000", 2024-09-10T05:55:44.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037152940000000001 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839738+0000", 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6007000000000005e-05 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839805+0000", 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7383000000000002e-05 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:828 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.865666267, 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00558758, 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 828 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911991+0000", 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1570000000000001e-06 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911997+0000", 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0349999999999998e-06 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912009+0000", 2024-09-10T05:55:44.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1824999999999999e-05 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912017+0000", 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2879999999999993e-06 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912078+0000", 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0869000000000003e-05 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912145+0000", 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7222000000000001e-05 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912278+0000", 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013305700000000001 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.913176+0000", 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000897213 2024-09-10T05:55:44.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917462+0000", 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042859439999999999 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917526+0000", 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849000000000002e-05 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917578+0000", 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1121000000000001e-05 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:841 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.859283252999999, 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053076190000000004, 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.897 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.898 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 841 2024-09-10T05:55:44.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.900 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918374+0000", 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.64e-07 2024-09-10T05:55:44.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918379+0000", 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8670000000000002e-06 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918390+0000", 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.134e-05 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918395+0000", 2024-09-10T05:55:44.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3360000000000002e-06 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918442+0000", 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6817999999999998e-05 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918501+0000", 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8461999999999997e-05 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918620+0000", 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119731 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.919469+0000", 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084865199999999998 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923609+0000", 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041400059999999999 2024-09-10T05:55:44.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923654+0000", 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4413000000000003e-05 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923681+0000", 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.703e-05 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:843 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.856862143000001, 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056796060000000002, 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 843 2024-09-10T05:55:44.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:44.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920795+0000", 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0809999999999999e-06 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920800+0000", 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7670000000000003e-06 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920815+0000", 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4848000000000001e-05 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920823+0000", 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8089999999999993e-06 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920885+0000", 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2675999999999994e-05 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920951+0000", 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5401999999999995e-05 2024-09-10T05:55:44.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.921085+0000", 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.922066+0000", 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098162100000000001 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:44.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926361+0000", 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042945659999999997 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926424+0000", 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3357999999999999e-05 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926474+0000", 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9360000000000002e-05 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.911 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:44.912 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:44.912 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:44.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:55:44.914 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:44.911+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:45.014 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:45.015+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:45.085 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:45.085 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:55:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:45.098 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:55:45.142 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:45.143+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:45.216 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:45.217+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:45.264 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:45.265 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:45.265 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:55:45.265 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:55:45.265 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:45.278 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:55:45.317 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:45.317+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:45.400 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:45.400 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:45.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:45.400 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:45.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.808951061, 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.401 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:55:45.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:45.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:55:45.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:55:45.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402885765248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.78114706, 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063071129999999996, 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 47 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616730+0000", 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.755e-06 2024-09-10T05:55:45.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616742+0000", 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2228e-05 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616775+0000", 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3362999999999999e-05 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616799+0000", 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3560000000000001e-05 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616928+0000", 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012861700000000001 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617040+0000", 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112855 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617301+0000", 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026039100000000001 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622807+0000", 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055066450000000001 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622837+0000", 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9482999999999999e-05 2024-09-10T05:55:45.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622910+0000", 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2667000000000001e-05 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.623033+0000", 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012354900000000001 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:380 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'3, mlcod=36'1)", 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.620884643, 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004045608, 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:45.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776990+0000", 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9139999999999998e-06 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777004+0000", 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4083000000000001e-05 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777040+0000", 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5577000000000002e-05 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777098+0000", 2024-09-10T05:55:45.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7921999999999999e-05 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777301+0000", 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020330899999999999 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777354+0000", 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.304e-05 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.780921+0000", 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00356639 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781034+0000", 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113373 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.419 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:392 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'4, mlcod=36'2)", 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.615202115000001, 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040178150000000001, 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782673+0000", 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.04e-06 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782685+0000", 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2103000000000001e-05 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782707+0000", 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1500000000000001e-05 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782719+0000", 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.272e-05 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782869+0000", 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150192 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782919+0000", 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9814000000000001e-05 2024-09-10T05:55:45.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786592+0000", 2024-09-10T05:55:45.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036727729999999998 2024-09-10T05:55:45.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786689+0000", 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6673000000000001e-05 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:387 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'6, mlcod=36'3)", 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.615018856000001, 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038518089999999999, 2024-09-10T05:55:45.425 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782856+0000", 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.373e-06 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782867+0000", 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1167e-05 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782884+0000", 2024-09-10T05:55:45.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7646e-05 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782894+0000", 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9669999999999996e-06 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783004+0000", 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109589 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783037+0000", 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2647000000000001e-05 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786621+0000", 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035847230000000002 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786706+0000", 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4697000000000006e-05 2024-09-10T05:55:45.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:395 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'5, mlcod=36'2)", 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.612970325999999, 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052374350000000004, 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784905+0000", 2024-09-10T05:55:45.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0169999999999999e-06 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784920+0000", 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5362999999999998e-05 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784953+0000", 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2712999999999997e-05 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784972+0000", 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199999999999999e-05 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785086+0000", 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113733 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785122+0000", 2024-09-10T05:55:45.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5995999999999999e-05 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790033+0000", 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049114759999999997 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790140+0000", 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106937 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:400 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'7, mlcod=36'5)", 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.608730274999999, 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041295639999999996, 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789145+0000", 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0829999999999998e-06 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789159+0000", 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3797e-05 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789190+0000", 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1052e-05 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789209+0000", 2024-09-10T05:55:45.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9774000000000001e-05 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789342+0000", 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013203299999999999 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789388+0000", 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6791e-05 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793161+0000", 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037730179999999999 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793272+0000", 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111016 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:407 6.a e36/30 6:5395e6f3:lc::lc.4:head v 36'2, mlcod=0'0)", 2024-09-10T05:55:45.439 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.606363427, 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041314409999999996, 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791512+0000", 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.04e-06 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791526+0000", 2024-09-10T05:55:45.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4147e-05 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791554+0000", 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8606e-05 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791568+0000", 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.34e-05 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791714+0000", 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014631299999999999 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791766+0000", 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1638999999999998e-05 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795546+0000", 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037801699999999998 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795641+0000", 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5125999999999997e-05 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:417 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'6, mlcod=36'4)", 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.605647371, 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046622369999999996, 2024-09-10T05:55:45.444 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792228+0000", 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792241+0000", 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3568e-05 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792269+0000", 2024-09-10T05:55:45.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7475e-05 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792289+0000", 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9604999999999999e-05 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792434+0000", 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014589200000000001 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792487+0000", 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2800000000000003e-05 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796741+0000", 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042537310000000002 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796888+0000", 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014694600000000001 2024-09-10T05:55:45.448 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:418 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'2, mlcod=0'0)", 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.60469501, 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036976560000000001, 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793180+0000", 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.153e-06 2024-09-10T05:55:45.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793194+0000", 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.42e-05 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793224+0000", 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793241+0000", 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7333000000000002e-05 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793388+0000", 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000147276 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793448+0000", 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422999999999997e-05 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796756+0000", 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033080890000000002 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796876+0000", 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012006900000000001 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:608 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'9, mlcod=36'7)", 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.549036834000001, 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044587100000000003, 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848838+0000", 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.466e-06 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848847+0000", 2024-09-10T05:55:45.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3819999999999993e-06 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848871+0000", 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.353e-05 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848883+0000", 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2649999999999999e-05 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848969+0000", 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5351000000000003e-05 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848994+0000", 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5028000000000002e-05 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.853202+0000", 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042088079999999996 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.853295+0000", 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2495000000000001e-05 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:606 6.5 e36/30 6:a7f90313:reshard::reshard.0000000012:head v 36'5, mlcod=36'2)", 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.548595670999999, 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048455449999999997, 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.458 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849279+0000", 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7600000000000001e-06 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849290+0000", 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1083999999999999e-05 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849311+0000", 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0831000000000001e-05 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849322+0000", 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0468e-05 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849413+0000", 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1256999999999997e-05 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849440+0000", 2024-09-10T05:55:45.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7311e-05 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.854034+0000", 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045941879999999999 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.854123+0000", 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8646000000000005e-05 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:620 6.15 e36/30 6:abd89f08:lc::lc.23:head v 36'4, mlcod=36'2)", 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.542777281999999, 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040651209999999997, 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855097+0000", 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4780000000000001e-06 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855107+0000", 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0098000000000001e-05 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855130+0000", 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2872000000000001e-05 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855144+0000", 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3906e-05 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855271+0000", 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012645899999999999 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855331+0000", 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0041999999999999e-05 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859088+0000", 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037569729999999998 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859161+0000", 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3293000000000005e-05 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:627 6.3 e36/30 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 36'10, mlcod=36'8)", 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.542221709, 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035147479999999998, 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855653+0000", 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.798e-06 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855682+0000", 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8911000000000002e-05 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855704+0000", 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2348e-05 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855719+0000", 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4192000000000001e-05 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855812+0000", 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3277999999999997e-05 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855843+0000", 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1112999999999998e-05 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859099+0000", 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00325567 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859166+0000", 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7438e-05 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:641 6.3 e36/30 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 36'11, mlcod=36'9)", 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.535464229, 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045882409999999998, 2024-09-10T05:55:45.472 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862410+0000", 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1400000000000001e-06 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862419+0000", 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7190000000000007e-06 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862437+0000", 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8664999999999998e-05 2024-09-10T05:55:45.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862447+0000", 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7629999999999995e-06 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862531+0000", 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3534000000000004e-05 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862565+0000", 2024-09-10T05:55:45.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4734000000000003e-05 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.866923+0000", 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043578519999999997 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.866997+0000", 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3833999999999998e-05 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:643 6.15 e36/30 6:abd89f08:lc::lc.23:head v 36'5, mlcod=36'3)", 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.534909981, 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046454249999999999, 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862964+0000", 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.35e-06 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862972+0000", 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8269999999999998e-06 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862990+0000", 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8085999999999999e-05 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862999+0000", 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7579999999999998e-06 2024-09-10T05:55:45.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.863075+0000", 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5486000000000002e-05 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.863110+0000", 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.867542+0000", 2024-09-10T05:55:45.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044317820000000004 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.867608+0000", 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6270000000000001e-05 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:909 6.c e36/30 6:36abfd60:::obj_delete_at_hint.0000000029:head v 36'6, mlcod=36'4)", 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:45.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.453636048, 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044843310000000003, 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944238+0000", 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1310000000000001e-06 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944246+0000", 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5379999999999997e-06 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944262+0000", 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6449000000000001e-05 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944270+0000", 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6059999999999997e-06 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944336+0000", 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5946999999999997e-05 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944363+0000", 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7775000000000001e-05 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948668+0000", 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004304123 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948721+0000", 2024-09-10T05:55:45.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3761999999999998e-05 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:910 6.1e e36/30 6:7e82ab18:lc::lc.13:head v 36'3, mlcod=36'1)", 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.452710216, 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003611525, 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.486 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945164+0000", 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0100000000000001e-06 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945172+0000", 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9699999999999999e-06 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945189+0000", 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6952999999999998e-05 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945199+0000", 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8479999999999996e-06 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945268+0000", 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880999999999993e-05 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945295+0000", 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7070999999999999e-05 2024-09-10T05:55:45.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948698+0000", 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034032609999999999 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948774+0000", 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6531000000000003e-05 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:927 6.1f e36/30 6:fd8d39b6:::obj_delete_at_hint.0000000030:head v 36'11, mlcod=36'9)", 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.445288514, 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048014889999999999, 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952586+0000", 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.001e-06 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952605+0000", 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952617+0000", 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2058999999999999e-05 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952623+0000", 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1709999999999999e-06 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952675+0000", 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2110000000000001e-05 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952693+0000", 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7761000000000002e-05 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.957349+0000", 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046558809999999997 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.957386+0000", 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7197999999999999e-05 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.495 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1189 6.1f e36/30 6:fce5a501:::obj_delete_at_hint.0000000075:head v 36'14, mlcod=36'12)", 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.255745412, 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041812739999999996, 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142129+0000", 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142141+0000", 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2038999999999999e-05 2024-09-10T05:55:45.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142156+0000", 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4657999999999999e-05 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142162+0000", 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6279999999999999e-06 2024-09-10T05:55:45.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142281+0000", 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119249 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142344+0000", 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3069000000000002e-05 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:45.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.146191+0000", 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038467219999999999 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.146309+0000", 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117716 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:45.500 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:45.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:55:45.502 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:45.499+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:45.603 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:45.601+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:45.674 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:45.674 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:45.674 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:55:45.675 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:45.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:55:45.730 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:55:45.734 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:45.735+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:45.804 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:45.803+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:45.813 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:45.813 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:45.813 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:55:45.813 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:55:45.813 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:45.827 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:55:45.905 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:45.905+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:45.994 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.008051557999998, 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:45.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:55:45.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:45.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:55:46.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.053720102, 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010177393999999999, 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937122+0000", 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.624e-06 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937136+0000", 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.359e-05 2024-09-10T05:55:46.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937157+0000", 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0953000000000001e-05 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937173+0000", 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5897e-05 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.941996+0000", 2024-09-10T05:55:46.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048236349999999997 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942219+0000", 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000222609 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942422+0000", 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020308500000000001 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946080+0000", 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036577379999999998 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947146+0000", 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001066607 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947216+0000", 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9888999999999994e-05 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947298+0000", 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1767000000000005e-05 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.053611883000002, 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011563665000000001, 2024-09-10T05:55:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.009 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 44 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937230+0000", 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937398+0000", 2024-09-10T05:55:46.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937424+0000", 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5239999999999999e-05 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937485+0000", 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1029999999999997e-05 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943654+0000", 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006169384 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943798+0000", 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.944008+0000", 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209562 2024-09-10T05:55:46.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947319+0000", 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033113499999999998 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948656+0000", 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013365849999999999 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948733+0000", 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7082000000000005e-05 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948793+0000", 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9910000000000001e-05 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.053321494000002, 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011644801, 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 45 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.016 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937521+0000", 2024-09-10T05:55:46.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937562+0000", 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1325999999999997e-05 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937586+0000", 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.427e-05 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937602+0000", 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5393999999999999e-05 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945047+0000", 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007445119 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945167+0000", 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120233 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945351+0000", 2024-09-10T05:55:46.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184599 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948941+0000", 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035892739999999999 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948975+0000", 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4459999999999999e-05 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949057+0000", 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1353000000000005e-05 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949164+0000", 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010747999999999999 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.021 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.053211890999997, 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012744626, 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:55:46.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937630+0000", 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937640+0000", 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0317e-05 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937660+0000", 2024-09-10T05:55:46.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0049000000000001e-05 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937674+0000", 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.401e-05 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946184+0000", 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085092269999999994 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946324+0000", 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013997900000000001 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946567+0000", 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024366899999999999 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949295+0000", 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027277130000000001 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950244+0000", 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00094850000000000002 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950311+0000", 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7972999999999994e-05 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950373+0000", 2024-09-10T05:55:46.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1995999999999994e-05 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.053106132000003, 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013893696000000001, 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 47 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937736+0000", 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4759999999999999e-06 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937863+0000", 2024-09-10T05:55:46.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012669299999999999 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937887+0000", 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4125999999999999e-05 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937904+0000", 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947400+0000", 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094954949999999996 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947551+0000", 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150929 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947752+0000", 2024-09-10T05:55:46.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020166199999999999 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950521+0000", 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002768969 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951502+0000", 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000980477 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951571+0000", 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8780000000000002e-05 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951628+0000", 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7599000000000002e-05 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.052906002999997, 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015425703000000001, 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 48 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.035 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937936+0000", 2024-09-10T05:55:46.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6759999999999999e-06 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937947+0000", 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0507e-05 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937967+0000", 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0137e-05 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937982+0000", 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4636e-05 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949376+0000", 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011394235000000001 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949508+0000", 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013255299999999999 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949708+0000", 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019957199999999999 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953070+0000", 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003362182 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953217+0000", 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146329 2024-09-10T05:55:46.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953291+0000", 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4809999999999997e-05 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953360+0000", 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9066000000000006e-05 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.052835993999999, 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017394456999999999, 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.041 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938006+0000", 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.113e-06 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938016+0000", 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7699999999999996e-06 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938034+0000", 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8700000000000001e-05 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938048+0000", 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3886999999999999e-05 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950635+0000", 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012587167999999999 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950750+0000", 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114146 2024-09-10T05:55:46.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950963+0000", 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021314200000000001 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953193+0000", 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022307519999999999 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955262+0000", 2024-09-10T05:55:46.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020683870000000001 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955335+0000", 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2819999999999997e-05 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955399+0000", 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4572000000000005e-05 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.052762590999997, 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017649246, 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938079+0000", 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1799999999999999e-06 2024-09-10T05:55:46.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938200+0000", 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120909 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938222+0000", 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2027000000000001e-05 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938238+0000", 2024-09-10T05:55:46.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951706+0000", 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013468226 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951865+0000", 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015928900000000001 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.952072+0000", 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020730499999999999 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955427+0000", 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033544680000000002 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955561+0000", 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133769 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955664+0000", 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103037 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955727+0000", 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3706000000000003e-05 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.052 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.052576129000002, 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017909134, 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 51 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.053 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938266+0000", 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.33e-06 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938278+0000", 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.254e-05 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938297+0000", 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8870000000000001e-05 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938311+0000", 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3976e-05 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953401+0000", 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015089939 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953553+0000", 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151619 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953766+0000", 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213456 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955443+0000", 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016762859999999999 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955961+0000", 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00051787700000000003 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956053+0000", 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2829000000000002e-05 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956174+0000", 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120412 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.052507022999997, 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.059 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:55:46.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:55:46.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.064 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.814734872999999, 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079199360000000007, 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.065 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 67 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1699999999999998e-07 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176110+0000", 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2660000000000002e-06 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176115+0000", 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0919999999999997e-06 2024-09-10T05:55:46.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176120+0000", 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8099999999999997e-06 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179722+0000", 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036025150000000001 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179836+0000", 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011409299999999999 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.180038+0000", 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000202096 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183798+0000", 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037592139999999999 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183887+0000", 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9087999999999998e-05 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183966+0000", 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9034000000000003e-05 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184026+0000", 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0111000000000001e-05 2024-09-10T05:55:46.070 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.814121577000002, 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098813330000000008, 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.071 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 69 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176720+0000", 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9599999999999999e-07 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176769+0000", 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9638000000000001e-05 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176780+0000", 2024-09-10T05:55:46.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0183000000000001e-05 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176786+0000", 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1020000000000002e-06 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182183+0000", 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053968380000000002 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182329+0000", 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014657900000000001 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182634+0000", 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030473099999999998 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186383+0000", 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037490900000000001 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186466+0000", 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2535999999999997e-05 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186541+0000", 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.572e-05 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186600+0000", 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9219999999999999e-05 2024-09-10T05:55:46.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.814041537999998, 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010079565, 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 70 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176800+0000", 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176806+0000", 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9939999999999997e-06 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176815+0000", 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4579999999999999e-06 2024-09-10T05:55:46.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176824+0000", 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8729999999999996e-06 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184431+0000", 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076067360000000002 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184549+0000", 2024-09-10T05:55:46.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118238 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184729+0000", 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017982299999999999 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186702+0000", 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001972999 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186723+0000", 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.101e-05 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186808+0000", 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4363000000000005e-05 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186879+0000", 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1255999999999997e-05 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.814002475999999, 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013908907999999999, 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.084 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 71 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176839+0000", 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9500000000000001e-07 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176844+0000", 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.147e-06 2024-09-10T05:55:46.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176854+0000", 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6469999999999993e-06 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176860+0000", 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5119999999999997e-06 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185245+0000", 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083848519999999999 2024-09-10T05:55:46.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185389+0000", 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185703+0000", 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000313935 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189360+0000", 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036563530000000002 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190587+0000", 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001227456 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190677+0000", 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0019000000000007e-05 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190747+0000", 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0166000000000005e-05 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.813961116999998, 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015237794000000001, 2024-09-10T05:55:46.090 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 72 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000004e-07 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176999+0000", 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118935 2024-09-10T05:55:46.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177019+0000", 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9337000000000001e-05 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177029+0000", 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0147e-05 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186918+0000", 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098897099999999995 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187037+0000", 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011831400000000001 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187214+0000", 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017770000000000001 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190764+0000", 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035500129999999999 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191969+0000", 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001205036 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192056+0000", 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6929999999999996e-05 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192117+0000", 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1019e-05 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.813791698000003, 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015303199, 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 73 2024-09-10T05:55:46.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177050+0000", 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7000000000000004e-07 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177054+0000", 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5430000000000004e-06 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177061+0000", 2024-09-10T05:55:46.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7170000000000002e-06 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177066+0000", 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6140000000000002e-06 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188130+0000", 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011064153 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188276+0000", 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014621600000000001 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188580+0000", 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030395800000000001 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192139+0000", 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003558627 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192223+0000", 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4056999999999998e-05 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192296+0000", 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3744000000000004e-05 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192352+0000", 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5899999999999997e-05 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.103 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.813767485, 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015532812999999999, 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 74 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177074+0000", 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6100000000000001e-07 2024-09-10T05:55:46.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177078+0000", 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4329999999999997e-06 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177087+0000", 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4400000000000005e-06 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177093+0000", 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1489999999999999e-06 2024-09-10T05:55:46.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189439+0000", 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012346398999999999 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189611+0000", 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017199199999999999 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189927+0000", 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031553499999999998 2024-09-10T05:55:46.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192450+0000", 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002522851 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192470+0000", 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0383000000000001e-05 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192542+0000", 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2000000000000002e-05 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192606+0000", 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4170000000000004e-05 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.813710628000003, 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017090899999999999, 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 75 2024-09-10T05:55:46.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177131+0000", 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4000000000000001e-07 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177233+0000", 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102378 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177244+0000", 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1032999999999999e-05 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177254+0000", 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9299999999999998e-06 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190840+0000", 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013585488999999999 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190983+0000", 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014378899999999999 2024-09-10T05:55:46.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191170+0000", 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018661099999999999 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193379+0000", 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002208574 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194090+0000", 2024-09-10T05:55:46.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071146999999999996 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194168+0000", 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7770999999999998e-05 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194221+0000", 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3115000000000002e-05 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.813570009000003, 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017505636000000002, 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:46.116 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 76 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:46.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4199999999999995e-07 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177278+0000", 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8569999999999997e-06 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:46.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177287+0000", 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0899999999999994e-06 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177294+0000", 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3099999999999997e-06 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192645+0000", 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015351205999999999 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192759+0000", 2024-09-10T05:55:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114194 2024-09-10T05:55:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192937+0000", 2024-09-10T05:55:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178319 2024-09-10T05:55:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:46.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193807+0000", 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000869841 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194636+0000", 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00082883499999999999 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194713+0000", 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7189999999999998e-05 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:46.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194776+0000", 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3052000000000006e-05 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:46.128 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:46.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:55:46.130 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:46.129+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:46.230 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:46.229+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:46.265 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:46.266 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:46.266 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:46.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:55:46.331 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:46.330+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:46.432 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:46.430+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:46.444 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:46.444 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:46.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:55:46.534 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:46.533+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:46.581 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.965473921999999, 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:55:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:55:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.935062304000001, 2024-09-10T05:55:46.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039429599999999997, 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 210 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:46.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646914+0000", 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646928+0000", 2024-09-10T05:55:46.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.47e-05 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646972+0000", 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3619999999999999e-05 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646995+0000", 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3366999999999998e-05 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647130+0000", 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013420500000000001 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647345+0000", 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647767+0000", 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042202 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.649519+0000", 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017519230000000001 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650567+0000", 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001047755 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650728+0000", 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160896 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650852+0000", 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124635 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.854176468, 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032374489999999999, 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727798+0000", 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727810+0000", 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727839+0000", 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9960000000000001e-05 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727857+0000", 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7229999999999999e-05 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727966+0000", 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010930299999999999 2024-09-10T05:55:46.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728184+0000", 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021791399999999999 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728656+0000", 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047184000000000001 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730163+0000", 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015069689999999999 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730830+0000", 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066677499999999998 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730924+0000", 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4518999999999994e-05 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731033+0000", 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108749 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:272 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.822689435000001, 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038580870000000001, 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 272 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759284+0000", 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.389e-06 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759290+0000", 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2299999999999996e-06 2024-09-10T05:55:46.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759306+0000", 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5534999999999999e-05 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759315+0000", 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9749999999999996e-06 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759390+0000", 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5964999999999995e-05 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759509+0000", 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118069 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759725+0000", 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021602899999999999 2024-09-10T05:55:46.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760294+0000", 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056910499999999998 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763042+0000", 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027483960000000002 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763097+0000", 2024-09-10T05:55:46.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4981000000000001e-05 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763140+0000", 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3412999999999999e-05 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:283 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:46.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.821483783, 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003248969, 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 283 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760489+0000", 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.339e-06 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760496+0000", 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760510+0000", 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4630000000000001e-05 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760518+0000", 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429999999999997e-06 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760590+0000", 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2002000000000006e-05 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760739+0000", 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014892 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760956+0000", 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021756100000000001 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.761617+0000", 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066045600000000002 2024-09-10T05:55:46.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763653+0000", 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020359639999999999 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763701+0000", 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8712999999999999e-05 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763737+0000", 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5695000000000003e-05 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:302 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.817336518999999, 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043845380000000003, 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 302 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764636+0000", 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764641+0000", 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764651+0000", 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0223e-05 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764658+0000", 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764919+0000", 2024-09-10T05:55:46.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026097700000000002 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764970+0000", 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1082000000000003e-05 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765083+0000", 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011311000000000001 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765878+0000", 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079446699999999998 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768931+0000", 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030533190000000001 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768974+0000", 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2815000000000003e-05 2024-09-10T05:55:46.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769020+0000", 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6150999999999999e-05 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:305 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.816856624, 2024-09-10T05:55:46.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040725470000000001, 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 305 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:46.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765117+0000", 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.491e-06 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765123+0000", 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765139+0000", 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5896000000000002e-05 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765148+0000", 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6719999999999999e-06 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765357+0000", 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020874700000000001 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765441+0000", 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4016000000000003e-05 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765623+0000", 2024-09-10T05:55:46.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018151500000000001 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766209+0000", 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000586514 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769086+0000", 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028770169999999999 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769145+0000", 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8338000000000003e-05 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3173999999999997e-05 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:330 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.812782638, 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044565830000000001, 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 330 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769191+0000", 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4249999999999999e-06 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769197+0000", 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1190000000000002e-06 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769212+0000", 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5617999999999999e-05 2024-09-10T05:55:46.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769224+0000", 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569999999999999e-05 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769282+0000", 2024-09-10T05:55:46.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7986999999999999e-05 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769414+0000", 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132485 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769627+0000", 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000212845 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770192+0000", 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056470000000000001 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773540+0000", 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033483739999999999 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773603+0000", 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3096999999999996e-05 2024-09-10T05:55:46.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773646+0000", 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2363000000000001e-05 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:334 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.811900947, 2024-09-10T05:55:46.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037038150000000001, 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 334 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770072+0000", 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2810000000000001e-06 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770078+0000", 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2570000000000004e-06 2024-09-10T05:55:46.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770093+0000", 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4127e-05 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770099+0000", 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5780000000000004e-06 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770161+0000", 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770231+0000", 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770344+0000", 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113435 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770852+0000", 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050825999999999996 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773708+0000", 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028555310000000001 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773749+0000", 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0719000000000001e-05 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773775+0000", 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6066000000000001e-05 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:360 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.807031645, 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003515392, 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 360 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774941+0000", 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000005e-07 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774946+0000", 2024-09-10T05:55:46.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7360000000000001e-06 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774957+0000", 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774969+0000", 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775059+0000", 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0119999999999998e-05 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775147+0000", 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-05 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775336+0000", 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018901399999999999 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.776189+0000", 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085303699999999996 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778360+0000", 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002170936 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778413+0000", 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3366999999999999e-05 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778456+0000", 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2395000000000003e-05 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:476 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.645 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.773520709, 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033473259999999999, 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 476 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808452+0000", 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.105e-06 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808458+0000", 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1430000000000003e-06 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808472+0000", 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3759e-05 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808478+0000", 2024-09-10T05:55:46.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3400000000000003e-06 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808555+0000", 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6439000000000005e-05 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808619+0000", 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3649e-05 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808749+0000", 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013027399999999999 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809571+0000", 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082185400000000001 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811686+0000", 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021150959999999999 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811752+0000", 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6085000000000002e-05 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811798+0000", 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6582000000000002e-05 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.651 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:488 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.770051415999999, 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035493080000000002, 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 488 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811923+0000", 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209999999999999e-06 2024-09-10T05:55:46.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811931+0000", 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7849999999999992e-06 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811950+0000", 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8848e-05 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811960+0000", 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0396e-05 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812031+0000", 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0632999999999999e-05 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812181+0000", 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015055900000000001 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812344+0000", 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016297300000000001 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812905+0000", 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056038799999999999 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815344+0000", 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024393520000000001 2024-09-10T05:55:46.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815416+0000", 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1985999999999998e-05 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815470+0000", 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3667e-05 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:610 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.73001638, 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046567709999999997, 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 610 2024-09-10T05:55:46.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851957+0000", 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1850000000000001e-06 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851964+0000", 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9059999999999996e-06 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851980+0000", 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6725e-05 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851987+0000", 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852056+0000", 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9453000000000001e-05 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852111+0000", 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5176999999999997e-05 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852250+0000", 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013836600000000001 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852726+0000", 2024-09-10T05:55:46.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047576900000000002 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856557+0000", 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038316639999999998 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856586+0000", 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9266999999999999e-05 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856612+0000", 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5738999999999999e-05 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:628 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.723810886999999, 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046452960000000001, 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 628 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:46.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858162+0000", 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.083e-06 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858167+0000", 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858180+0000", 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3461e-05 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858187+0000", 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0199999999999997e-06 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858236+0000", 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9005999999999998e-05 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858301+0000", 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4593999999999999e-05 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858421+0000", 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011972399999999999 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858914+0000", 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049326199999999995 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862730+0000", 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038160120000000001 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862768+0000", 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8550999999999997e-05 2024-09-10T05:55:46.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862806+0000", 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725999999999998e-05 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:645 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.716626185999999, 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056225549999999996, 2024-09-10T05:55:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 645 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865347+0000", 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.015e-06 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865352+0000", 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2390000000000002e-06 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865364+0000", 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865371+0000", 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2249999999999997e-06 2024-09-10T05:55:46.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865422+0000", 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0939000000000001e-05 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865510+0000", 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8802999999999997e-05 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865633+0000", 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012270900000000001 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866082+0000", 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044930399999999998 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870875+0000", 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047923890000000002 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870929+0000", 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4314999999999998e-05 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870968+0000", 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9121e-05 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:647 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.715795579, 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049129430000000003, 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 647 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866177+0000", 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866182+0000", 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5079999999999999e-06 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866191+0000", 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6520000000000001e-06 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866197+0000", 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4360000000000001e-06 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866247+0000", 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0047999999999999e-05 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866306+0000", 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8910999999999999e-05 2024-09-10T05:55:46.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866415+0000", 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010889499999999999 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866857+0000", 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044269399999999999 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871019+0000", 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041621200000000001 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871065+0000", 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5439999999999999e-05 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871089+0000", 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4386e-05 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:823 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.670676371000001, 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034604840000000002, 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 823 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911296+0000", 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911300+0000", 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911307+0000", 2024-09-10T05:55:46.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5399999999999998e-06 2024-09-10T05:55:46.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911312+0000", 2024-09-10T05:55:46.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070000000000003e-06 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911344+0000", 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2203000000000003e-05 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911385+0000", 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1544000000000001e-05 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911481+0000", 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5716000000000003e-05 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911947+0000", 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000466327 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914701+0000", 2024-09-10T05:55:46.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002753307 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914732+0000", 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1393000000000003e-05 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914756+0000", 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3842e-05 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:883 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.643886735000001, 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00325596, 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 883 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938086+0000", 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4399999999999999e-07 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938090+0000", 2024-09-10T05:55:46.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0069999999999999e-06 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938099+0000", 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6190000000000006e-06 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938105+0000", 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0989999999999998e-06 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938159+0000", 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4317000000000002e-05 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938233+0000", 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4317e-05 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938395+0000", 2024-09-10T05:55:46.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016220300000000001 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938964+0000", 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056826499999999998 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941280+0000", 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002316196 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941315+0000", 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5193e-05 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941341+0000", 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5999999999999998e-05 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:888 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.642672839999999, 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004820525, 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 888 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:46.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939300+0000", 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.032e-06 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939307+0000", 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.827e-06 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939318+0000", 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1105e-05 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939323+0000", 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939374+0000", 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1232e-05 2024-09-10T05:55:46.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939437+0000", 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2472999999999996e-05 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939576+0000", 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138837 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.940035+0000", 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000459414 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944026+0000", 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003990352 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944074+0000", 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8417000000000001e-05 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944120+0000", 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5516000000000003e-05 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1072 6.16 6:6d4431ed:lc::lc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.559545747, 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048653860000000002, 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:46.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:46.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022427+0000", 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022431+0000", 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4520000000000002e-06 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022439+0000", 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8419999999999994e-06 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022444+0000", 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022495+0000", 2024-09-10T05:55:46.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1314999999999999e-05 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022589+0000", 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3917000000000002e-05 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022781+0000", 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000192158 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:46.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.023273+0000", 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049226000000000001 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027217+0000", 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039431780000000003 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027248+0000", 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1248999999999998e-05 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:46.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027291+0000", 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3677000000000002e-05 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:46.709 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:46.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:55:46.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:55:46.712 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:46.713+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:46.811 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:46.809+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:46.887 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:46.888 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:46.888 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:46.901 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:46.901 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:46.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:55:46.917 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:46.918 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:46.918 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:46.917+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:46.934 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:46.934 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:46.952 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:46.953 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:46.972 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:46.972 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:46.993 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:46.993 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:47.013 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:47.014 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:47.014 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:47.013+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:47.031 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:47.032 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:47.034 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:47.034 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:47.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:55:47.140 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:47.141+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:47.215 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:47.216 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:47.216 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:47.214+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:47.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:55:47.317 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:47.314+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:47.398 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:47.398 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:47.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:55:47.460 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:47.461+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:47.518 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:47.517+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:47.533 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:47.533 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:47.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:55:47.620 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:47.618+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:47.715 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:47.715 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:47.721 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:47.718+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:47.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:55:47.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:55:47.824 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:47.825+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:47.855 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:47.856 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:47.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:55:47.961 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:47.961+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:48.023 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:48.022+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:48.030 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:48.030 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:48.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:55:48.124 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:48.122+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:48.208 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:48.209 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:48.224 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:55:48.225 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:48.225+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:48.326 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:48.326+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:48.355 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:48.356 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:48.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:55:48.427 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:48.425+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:48.528 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:48.526+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:48.538 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:48.538 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:48.552 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:55:48.638 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:48.638+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:48.716 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:48.716 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:48.730 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:48.730+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:48.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:55:48.757 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:55:48.831 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:48.830+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:48.903 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:48.903 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:48.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:55:48.933 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:48.933+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:49.033 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:49.033+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:49.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:55:49.082 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:49.082 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:49.097 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:55:49.146 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:49.146+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:49.209 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:49.210 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:49.222 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:49.226 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:49.226 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:49.234 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:49.233+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:49.236 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:55:49.242 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:49.242 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:49.258 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:49.279 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:49.279 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:49.297 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:49.297 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:49.314 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:49.314 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:49.332 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:49.335 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:49.333+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:49.405 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:55:49.405 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:49.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:55:49.436 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:49.433+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:49.537 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:49.534+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:49.542 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:55:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:55:49.542 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:49.557 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:55:49.646 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:49.646+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:49.722 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.131477189000002, 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:55:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:55:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402885765248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.103673187999998, 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063071129999999996, 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 47 2024-09-10T05:55:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616730+0000", 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.755e-06 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616742+0000", 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2228e-05 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616775+0000", 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3362999999999999e-05 2024-09-10T05:55:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616799+0000", 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3560000000000001e-05 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616928+0000", 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012861700000000001 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617040+0000", 2024-09-10T05:55:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112855 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617301+0000", 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026039100000000001 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622807+0000", 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055066450000000001 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622837+0000", 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9482999999999999e-05 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622910+0000", 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2667000000000001e-05 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.623033+0000", 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012354900000000001 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:380 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'3, mlcod=36'1)", 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.943410771, 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004045608, 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776990+0000", 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9139999999999998e-06 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777004+0000", 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4083000000000001e-05 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777040+0000", 2024-09-10T05:55:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5577000000000002e-05 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777098+0000", 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7921999999999999e-05 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777301+0000", 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020330899999999999 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777354+0000", 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.304e-05 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.780921+0000", 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00356639 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781034+0000", 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113373 2024-09-10T05:55:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:392 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'4, mlcod=36'2)", 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.937728243, 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040178150000000001, 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782673+0000", 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.04e-06 2024-09-10T05:55:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782685+0000", 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2103000000000001e-05 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782707+0000", 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1500000000000001e-05 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782719+0000", 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.272e-05 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782869+0000", 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150192 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782919+0000", 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9814000000000001e-05 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786592+0000", 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036727729999999998 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786689+0000", 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6673000000000001e-05 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:387 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'6, mlcod=36'3)", 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.937544984000001, 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038518089999999999, 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782856+0000", 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.373e-06 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782867+0000", 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1167e-05 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782884+0000", 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7646e-05 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782894+0000", 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9669999999999996e-06 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783004+0000", 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109589 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783037+0000", 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2647000000000001e-05 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786621+0000", 2024-09-10T05:55:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035847230000000002 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786706+0000", 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4697000000000006e-05 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:395 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'5, mlcod=36'2)", 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.935496454000001, 2024-09-10T05:55:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052374350000000004, 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784905+0000", 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0169999999999999e-06 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784920+0000", 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5362999999999998e-05 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784953+0000", 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2712999999999997e-05 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784972+0000", 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199999999999999e-05 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785086+0000", 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113733 2024-09-10T05:55:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785122+0000", 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5995999999999999e-05 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790033+0000", 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049114759999999997 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790140+0000", 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106937 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:400 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'7, mlcod=36'5)", 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.931256403000001, 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041295639999999996, 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789145+0000", 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0829999999999998e-06 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789159+0000", 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3797e-05 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789190+0000", 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1052e-05 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789209+0000", 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9774000000000001e-05 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789342+0000", 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013203299999999999 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789388+0000", 2024-09-10T05:55:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6791e-05 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793161+0000", 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037730179999999999 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793272+0000", 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111016 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:407 6.a e36/30 6:5395e6f3:lc::lc.4:head v 36'2, mlcod=0'0)", 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.928889555, 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041314409999999996, 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791512+0000", 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.04e-06 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791526+0000", 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4147e-05 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791554+0000", 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8606e-05 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791568+0000", 2024-09-10T05:55:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.34e-05 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791714+0000", 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014631299999999999 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791766+0000", 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1638999999999998e-05 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795546+0000", 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037801699999999998 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795641+0000", 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5125999999999997e-05 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:417 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'6, mlcod=36'4)", 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.928173499, 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046622369999999996, 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792228+0000", 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792241+0000", 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3568e-05 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792269+0000", 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7475e-05 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792289+0000", 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9604999999999999e-05 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792434+0000", 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014589200000000001 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792487+0000", 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2800000000000003e-05 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796741+0000", 2024-09-10T05:55:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042537310000000002 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796888+0000", 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014694600000000001 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:418 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'2, mlcod=0'0)", 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.927221138, 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036976560000000001, 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793180+0000", 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.153e-06 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793194+0000", 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.42e-05 2024-09-10T05:55:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793224+0000", 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793241+0000", 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7333000000000002e-05 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793388+0000", 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000147276 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793448+0000", 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422999999999997e-05 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796756+0000", 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033080890000000002 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796876+0000", 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012006900000000001 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:608 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'9, mlcod=36'7)", 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.871562962, 2024-09-10T05:55:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044587100000000003, 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848838+0000", 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.466e-06 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848847+0000", 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3819999999999993e-06 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848871+0000", 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.353e-05 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848883+0000", 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2649999999999999e-05 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848969+0000", 2024-09-10T05:55:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5351000000000003e-05 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848994+0000", 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5028000000000002e-05 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.853202+0000", 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042088079999999996 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.853295+0000", 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2495000000000001e-05 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:606 6.5 e36/30 6:a7f90313:reshard::reshard.0000000012:head v 36'5, mlcod=36'2)", 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.871121799000001, 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048455449999999997, 2024-09-10T05:55:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849279+0000", 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7600000000000001e-06 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849290+0000", 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1083999999999999e-05 2024-09-10T05:55:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849311+0000", 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0831000000000001e-05 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849322+0000", 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0468e-05 2024-09-10T05:55:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849413+0000", 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1256999999999997e-05 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849440+0000", 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7311e-05 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.854034+0000", 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045941879999999999 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.854123+0000", 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8646000000000005e-05 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:620 6.15 e36/30 6:abd89f08:lc::lc.23:head v 36'4, mlcod=36'2)", 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.865303409999999, 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040651209999999997, 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855097+0000", 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4780000000000001e-06 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855107+0000", 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0098000000000001e-05 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855130+0000", 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2872000000000001e-05 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855144+0000", 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3906e-05 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855271+0000", 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012645899999999999 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855331+0000", 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0041999999999999e-05 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859088+0000", 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037569729999999998 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859161+0000", 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3293000000000005e-05 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:627 6.3 e36/30 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 36'10, mlcod=36'8)", 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.864747836999999, 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035147479999999998, 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855653+0000", 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.798e-06 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855682+0000", 2024-09-10T05:55:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8911000000000002e-05 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855704+0000", 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2348e-05 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855719+0000", 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4192000000000001e-05 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855812+0000", 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3277999999999997e-05 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855843+0000", 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1112999999999998e-05 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859099+0000", 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00325567 2024-09-10T05:55:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859166+0000", 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7438e-05 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:641 6.3 e36/30 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 36'11, mlcod=36'9)", 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.857990357, 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045882409999999998, 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862410+0000", 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1400000000000001e-06 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862419+0000", 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7190000000000007e-06 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862437+0000", 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8664999999999998e-05 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862447+0000", 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7629999999999995e-06 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862531+0000", 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3534000000000004e-05 2024-09-10T05:55:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862565+0000", 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4734000000000003e-05 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.866923+0000", 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043578519999999997 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.866997+0000", 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3833999999999998e-05 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:643 6.15 e36/30 6:abd89f08:lc::lc.23:head v 36'5, mlcod=36'3)", 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.857436109, 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046454249999999999, 2024-09-10T05:55:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862964+0000", 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.35e-06 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862972+0000", 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8269999999999998e-06 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862990+0000", 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8085999999999999e-05 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862999+0000", 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7579999999999998e-06 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.863075+0000", 2024-09-10T05:55:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5486000000000002e-05 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.863110+0000", 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.867542+0000", 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044317820000000004 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.867608+0000", 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6270000000000001e-05 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:909 6.c e36/30 6:36abfd60:::obj_delete_at_hint.0000000029:head v 36'6, mlcod=36'4)", 2024-09-10T05:55:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.776162176, 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044843310000000003, 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944238+0000", 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1310000000000001e-06 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944246+0000", 2024-09-10T05:55:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5379999999999997e-06 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944262+0000", 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6449000000000001e-05 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944270+0000", 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6059999999999997e-06 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944336+0000", 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5946999999999997e-05 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944363+0000", 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7775000000000001e-05 2024-09-10T05:55:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948668+0000", 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004304123 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948721+0000", 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3761999999999998e-05 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:910 6.1e e36/30 6:7e82ab18:lc::lc.13:head v 36'3, mlcod=36'1)", 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.775236344, 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003611525, 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945164+0000", 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0100000000000001e-06 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945172+0000", 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9699999999999999e-06 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945189+0000", 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6952999999999998e-05 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945199+0000", 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8479999999999996e-06 2024-09-10T05:55:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945268+0000", 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880999999999993e-05 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945295+0000", 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7070999999999999e-05 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948698+0000", 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034032609999999999 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948774+0000", 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6531000000000003e-05 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:927 6.1f e36/30 6:fd8d39b6:::obj_delete_at_hint.0000000030:head v 36'11, mlcod=36'9)", 2024-09-10T05:55:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.767814641999999, 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048014889999999999, 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952586+0000", 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.001e-06 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952605+0000", 2024-09-10T05:55:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952617+0000", 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2058999999999999e-05 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952623+0000", 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1709999999999999e-06 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952675+0000", 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2110000000000001e-05 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952693+0000", 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7761000000000002e-05 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.957349+0000", 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046558809999999997 2024-09-10T05:55:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.957386+0000", 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7197999999999999e-05 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1189 6.1f e36/30 6:fce5a501:::obj_delete_at_hint.0000000075:head v 36'14, mlcod=36'12)", 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.578271539999999, 2024-09-10T05:55:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041812739999999996, 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142129+0000", 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142141+0000", 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2038999999999999e-05 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142156+0000", 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4657999999999999e-05 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142162+0000", 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6279999999999999e-06 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142281+0000", 2024-09-10T05:55:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119249 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142344+0000", 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3069000000000002e-05 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.146191+0000", 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038467219999999999 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.146309+0000", 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117716 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:49.825 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:49.826 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:55:49.827 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:49.825+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:49.928 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:49.925+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:49.998 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:55:49.999 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:50.013 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:55:50.028 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:50.025+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:50.129 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:50.129+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:50.133 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:50.133 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:50.133 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:55:50.133 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:55:50.133 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:50.147 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:55:50.230 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:50.230+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.287044453999997, 2024-09-10T05:55:50.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:55:50.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:55:50.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.332712997999998, 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010177393999999999, 2024-09-10T05:55:50.279 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937122+0000", 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.624e-06 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937136+0000", 2024-09-10T05:55:50.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.359e-05 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937157+0000", 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0953000000000001e-05 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937173+0000", 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5897e-05 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.941996+0000", 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048236349999999997 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942219+0000", 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000222609 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942422+0000", 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020308500000000001 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946080+0000", 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036577379999999998 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947146+0000", 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001066607 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947216+0000", 2024-09-10T05:55:50.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9888999999999994e-05 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947298+0000", 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1767000000000005e-05 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:50.285 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.332604779, 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011563665000000001, 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 44 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937230+0000", 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937398+0000", 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937424+0000", 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5239999999999999e-05 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937485+0000", 2024-09-10T05:55:50.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1029999999999997e-05 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943654+0000", 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006169384 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943798+0000", 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.944008+0000", 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209562 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947319+0000", 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033113499999999998 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948656+0000", 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013365849999999999 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948733+0000", 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7082000000000005e-05 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948793+0000", 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9910000000000001e-05 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.332314390000001, 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011644801, 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 45 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.292 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937521+0000", 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937562+0000", 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1325999999999997e-05 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937586+0000", 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.427e-05 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937602+0000", 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5393999999999999e-05 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945047+0000", 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007445119 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945167+0000", 2024-09-10T05:55:50.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120233 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945351+0000", 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184599 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948941+0000", 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035892739999999999 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948975+0000", 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4459999999999999e-05 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949057+0000", 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1353000000000005e-05 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949164+0000", 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010747999999999999 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.297 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.332204787000002, 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012744626, 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.298 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937630+0000", 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937640+0000", 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0317e-05 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937660+0000", 2024-09-10T05:55:50.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0049000000000001e-05 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937674+0000", 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.401e-05 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946184+0000", 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085092269999999994 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946324+0000", 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013997900000000001 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946567+0000", 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024366899999999999 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949295+0000", 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027277130000000001 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950244+0000", 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00094850000000000002 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950311+0000", 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7972999999999994e-05 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950373+0000", 2024-09-10T05:55:50.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1995999999999994e-05 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.332099028000002, 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013893696000000001, 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.304 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 47 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937736+0000", 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4759999999999999e-06 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937863+0000", 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012669299999999999 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937887+0000", 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4125999999999999e-05 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937904+0000", 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947400+0000", 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094954949999999996 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947551+0000", 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150929 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947752+0000", 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020166199999999999 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950521+0000", 2024-09-10T05:55:50.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002768969 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951502+0000", 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000980477 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951571+0000", 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8780000000000002e-05 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951628+0000", 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7599000000000002e-05 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.331898899000002, 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015425703000000001, 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 48 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937936+0000", 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6759999999999999e-06 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937947+0000", 2024-09-10T05:55:50.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0507e-05 2024-09-10T05:55:50.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937967+0000", 2024-09-10T05:55:50.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0137e-05 2024-09-10T05:55:50.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937982+0000", 2024-09-10T05:55:50.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4636e-05 2024-09-10T05:55:50.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949376+0000", 2024-09-10T05:55:50.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011394235000000001 2024-09-10T05:55:50.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949508+0000", 2024-09-10T05:55:50.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013255299999999999 2024-09-10T05:55:50.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949708+0000", 2024-09-10T05:55:50.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019957199999999999 2024-09-10T05:55:50.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953070+0000", 2024-09-10T05:55:50.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003362182 2024-09-10T05:55:50.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953217+0000", 2024-09-10T05:55:50.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146329 2024-09-10T05:55:50.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953291+0000", 2024-09-10T05:55:50.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4809999999999997e-05 2024-09-10T05:55:50.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953360+0000", 2024-09-10T05:55:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9066000000000006e-05 2024-09-10T05:55:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.322 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.322 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:50.322 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.331828889999997, 2024-09-10T05:55:50.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017394456999999999, 2024-09-10T05:55:50.322 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.323 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-09-10T05:55:50.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.324 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:50.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938006+0000", 2024-09-10T05:55:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.113e-06 2024-09-10T05:55:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938016+0000", 2024-09-10T05:55:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7699999999999996e-06 2024-09-10T05:55:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938034+0000", 2024-09-10T05:55:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8700000000000001e-05 2024-09-10T05:55:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938048+0000", 2024-09-10T05:55:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3886999999999999e-05 2024-09-10T05:55:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950635+0000", 2024-09-10T05:55:50.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012587167999999999 2024-09-10T05:55:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950750+0000", 2024-09-10T05:55:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114146 2024-09-10T05:55:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950963+0000", 2024-09-10T05:55:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021314200000000001 2024-09-10T05:55:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953193+0000", 2024-09-10T05:55:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022307519999999999 2024-09-10T05:55:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955262+0000", 2024-09-10T05:55:50.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020683870000000001 2024-09-10T05:55:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955335+0000", 2024-09-10T05:55:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2819999999999997e-05 2024-09-10T05:55:50.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955399+0000", 2024-09-10T05:55:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4572000000000005e-05 2024-09-10T05:55:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.335 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.336 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.331755487000002, 2024-09-10T05:55:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017649246, 2024-09-10T05:55:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.337 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-09-10T05:55:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938079+0000", 2024-09-10T05:55:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1799999999999999e-06 2024-09-10T05:55:50.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938200+0000", 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120909 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938222+0000", 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2027000000000001e-05 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938238+0000", 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951706+0000", 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013468226 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951865+0000", 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015928900000000001 2024-09-10T05:55:50.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.952072+0000", 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020730499999999999 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955427+0000", 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033544680000000002 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955561+0000", 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133769 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955664+0000", 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103037 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955727+0000", 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3706000000000003e-05 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.331569025, 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017909134, 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 51 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938266+0000", 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.33e-06 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938278+0000", 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.254e-05 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938297+0000", 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8870000000000001e-05 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938311+0000", 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3976e-05 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953401+0000", 2024-09-10T05:55:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015089939 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953553+0000", 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151619 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953766+0000", 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213456 2024-09-10T05:55:50.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955443+0000", 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016762859999999999 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955961+0000", 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00051787700000000003 2024-09-10T05:55:50.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956053+0000", 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2829000000000002e-05 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956174+0000", 2024-09-10T05:55:50.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120412 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.331499919000002, 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:55:50.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:55:50.359 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.093727768999997, 2024-09-10T05:55:50.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079199360000000007, 2024-09-10T05:55:50.361 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.361 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.361 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 67 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:50.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:50.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1699999999999998e-07 2024-09-10T05:55:50.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176110+0000", 2024-09-10T05:55:50.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2660000000000002e-06 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176115+0000", 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0919999999999997e-06 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176120+0000", 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8099999999999997e-06 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179722+0000", 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036025150000000001 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179836+0000", 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011409299999999999 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.180038+0000", 2024-09-10T05:55:50.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000202096 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183798+0000", 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037592139999999999 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183887+0000", 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9087999999999998e-05 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183966+0000", 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9034000000000003e-05 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184026+0000", 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0111000000000001e-05 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.370 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.371 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:50.371 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.093114473, 2024-09-10T05:55:50.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098813330000000008, 2024-09-10T05:55:50.371 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.371 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.371 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 69 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176720+0000", 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9599999999999999e-07 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176769+0000", 2024-09-10T05:55:50.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9638000000000001e-05 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176780+0000", 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0183000000000001e-05 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176786+0000", 2024-09-10T05:55:50.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1020000000000002e-06 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182183+0000", 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053968380000000002 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182329+0000", 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014657900000000001 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182634+0000", 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030473099999999998 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186383+0000", 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037490900000000001 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186466+0000", 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2535999999999997e-05 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186541+0000", 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.572e-05 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186600+0000", 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9219999999999999e-05 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.377 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.378 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:50.378 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.093034434000003, 2024-09-10T05:55:50.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010079565, 2024-09-10T05:55:50.378 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 70 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:50.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176800+0000", 2024-09-10T05:55:50.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176806+0000", 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9939999999999997e-06 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176815+0000", 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4579999999999999e-06 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176824+0000", 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8729999999999996e-06 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184431+0000", 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076067360000000002 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184549+0000", 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118238 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184729+0000", 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017982299999999999 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186702+0000", 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001972999 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186723+0000", 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.101e-05 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186808+0000", 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4363000000000005e-05 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186879+0000", 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1255999999999997e-05 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.385 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.092995371999997, 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013908907999999999, 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 71 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176839+0000", 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9500000000000001e-07 2024-09-10T05:55:50.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176844+0000", 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.147e-06 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176854+0000", 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6469999999999993e-06 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176860+0000", 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5119999999999997e-06 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185245+0000", 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083848519999999999 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185389+0000", 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:50.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185703+0000", 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000313935 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189360+0000", 2024-09-10T05:55:50.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036563530000000002 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190587+0000", 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001227456 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190677+0000", 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0019000000000007e-05 2024-09-10T05:55:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190747+0000", 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0166000000000005e-05 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.392 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.092954013000003, 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015237794000000001, 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 72 2024-09-10T05:55:50.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000004e-07 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176999+0000", 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118935 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177019+0000", 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9337000000000001e-05 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177029+0000", 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0147e-05 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186918+0000", 2024-09-10T05:55:50.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098897099999999995 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187037+0000", 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011831400000000001 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187214+0000", 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017770000000000001 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190764+0000", 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035500129999999999 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191969+0000", 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001205036 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192056+0000", 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6929999999999996e-05 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192117+0000", 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1019e-05 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.092784594000001, 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015303199, 2024-09-10T05:55:50.399 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 73 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177050+0000", 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7000000000000004e-07 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177054+0000", 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5430000000000004e-06 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177061+0000", 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7170000000000002e-06 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177066+0000", 2024-09-10T05:55:50.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6140000000000002e-06 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188130+0000", 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011064153 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188276+0000", 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014621600000000001 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188580+0000", 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030395800000000001 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192139+0000", 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003558627 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192223+0000", 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4056999999999998e-05 2024-09-10T05:55:50.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192296+0000", 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3744000000000004e-05 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192352+0000", 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5899999999999997e-05 2024-09-10T05:55:50.405 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.092760380999998, 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015532812999999999, 2024-09-10T05:55:50.406 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 74 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:50.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177074+0000", 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6100000000000001e-07 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177078+0000", 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4329999999999997e-06 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177087+0000", 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4400000000000005e-06 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177093+0000", 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1489999999999999e-06 2024-09-10T05:55:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189439+0000", 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012346398999999999 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189611+0000", 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017199199999999999 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189927+0000", 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031553499999999998 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192450+0000", 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002522851 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192470+0000", 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0383000000000001e-05 2024-09-10T05:55:50.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192542+0000", 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2000000000000002e-05 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192606+0000", 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4170000000000004e-05 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.092703524000001, 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017090899999999999, 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 75 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177131+0000", 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4000000000000001e-07 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177233+0000", 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102378 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177244+0000", 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1032999999999999e-05 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177254+0000", 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9299999999999998e-06 2024-09-10T05:55:50.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190840+0000", 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013585488999999999 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190983+0000", 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014378899999999999 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191170+0000", 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018661099999999999 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193379+0000", 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002208574 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194090+0000", 2024-09-10T05:55:50.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071146999999999996 2024-09-10T05:55:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194168+0000", 2024-09-10T05:55:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7770999999999998e-05 2024-09-10T05:55:50.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194221+0000", 2024-09-10T05:55:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3115000000000002e-05 2024-09-10T05:55:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.420 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:50.421 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.092562905000001, 2024-09-10T05:55:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017505636000000002, 2024-09-10T05:55:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:50.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 76 2024-09-10T05:55:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:50.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4199999999999995e-07 2024-09-10T05:55:50.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177278+0000", 2024-09-10T05:55:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8569999999999997e-06 2024-09-10T05:55:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177287+0000", 2024-09-10T05:55:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0899999999999994e-06 2024-09-10T05:55:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177294+0000", 2024-09-10T05:55:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3099999999999997e-06 2024-09-10T05:55:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192645+0000", 2024-09-10T05:55:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015351205999999999 2024-09-10T05:55:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:50.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192759+0000", 2024-09-10T05:55:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114194 2024-09-10T05:55:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:50.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192937+0000", 2024-09-10T05:55:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178319 2024-09-10T05:55:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193807+0000", 2024-09-10T05:55:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000869841 2024-09-10T05:55:50.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194636+0000", 2024-09-10T05:55:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00082883499999999999 2024-09-10T05:55:50.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194713+0000", 2024-09-10T05:55:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7189999999999998e-05 2024-09-10T05:55:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:50.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194776+0000", 2024-09-10T05:55:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3052000000000006e-05 2024-09-10T05:55:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:50.435 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:50.435 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:50.437 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:50.434+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:50.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:55:50.538 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:50.537+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:50.569 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:50.569 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:50.569 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:50.569 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:50.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:55:50.673 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:50.673+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:50.740 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:50.738+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:50.751 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:50.751 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:50.752 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:50.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:55:50.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:55:50.857 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:50.857+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:50.930 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:50.930 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:55:50.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:55:50.930 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:55:50.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.315111691999999, 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:55:50.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:55:50.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.937 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.284700074, 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039429599999999997, 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 210 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646914+0000", 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-10T05:55:50.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646928+0000", 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.47e-05 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646972+0000", 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3619999999999999e-05 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646995+0000", 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3366999999999998e-05 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647130+0000", 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013420500000000001 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647345+0000", 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647767+0000", 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042202 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.649519+0000", 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017519230000000001 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650567+0000", 2024-09-10T05:55:50.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001047755 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650728+0000", 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160896 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650852+0000", 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124635 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.203814238, 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032374489999999999, 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727798+0000", 2024-09-10T05:55:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:55:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727810+0000", 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727839+0000", 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9960000000000001e-05 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727857+0000", 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7229999999999999e-05 2024-09-10T05:55:50.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727966+0000", 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010930299999999999 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728184+0000", 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021791399999999999 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728656+0000", 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047184000000000001 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730163+0000", 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015069689999999999 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730830+0000", 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066677499999999998 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730924+0000", 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4518999999999994e-05 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731033+0000", 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108749 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:272 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.172327204999998, 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038580870000000001, 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 272 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759284+0000", 2024-09-10T05:55:50.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.389e-06 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759290+0000", 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2299999999999996e-06 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759306+0000", 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5534999999999999e-05 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759315+0000", 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9749999999999996e-06 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759390+0000", 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5964999999999995e-05 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759509+0000", 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118069 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759725+0000", 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021602899999999999 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760294+0000", 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056910499999999998 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763042+0000", 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027483960000000002 2024-09-10T05:55:50.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763097+0000", 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4981000000000001e-05 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763140+0000", 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3412999999999999e-05 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:283 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.171121552999999, 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003248969, 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 283 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.957 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760489+0000", 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.339e-06 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760496+0000", 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760510+0000", 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4630000000000001e-05 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760518+0000", 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429999999999997e-06 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760590+0000", 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2002000000000006e-05 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760739+0000", 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014892 2024-09-10T05:55:50.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760956+0000", 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021756100000000001 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.761617+0000", 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066045600000000002 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763653+0000", 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020359639999999999 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763701+0000", 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8712999999999999e-05 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763737+0000", 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5695000000000003e-05 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:302 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.166974288999999, 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043845380000000003, 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 302 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764636+0000", 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764641+0000", 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764651+0000", 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0223e-05 2024-09-10T05:55:50.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764658+0000", 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764919+0000", 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026097700000000002 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764970+0000", 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1082000000000003e-05 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765083+0000", 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011311000000000001 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765878+0000", 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079446699999999998 2024-09-10T05:55:50.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768931+0000", 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030533190000000001 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768974+0000", 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2815000000000003e-05 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769020+0000", 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6150999999999999e-05 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:305 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.166494394000001, 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040725470000000001, 2024-09-10T05:55:50.969 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 305 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765117+0000", 2024-09-10T05:55:50.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.491e-06 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765123+0000", 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765139+0000", 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5896000000000002e-05 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765148+0000", 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6719999999999999e-06 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765357+0000", 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020874700000000001 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765441+0000", 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4016000000000003e-05 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765623+0000", 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018151500000000001 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766209+0000", 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000586514 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769086+0000", 2024-09-10T05:55:50.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028770169999999999 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769145+0000", 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8338000000000003e-05 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3173999999999997e-05 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.976 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:330 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.162420407999999, 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044565830000000001, 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 330 2024-09-10T05:55:50.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769191+0000", 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4249999999999999e-06 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769197+0000", 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1190000000000002e-06 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769212+0000", 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5617999999999999e-05 2024-09-10T05:55:50.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769224+0000", 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569999999999999e-05 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769282+0000", 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7986999999999999e-05 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769414+0000", 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132485 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769627+0000", 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000212845 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770192+0000", 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056470000000000001 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773540+0000", 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033483739999999999 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773603+0000", 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3096999999999996e-05 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773646+0000", 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2363000000000001e-05 2024-09-10T05:55:50.982 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:334 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.161538716999999, 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037038150000000001, 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.983 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 334 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770072+0000", 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2810000000000001e-06 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770078+0000", 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2570000000000004e-06 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770093+0000", 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4127e-05 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770099+0000", 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5780000000000004e-06 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770161+0000", 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770231+0000", 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770344+0000", 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113435 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770852+0000", 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050825999999999996 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773708+0000", 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028555310000000001 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773749+0000", 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0719000000000001e-05 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773775+0000", 2024-09-10T05:55:50.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6066000000000001e-05 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:360 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.156669415, 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003515392, 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.989 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 360 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:50.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774941+0000", 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000005e-07 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774946+0000", 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7360000000000001e-06 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774957+0000", 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774969+0000", 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775059+0000", 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0119999999999998e-05 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775147+0000", 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-05 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775336+0000", 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018901399999999999 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.776189+0000", 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085303699999999996 2024-09-10T05:55:50.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778360+0000", 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002170936 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778413+0000", 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3366999999999999e-05 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:50.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778456+0000", 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2395000000000003e-05 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:476 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.123158479000001, 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033473259999999999, 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:50.995 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 476 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:50.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808452+0000", 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.105e-06 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808458+0000", 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1430000000000003e-06 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808472+0000", 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3759e-05 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808478+0000", 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3400000000000003e-06 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808555+0000", 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6439000000000005e-05 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808619+0000", 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3649e-05 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808749+0000", 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013027399999999999 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809571+0000", 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082185400000000001 2024-09-10T05:55:50.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811686+0000", 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021150959999999999 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811752+0000", 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6085000000000002e-05 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811798+0000", 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6582000000000002e-05 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:488 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.119689185999999, 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035493080000000002, 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.001 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 488 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:51.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811923+0000", 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209999999999999e-06 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811931+0000", 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7849999999999992e-06 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811950+0000", 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8848e-05 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811960+0000", 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0396e-05 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812031+0000", 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0632999999999999e-05 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812181+0000", 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015055900000000001 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812344+0000", 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016297300000000001 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812905+0000", 2024-09-10T05:55:51.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056038799999999999 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815344+0000", 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024393520000000001 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815416+0000", 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1985999999999998e-05 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815470+0000", 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3667e-05 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:610 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.07965415, 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046567709999999997, 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 610 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851957+0000", 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1850000000000001e-06 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851964+0000", 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9059999999999996e-06 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851980+0000", 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6725e-05 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851987+0000", 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852056+0000", 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9453000000000001e-05 2024-09-10T05:55:51.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852111+0000", 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5176999999999997e-05 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852250+0000", 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013836600000000001 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852726+0000", 2024-09-10T05:55:51.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047576900000000002 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856557+0000", 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038316639999999998 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856586+0000", 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9266999999999999e-05 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856612+0000", 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5738999999999999e-05 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:628 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.073448657, 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046452960000000001, 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 628 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858162+0000", 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.083e-06 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858167+0000", 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858180+0000", 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3461e-05 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858187+0000", 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0199999999999997e-06 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858236+0000", 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9005999999999998e-05 2024-09-10T05:55:51.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858301+0000", 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4593999999999999e-05 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858421+0000", 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011972399999999999 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858914+0000", 2024-09-10T05:55:51.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049326199999999995 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862730+0000", 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038160120000000001 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862768+0000", 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8550999999999997e-05 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862806+0000", 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725999999999998e-05 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:645 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.066263956, 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056225549999999996, 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 645 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865347+0000", 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.015e-06 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865352+0000", 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2390000000000002e-06 2024-09-10T05:55:51.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865364+0000", 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865371+0000", 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2249999999999997e-06 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865422+0000", 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0939000000000001e-05 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865510+0000", 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8802999999999997e-05 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865633+0000", 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012270900000000001 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866082+0000", 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044930399999999998 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870875+0000", 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047923890000000002 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870929+0000", 2024-09-10T05:55:51.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4314999999999998e-05 2024-09-10T05:55:51.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870968+0000", 2024-09-10T05:55:51.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9121e-05 2024-09-10T05:55:51.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:647 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.065433348999999, 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049129430000000003, 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 647 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866177+0000", 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866182+0000", 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5079999999999999e-06 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866191+0000", 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6520000000000001e-06 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866197+0000", 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4360000000000001e-06 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866247+0000", 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0047999999999999e-05 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866306+0000", 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8910999999999999e-05 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866415+0000", 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010889499999999999 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866857+0000", 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044269399999999999 2024-09-10T05:55:51.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871019+0000", 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041621200000000001 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871065+0000", 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5439999999999999e-05 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871089+0000", 2024-09-10T05:55:51.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4386e-05 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:823 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.020314141, 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034604840000000002, 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 823 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911296+0000", 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911300+0000", 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:55:51.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911307+0000", 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5399999999999998e-06 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911312+0000", 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070000000000003e-06 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911344+0000", 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2203000000000003e-05 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911385+0000", 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1544000000000001e-05 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911481+0000", 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5716000000000003e-05 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911947+0000", 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000466327 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914701+0000", 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002753307 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914732+0000", 2024-09-10T05:55:51.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1393000000000003e-05 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914756+0000", 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3842e-05 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:883 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.993524505, 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00325596, 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 883 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938086+0000", 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4399999999999999e-07 2024-09-10T05:55:51.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938090+0000", 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0069999999999999e-06 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938099+0000", 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6190000000000006e-06 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938105+0000", 2024-09-10T05:55:51.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0989999999999998e-06 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938159+0000", 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4317000000000002e-05 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938233+0000", 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4317e-05 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938395+0000", 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016220300000000001 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938964+0000", 2024-09-10T05:55:51.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056826499999999998 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941280+0000", 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002316196 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941315+0000", 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5193e-05 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941341+0000", 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5999999999999998e-05 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:888 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.992310610000001, 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004820525, 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 888 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939300+0000", 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.032e-06 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939307+0000", 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.827e-06 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939318+0000", 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1105e-05 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939323+0000", 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939374+0000", 2024-09-10T05:55:51.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1232e-05 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939437+0000", 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2472999999999996e-05 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939576+0000", 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138837 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.940035+0000", 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000459414 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944026+0000", 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003990352 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944074+0000", 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8417000000000001e-05 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944120+0000", 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5516000000000003e-05 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1072 6.16 6:6d4431ed:lc::lc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.909183516999999, 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048653860000000002, 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:51.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:51.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022427+0000", 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022431+0000", 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4520000000000002e-06 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022439+0000", 2024-09-10T05:55:51.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8419999999999994e-06 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022444+0000", 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022495+0000", 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1314999999999999e-05 2024-09-10T05:55:51.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022589+0000", 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3917000000000002e-05 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022781+0000", 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000192158 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.023273+0000", 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049226000000000001 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027217+0000", 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039431780000000003 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:51.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027248+0000", 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1248999999999998e-05 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027291+0000", 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3677000000000002e-05 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:51.062 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:51.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:55:51.065 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:51.061+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:51.165 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:51.162+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:51.233 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:51.233 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:51.234 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:51.234 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:51.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:55:51.265 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:51.262+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:51.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:55:51.361 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:51.362 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:51.362 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:51.362 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:51.362 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:51.365 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:51.362+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:51.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:55:51.466 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:51.466+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:51.489 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:51.489 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:51.505 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:51.505 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:51.520 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:51.521 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:51.538 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:51.538 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:51.548 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:51.548 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:51.558 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:51.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:51.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:55:51.568 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:51.566+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:51.578 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:51.597 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:51.597 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:51.618 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:51.618 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:51.669 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:51.666+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:51.672 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:51.672 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:51.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:55:51.773 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:51.772+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:51.780 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:55:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:51.844 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:51.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:55:51.905 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:51.904+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:51.972 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:51.970+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:52.021 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:52.021 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:52.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:55:52.081 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:52.080+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:52.157 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:52.157 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:52.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:55:52.174 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:52.170+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:52.275 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:52.274+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:52.331 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:52.332 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:52.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:55:52.393 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:52.392+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:52.455 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:52.455 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:52.468 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:55:52.514 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:52.514+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:52.577 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:52.576+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:52.601 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:52.602 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:52.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:55:52.679 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:52.680+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:52.780 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:52.778+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:52.783 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:52.784 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:52.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:55:52.881 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:52.880+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:52.967 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:52.968 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:52.981 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:52.978+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:52.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:55:53.082 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:53.080+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:53.156 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:53.156 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:53.170 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:55:53.214 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:53.214+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:53.286 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:53.284+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:53.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:55:53.390 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:53.390+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:53.468 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:53.468 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:53.482 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:55:53.488 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:53.488+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:53.589 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:53.588+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:53.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:53.644 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:53.659 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:55:53.693 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:53.692+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:53.777 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:53.778 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:53.789 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:53.789 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:53.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:55:53.793 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:53.790+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:53.801 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:55:53.806 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:53.806 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:53.823 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:53.823 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:53.840 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:53.840 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:53.859 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:53.859 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:53.877 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:53.877 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:53.897 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:53.897 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:53.898 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:53.894+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:53.916 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:53.916 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:53.922 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:53.922 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.331674291999999, 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.923 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:55:53.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:55:53.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:55:53.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402885765248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.303870290999999, 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063071129999999996, 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 47 2024-09-10T05:55:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616726+0000", 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616730+0000", 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.755e-06 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616742+0000", 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2228e-05 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616775+0000", 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3362999999999999e-05 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616799+0000", 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3560000000000001e-05 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616928+0000", 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012861700000000001 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617040+0000", 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112855 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617301+0000", 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026039100000000001 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622807+0000", 2024-09-10T05:55:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055066450000000001 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622837+0000", 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9482999999999999e-05 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622910+0000", 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2667000000000001e-05 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.623033+0000", 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012354900000000001 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:380 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'3, mlcod=36'1)", 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.143607874000001, 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004045608, 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776988+0000", 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.776990+0000", 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9139999999999998e-06 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777004+0000", 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4083000000000001e-05 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777040+0000", 2024-09-10T05:55:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5577000000000002e-05 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777098+0000", 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7921999999999999e-05 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777301+0000", 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020330899999999999 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777354+0000", 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.304e-05 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.780921+0000", 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00356639 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781034+0000", 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113373 2024-09-10T05:55:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:392 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'4, mlcod=36'2)", 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.137925345999999, 2024-09-10T05:55:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040178150000000001, 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782671+0000", 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782673+0000", 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.04e-06 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782685+0000", 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2103000000000001e-05 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782707+0000", 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1500000000000001e-05 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782719+0000", 2024-09-10T05:55:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.272e-05 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782869+0000", 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150192 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782919+0000", 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9814000000000001e-05 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786592+0000", 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036727729999999998 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786689+0000", 2024-09-10T05:55:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6673000000000001e-05 2024-09-10T05:55:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:387 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'6, mlcod=36'3)", 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.137742086999999, 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038518089999999999, 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782854+0000", 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782856+0000", 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.373e-06 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782867+0000", 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1167e-05 2024-09-10T05:55:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782884+0000", 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7646e-05 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782894+0000", 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9669999999999996e-06 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783004+0000", 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109589 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783037+0000", 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2647000000000001e-05 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786621+0000", 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035847230000000002 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786706+0000", 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4697000000000006e-05 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:395 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'5, mlcod=36'2)", 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.135693557, 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052374350000000004, 2024-09-10T05:55:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784903+0000", 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784905+0000", 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0169999999999999e-06 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784920+0000", 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5362999999999998e-05 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784953+0000", 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2712999999999997e-05 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784972+0000", 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9199999999999999e-05 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785086+0000", 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113733 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785122+0000", 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5995999999999999e-05 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790033+0000", 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049114759999999997 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790140+0000", 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106937 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:400 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'7, mlcod=36'5)", 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.131453506, 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041295639999999996, 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789143+0000", 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789145+0000", 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0829999999999998e-06 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789159+0000", 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3797e-05 2024-09-10T05:55:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789190+0000", 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1052e-05 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789209+0000", 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9774000000000001e-05 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789342+0000", 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013203299999999999 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789388+0000", 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6791e-05 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793161+0000", 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037730179999999999 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793272+0000", 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111016 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:407 6.a e36/30 6:5395e6f3:lc::lc.4:head v 36'2, mlcod=0'0)", 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.129086657999999, 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041314409999999996, 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791510+0000", 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791512+0000", 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.04e-06 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791526+0000", 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4147e-05 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791554+0000", 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8606e-05 2024-09-10T05:55:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791568+0000", 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.34e-05 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791714+0000", 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014631299999999999 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791766+0000", 2024-09-10T05:55:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1638999999999998e-05 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795546+0000", 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037801699999999998 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795641+0000", 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5125999999999997e-05 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:417 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'6, mlcod=36'4)", 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.128370602, 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046622369999999996, 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792226+0000", 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792228+0000", 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792241+0000", 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3568e-05 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792269+0000", 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7475e-05 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792289+0000", 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9604999999999999e-05 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792434+0000", 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014589200000000001 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792487+0000", 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2800000000000003e-05 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796741+0000", 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042537310000000002 2024-09-10T05:55:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796888+0000", 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014694600000000001 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:418 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'2, mlcod=0'0)", 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.127418241000001, 2024-09-10T05:55:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036976560000000001, 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793178+0000", 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793180+0000", 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.153e-06 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793194+0000", 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.42e-05 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793224+0000", 2024-09-10T05:55:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793241+0000", 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7333000000000002e-05 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793388+0000", 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000147276 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.793448+0000", 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422999999999997e-05 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796756+0000", 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033080890000000002 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796876+0000", 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012006900000000001 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:608 6.1 e36/30 6:8386e9da:lc::lc.16:head v 36'9, mlcod=36'7)", 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.071760064999999, 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044587100000000003, 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848836+0000", 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848838+0000", 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.466e-06 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848847+0000", 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3819999999999993e-06 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848871+0000", 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.353e-05 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848883+0000", 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2649999999999999e-05 2024-09-10T05:55:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848969+0000", 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5351000000000003e-05 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848994+0000", 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5028000000000002e-05 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.853202+0000", 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042088079999999996 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.853295+0000", 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2495000000000001e-05 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:606 6.5 e36/30 6:a7f90313:reshard::reshard.0000000012:head v 36'5, mlcod=36'2)", 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.071318902000002, 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048455449999999997, 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849277+0000", 2024-09-10T05:55:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849279+0000", 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7600000000000001e-06 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849290+0000", 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1083999999999999e-05 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849311+0000", 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0831000000000001e-05 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849322+0000", 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0468e-05 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849413+0000", 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1256999999999997e-05 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.849440+0000", 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7311e-05 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.854034+0000", 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045941879999999999 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.854123+0000", 2024-09-10T05:55:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8646000000000005e-05 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:620 6.15 e36/30 6:abd89f08:lc::lc.23:head v 36'4, mlcod=36'2)", 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.065500513, 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040651209999999997, 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855096+0000", 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855097+0000", 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4780000000000001e-06 2024-09-10T05:55:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855107+0000", 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0098000000000001e-05 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855130+0000", 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2872000000000001e-05 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855144+0000", 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3906e-05 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855271+0000", 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012645899999999999 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855331+0000", 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0041999999999999e-05 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859088+0000", 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037569729999999998 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859161+0000", 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3293000000000005e-05 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:627 6.3 e36/30 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 36'10, mlcod=36'8)", 2024-09-10T05:55:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.06494494, 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035147479999999998, 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855651+0000", 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855653+0000", 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.798e-06 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855682+0000", 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8911000000000002e-05 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855704+0000", 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2348e-05 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855719+0000", 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4192000000000001e-05 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855812+0000", 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3277999999999997e-05 2024-09-10T05:55:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.855843+0000", 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1112999999999998e-05 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859099+0000", 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00325567 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.859166+0000", 2024-09-10T05:55:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7438e-05 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:641 6.3 e36/30 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 36'11, mlcod=36'9)", 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.058187459999999, 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045882409999999998, 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862409+0000", 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862410+0000", 2024-09-10T05:55:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1400000000000001e-06 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862419+0000", 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7190000000000007e-06 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862437+0000", 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8664999999999998e-05 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862447+0000", 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7629999999999995e-06 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862531+0000", 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3534000000000004e-05 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862565+0000", 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4734000000000003e-05 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.866923+0000", 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043578519999999997 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.866997+0000", 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3833999999999998e-05 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:643 6.15 e36/30 6:abd89f08:lc::lc.23:head v 36'5, mlcod=36'3)", 2024-09-10T05:55:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.057633211999999, 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046454249999999999, 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862963+0000", 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862964+0000", 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.35e-06 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862972+0000", 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8269999999999998e-06 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862990+0000", 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8085999999999999e-05 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.862999+0000", 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7579999999999998e-06 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.863075+0000", 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5486000000000002e-05 2024-09-10T05:55:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.863110+0000", 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.867542+0000", 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044317820000000004 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.867608+0000", 2024-09-10T05:55:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6270000000000001e-05 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:909 6.c e36/30 6:36abfd60:::obj_delete_at_hint.0000000029:head v 36'6, mlcod=36'4)", 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.976359279, 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044843310000000003, 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944237+0000", 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944238+0000", 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1310000000000001e-06 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944246+0000", 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5379999999999997e-06 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944262+0000", 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6449000000000001e-05 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944270+0000", 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6059999999999997e-06 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944336+0000", 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5946999999999997e-05 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944363+0000", 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7775000000000001e-05 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948668+0000", 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004304123 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948721+0000", 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3761999999999998e-05 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:910 6.1e e36/30 6:7e82ab18:lc::lc.13:head v 36'3, mlcod=36'1)", 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.975433447, 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003611525, 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945163+0000", 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945164+0000", 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0100000000000001e-06 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945172+0000", 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9699999999999999e-06 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945189+0000", 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6952999999999998e-05 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945199+0000", 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8479999999999996e-06 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945268+0000", 2024-09-10T05:55:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880999999999993e-05 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945295+0000", 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7070999999999999e-05 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948698+0000", 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034032609999999999 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948774+0000", 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6531000000000003e-05 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:927 6.1f e36/30 6:fd8d39b6:::obj_delete_at_hint.0000000030:head v 36'11, mlcod=36'9)", 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.968011744999998, 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048014889999999999, 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952585+0000", 2024-09-10T05:55:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952586+0000", 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.001e-06 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952605+0000", 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952617+0000", 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2058999999999999e-05 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952623+0000", 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1709999999999999e-06 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952675+0000", 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2110000000000001e-05 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.952693+0000", 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7761000000000002e-05 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.957349+0000", 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046558809999999997 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.957386+0000", 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7197999999999999e-05 2024-09-10T05:55:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1189 6.1f e36/30 6:fce5a501:::obj_delete_at_hint.0000000075:head v 36'14, mlcod=36'12)", 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.778468643, 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041812739999999996, 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142128+0000", 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142129+0000", 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142141+0000", 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2038999999999999e-05 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142156+0000", 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4657999999999999e-05 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142162+0000", 2024-09-10T05:55:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6279999999999999e-06 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142281+0000", 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119249 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.142344+0000", 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3069000000000002e-05 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.146191+0000", 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038467219999999999 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:34.146309+0000", 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117716 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.026 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:54.028 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:54.024+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:54.029 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:55:54.128 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:54.126+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:54.196 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:54.197 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:54.197 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:55:54.197 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:54.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:55:54.229 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:54.228+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:54.331 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:54.330+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:54.376 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:54.377 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:55:54.377 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:55:54.377 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:55:54.377 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:54.391 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:55:54.433 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:54.432+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:54.534 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:54.536+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.578720695000001, 2024-09-10T05:55:54.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:54.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:55:54.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:55:54.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:55:54.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.624389239000003, 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010177393999999999, 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.574 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937122+0000", 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.624e-06 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937136+0000", 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.359e-05 2024-09-10T05:55:54.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937157+0000", 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0953000000000001e-05 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937173+0000", 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5897e-05 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.941996+0000", 2024-09-10T05:55:54.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048236349999999997 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942219+0000", 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000222609 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942422+0000", 2024-09-10T05:55:54.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020308500000000001 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946080+0000", 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036577379999999998 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947146+0000", 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001066607 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947216+0000", 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9888999999999994e-05 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947298+0000", 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1767000000000005e-05 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.624281019999998, 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011563665000000001, 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 44 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937230+0000", 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937398+0000", 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937424+0000", 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5239999999999999e-05 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937485+0000", 2024-09-10T05:55:54.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1029999999999997e-05 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943654+0000", 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006169384 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943798+0000", 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.944008+0000", 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209562 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947319+0000", 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033113499999999998 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948656+0000", 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013365849999999999 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948733+0000", 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7082000000000005e-05 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948793+0000", 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9910000000000001e-05 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.623990630999998, 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011644801, 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 45 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937521+0000", 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937562+0000", 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1325999999999997e-05 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937586+0000", 2024-09-10T05:55:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.427e-05 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937602+0000", 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5393999999999999e-05 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945047+0000", 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007445119 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945167+0000", 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120233 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945351+0000", 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184599 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948941+0000", 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035892739999999999 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948975+0000", 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4459999999999999e-05 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949057+0000", 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1353000000000005e-05 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949164+0000", 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010747999999999999 2024-09-10T05:55:54.592 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.623881028, 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012744626, 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937630+0000", 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937640+0000", 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0317e-05 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937660+0000", 2024-09-10T05:55:54.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0049000000000001e-05 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937674+0000", 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.401e-05 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946184+0000", 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085092269999999994 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946324+0000", 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013997900000000001 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946567+0000", 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024366899999999999 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949295+0000", 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027277130000000001 2024-09-10T05:55:54.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950244+0000", 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00094850000000000002 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950311+0000", 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7972999999999994e-05 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950373+0000", 2024-09-10T05:55:54.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1995999999999994e-05 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.623775268999999, 2024-09-10T05:55:54.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013893696000000001, 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 47 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937736+0000", 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4759999999999999e-06 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937863+0000", 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012669299999999999 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937887+0000", 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4125999999999999e-05 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937904+0000", 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-10T05:55:54.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947400+0000", 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094954949999999996 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947551+0000", 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150929 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947752+0000", 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020166199999999999 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950521+0000", 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002768969 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951502+0000", 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000980477 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951571+0000", 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8780000000000002e-05 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951628+0000", 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7599000000000002e-05 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.62357514, 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015425703000000001, 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.606 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 48 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937936+0000", 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6759999999999999e-06 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937947+0000", 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0507e-05 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937967+0000", 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0137e-05 2024-09-10T05:55:54.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937982+0000", 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4636e-05 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949376+0000", 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011394235000000001 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949508+0000", 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013255299999999999 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949708+0000", 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019957199999999999 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953070+0000", 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003362182 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953217+0000", 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146329 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953291+0000", 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4809999999999997e-05 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953360+0000", 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9066000000000006e-05 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.623505131000002, 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017394456999999999, 2024-09-10T05:55:54.612 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938006+0000", 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.113e-06 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938016+0000", 2024-09-10T05:55:54.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7699999999999996e-06 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938034+0000", 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8700000000000001e-05 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938048+0000", 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3886999999999999e-05 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950635+0000", 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012587167999999999 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950750+0000", 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114146 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950963+0000", 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021314200000000001 2024-09-10T05:55:54.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953193+0000", 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022307519999999999 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955262+0000", 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020683870000000001 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955335+0000", 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2819999999999997e-05 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955399+0000", 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4572000000000005e-05 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:54.618 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.623431728, 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017649246, 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:54.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938079+0000", 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1799999999999999e-06 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938200+0000", 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120909 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938222+0000", 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2027000000000001e-05 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938238+0000", 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951706+0000", 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013468226 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951865+0000", 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015928900000000001 2024-09-10T05:55:54.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.952072+0000", 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020730499999999999 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955427+0000", 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033544680000000002 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955561+0000", 2024-09-10T05:55:54.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133769 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955664+0000", 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103037 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955727+0000", 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3706000000000003e-05 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.623245265999998, 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017909134, 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.625 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 51 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938266+0000", 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.33e-06 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938278+0000", 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.254e-05 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938297+0000", 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8870000000000001e-05 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938311+0000", 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3976e-05 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953401+0000", 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015089939 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953553+0000", 2024-09-10T05:55:54.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151619 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953766+0000", 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213456 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955443+0000", 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016762859999999999 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955961+0000", 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00051787700000000003 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956053+0000", 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2829000000000002e-05 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956174+0000", 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120412 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.62317616, 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:55:54.631 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:55:54.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:55:54.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.385404010000002, 2024-09-10T05:55:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079199360000000007, 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 67 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:54.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1699999999999998e-07 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176110+0000", 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2660000000000002e-06 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176115+0000", 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0919999999999997e-06 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176120+0000", 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8099999999999997e-06 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179722+0000", 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036025150000000001 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179836+0000", 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011409299999999999 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.180038+0000", 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000202096 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183798+0000", 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037592139999999999 2024-09-10T05:55:54.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183887+0000", 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9087999999999998e-05 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183966+0000", 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9034000000000003e-05 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184026+0000", 2024-09-10T05:55:54.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0111000000000001e-05 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384790713999998, 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098813330000000008, 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 69 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176720+0000", 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9599999999999999e-07 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176769+0000", 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9638000000000001e-05 2024-09-10T05:55:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176780+0000", 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0183000000000001e-05 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176786+0000", 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1020000000000002e-06 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182183+0000", 2024-09-10T05:55:54.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053968380000000002 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182329+0000", 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014657900000000001 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182634+0000", 2024-09-10T05:55:54.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030473099999999998 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186383+0000", 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037490900000000001 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186466+0000", 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2535999999999997e-05 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186541+0000", 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.572e-05 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186600+0000", 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9219999999999999e-05 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384710675000001, 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010079565, 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 70 2024-09-10T05:55:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176800+0000", 2024-09-10T05:55:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:55:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176806+0000", 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9939999999999997e-06 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176815+0000", 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4579999999999999e-06 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176824+0000", 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8729999999999996e-06 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184431+0000", 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076067360000000002 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184549+0000", 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118238 2024-09-10T05:55:54.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184729+0000", 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017982299999999999 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186702+0000", 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001972999 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186723+0000", 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.101e-05 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186808+0000", 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4363000000000005e-05 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186879+0000", 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1255999999999997e-05 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384671613000002, 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013908907999999999, 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.659 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 71 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176839+0000", 2024-09-10T05:55:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9500000000000001e-07 2024-09-10T05:55:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176844+0000", 2024-09-10T05:55:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.147e-06 2024-09-10T05:55:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176854+0000", 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6469999999999993e-06 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176860+0000", 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5119999999999997e-06 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185245+0000", 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083848519999999999 2024-09-10T05:55:54.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185389+0000", 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185703+0000", 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000313935 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189360+0000", 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036563530000000002 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190587+0000", 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001227456 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190677+0000", 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0019000000000007e-05 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190747+0000", 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0166000000000005e-05 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384630254000001, 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015237794000000001, 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 72 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000004e-07 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176999+0000", 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118935 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177019+0000", 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9337000000000001e-05 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177029+0000", 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0147e-05 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186918+0000", 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098897099999999995 2024-09-10T05:55:54.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187037+0000", 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011831400000000001 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187214+0000", 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017770000000000001 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190764+0000", 2024-09-10T05:55:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035500129999999999 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191969+0000", 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001205036 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192056+0000", 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6929999999999996e-05 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192117+0000", 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1019e-05 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384460834999999, 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015303199, 2024-09-10T05:55:54.672 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 73 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:54.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177050+0000", 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7000000000000004e-07 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177054+0000", 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5430000000000004e-06 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177061+0000", 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7170000000000002e-06 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177066+0000", 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6140000000000002e-06 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188130+0000", 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011064153 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188276+0000", 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014621600000000001 2024-09-10T05:55:54.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188580+0000", 2024-09-10T05:55:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030395800000000001 2024-09-10T05:55:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192139+0000", 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003558627 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192223+0000", 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4056999999999998e-05 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192296+0000", 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3744000000000004e-05 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192352+0000", 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5899999999999997e-05 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:54.679 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384436622000003, 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015532812999999999, 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 74 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177074+0000", 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6100000000000001e-07 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177078+0000", 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4329999999999997e-06 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177087+0000", 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4400000000000005e-06 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177093+0000", 2024-09-10T05:55:54.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1489999999999999e-06 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189439+0000", 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012346398999999999 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189611+0000", 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017199199999999999 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189927+0000", 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031553499999999998 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192450+0000", 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002522851 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192470+0000", 2024-09-10T05:55:54.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0383000000000001e-05 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192542+0000", 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2000000000000002e-05 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192606+0000", 2024-09-10T05:55:54.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4170000000000004e-05 2024-09-10T05:55:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.686 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384379764999998, 2024-09-10T05:55:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017090899999999999, 2024-09-10T05:55:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.687 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 75 2024-09-10T05:55:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177131+0000", 2024-09-10T05:55:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4000000000000001e-07 2024-09-10T05:55:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177233+0000", 2024-09-10T05:55:54.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102378 2024-09-10T05:55:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177244+0000", 2024-09-10T05:55:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1032999999999999e-05 2024-09-10T05:55:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177254+0000", 2024-09-10T05:55:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9299999999999998e-06 2024-09-10T05:55:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190840+0000", 2024-09-10T05:55:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013585488999999999 2024-09-10T05:55:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190983+0000", 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014378899999999999 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191170+0000", 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018661099999999999 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193379+0000", 2024-09-10T05:55:54.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002208574 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194090+0000", 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071146999999999996 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194168+0000", 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7770999999999998e-05 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194221+0000", 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3115000000000002e-05 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.384239145999999, 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017505636000000002, 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 76 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4199999999999995e-07 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177278+0000", 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8569999999999997e-06 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177287+0000", 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0899999999999994e-06 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177294+0000", 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3099999999999997e-06 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192645+0000", 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015351205999999999 2024-09-10T05:55:54.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192759+0000", 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114194 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192937+0000", 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178319 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:54.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193807+0000", 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000869841 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194636+0000", 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00082883499999999999 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194713+0000", 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7189999999999998e-05 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:54.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194776+0000", 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3052000000000006e-05 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:54.703 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:54.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:55:54.705 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:54.700+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:55:54.805 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:54.802+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:54.841 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:54.841 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:54.841 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:54.841 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:54.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:55:54.906 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:54.902+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:55.006 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:55.006+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:55.020 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:55.020 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:55.020 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:55.020 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:55.020 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:55.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:55:55.107 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:55.106+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:55.162 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:55.162 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:55:55.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:55:55.162 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:55:55.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:55.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.544443575999999, 2024-09-10T05:55:55.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:55:55.164 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.164 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:55:55.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:55:55.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:55:55.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:55:55.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:55:55.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:55:55.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:55.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:55:55.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:55:55.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:55:55.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:55:55.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:55:55.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.175 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:55.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.514031958, 2024-09-10T05:55:55.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039429599999999997, 2024-09-10T05:55:55.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 210 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646914+0000", 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646928+0000", 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.47e-05 2024-09-10T05:55:55.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646972+0000", 2024-09-10T05:55:55.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3619999999999999e-05 2024-09-10T05:55:55.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646995+0000", 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3366999999999998e-05 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647130+0000", 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013420500000000001 2024-09-10T05:55:55.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647345+0000", 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647767+0000", 2024-09-10T05:55:55.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042202 2024-09-10T05:55:55.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.649519+0000", 2024-09-10T05:55:55.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017519230000000001 2024-09-10T05:55:55.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650567+0000", 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001047755 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650728+0000", 2024-09-10T05:55:55.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160896 2024-09-10T05:55:55.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650852+0000", 2024-09-10T05:55:55.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124635 2024-09-10T05:55:55.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.433146122, 2024-09-10T05:55:55.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032374489999999999, 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230 2024-09-10T05:55:55.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.188 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:55.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727798+0000", 2024-09-10T05:55:55.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727810+0000", 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727839+0000", 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9960000000000001e-05 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727857+0000", 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7229999999999999e-05 2024-09-10T05:55:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727966+0000", 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010930299999999999 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728184+0000", 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021791399999999999 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728656+0000", 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047184000000000001 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730163+0000", 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015069689999999999 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730830+0000", 2024-09-10T05:55:55.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066677499999999998 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730924+0000", 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4518999999999994e-05 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731033+0000", 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108749 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.196 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:272 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:55.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.401659088999999, 2024-09-10T05:55:55.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038580870000000001, 2024-09-10T05:55:55.197 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 272 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759284+0000", 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.389e-06 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759290+0000", 2024-09-10T05:55:55.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2299999999999996e-06 2024-09-10T05:55:55.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759306+0000", 2024-09-10T05:55:55.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5534999999999999e-05 2024-09-10T05:55:55.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759315+0000", 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9749999999999996e-06 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759390+0000", 2024-09-10T05:55:55.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5964999999999995e-05 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759509+0000", 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118069 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759725+0000", 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021602899999999999 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760294+0000", 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056910499999999998 2024-09-10T05:55:55.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763042+0000", 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027483960000000002 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763097+0000", 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4981000000000001e-05 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763140+0000", 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3412999999999999e-05 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:283 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:55.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.400453436999999, 2024-09-10T05:55:55.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003248969, 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 283 2024-09-10T05:55:55.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:55.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760489+0000", 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.339e-06 2024-09-10T05:55:55.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760496+0000", 2024-09-10T05:55:55.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-10T05:55:55.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760510+0000", 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4630000000000001e-05 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760518+0000", 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429999999999997e-06 2024-09-10T05:55:55.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760590+0000", 2024-09-10T05:55:55.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2002000000000006e-05 2024-09-10T05:55:55.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760739+0000", 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014892 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760956+0000", 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021756100000000001 2024-09-10T05:55:55.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.761617+0000", 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066045600000000002 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763653+0000", 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020359639999999999 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763701+0000", 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8712999999999999e-05 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763737+0000", 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5695000000000003e-05 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:302 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.396306172999999, 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043845380000000003, 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.218 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.219 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.219 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 302 2024-09-10T05:55:55.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.219 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764636+0000", 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764641+0000", 2024-09-10T05:55:55.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-10T05:55:55.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764651+0000", 2024-09-10T05:55:55.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0223e-05 2024-09-10T05:55:55.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764658+0000", 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764919+0000", 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026097700000000002 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764970+0000", 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1082000000000003e-05 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765083+0000", 2024-09-10T05:55:55.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011311000000000001 2024-09-10T05:55:55.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765878+0000", 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079446699999999998 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768931+0000", 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030533190000000001 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768974+0000", 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2815000000000003e-05 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769020+0000", 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6150999999999999e-05 2024-09-10T05:55:55.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:305 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:55.228 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.395826278000001, 2024-09-10T05:55:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040725470000000001, 2024-09-10T05:55:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 305 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:55.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765117+0000", 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.491e-06 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765123+0000", 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-10T05:55:55.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765139+0000", 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5896000000000002e-05 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765148+0000", 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6719999999999999e-06 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765357+0000", 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020874700000000001 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765441+0000", 2024-09-10T05:55:55.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4016000000000003e-05 2024-09-10T05:55:55.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765623+0000", 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018151500000000001 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766209+0000", 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000586514 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769086+0000", 2024-09-10T05:55:55.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028770169999999999 2024-09-10T05:55:55.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769145+0000", 2024-09-10T05:55:55.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8338000000000003e-05 2024-09-10T05:55:55.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:55:55.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3173999999999997e-05 2024-09-10T05:55:55.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:330 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.391752292, 2024-09-10T05:55:55.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044565830000000001, 2024-09-10T05:55:55.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 330 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769191+0000", 2024-09-10T05:55:55.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4249999999999999e-06 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769197+0000", 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1190000000000002e-06 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769212+0000", 2024-09-10T05:55:55.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5617999999999999e-05 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769224+0000", 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569999999999999e-05 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769282+0000", 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7986999999999999e-05 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769414+0000", 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132485 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769627+0000", 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000212845 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770192+0000", 2024-09-10T05:55:55.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056470000000000001 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773540+0000", 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033483739999999999 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773603+0000", 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3096999999999996e-05 2024-09-10T05:55:55.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773646+0000", 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2363000000000001e-05 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:334 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.390870601, 2024-09-10T05:55:55.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037038150000000001, 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 334 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.248 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770072+0000", 2024-09-10T05:55:55.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2810000000000001e-06 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770078+0000", 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2570000000000004e-06 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770093+0000", 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4127e-05 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770099+0000", 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5780000000000004e-06 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770161+0000", 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770231+0000", 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770344+0000", 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113435 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770852+0000", 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050825999999999996 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773708+0000", 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028555310000000001 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773749+0000", 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0719000000000001e-05 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773775+0000", 2024-09-10T05:55:55.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6066000000000001e-05 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:360 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.386001299, 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003515392, 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 360 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:55.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774941+0000", 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000005e-07 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774946+0000", 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7360000000000001e-06 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774957+0000", 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774969+0000", 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775059+0000", 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0119999999999998e-05 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775147+0000", 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-05 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775336+0000", 2024-09-10T05:55:55.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018901399999999999 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.776189+0000", 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085303699999999996 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778360+0000", 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002170936 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778413+0000", 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3366999999999999e-05 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778456+0000", 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2395000000000003e-05 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:476 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.352490363000001, 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033473259999999999, 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 476 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808452+0000", 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.105e-06 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808458+0000", 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1430000000000003e-06 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808472+0000", 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3759e-05 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808478+0000", 2024-09-10T05:55:55.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3400000000000003e-06 2024-09-10T05:55:55.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808555+0000", 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6439000000000005e-05 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808619+0000", 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3649e-05 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808749+0000", 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013027399999999999 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809571+0000", 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082185400000000001 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811686+0000", 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021150959999999999 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811752+0000", 2024-09-10T05:55:55.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6085000000000002e-05 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811798+0000", 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6582000000000002e-05 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:488 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.349021069999999, 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035493080000000002, 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 488 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811923+0000", 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209999999999999e-06 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811931+0000", 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7849999999999992e-06 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811950+0000", 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8848e-05 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811960+0000", 2024-09-10T05:55:55.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0396e-05 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812031+0000", 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0632999999999999e-05 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812181+0000", 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015055900000000001 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812344+0000", 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016297300000000001 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812905+0000", 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056038799999999999 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815344+0000", 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024393520000000001 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815416+0000", 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1985999999999998e-05 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815470+0000", 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3667e-05 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:610 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.308986034, 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046567709999999997, 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 610 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851957+0000", 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1850000000000001e-06 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851964+0000", 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9059999999999996e-06 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851980+0000", 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6725e-05 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851987+0000", 2024-09-10T05:55:55.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852056+0000", 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9453000000000001e-05 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852111+0000", 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5176999999999997e-05 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852250+0000", 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013836600000000001 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852726+0000", 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047576900000000002 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856557+0000", 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038316639999999998 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856586+0000", 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9266999999999999e-05 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856612+0000", 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5738999999999999e-05 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:628 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.302780541000001, 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046452960000000001, 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 628 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858162+0000", 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.083e-06 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858167+0000", 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858180+0000", 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3461e-05 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858187+0000", 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0199999999999997e-06 2024-09-10T05:55:55.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858236+0000", 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9005999999999998e-05 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858301+0000", 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4593999999999999e-05 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858421+0000", 2024-09-10T05:55:55.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011972399999999999 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858914+0000", 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049326199999999995 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862730+0000", 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038160120000000001 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862768+0000", 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8550999999999997e-05 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862806+0000", 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725999999999998e-05 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:645 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.295595840000001, 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056225549999999996, 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 645 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865347+0000", 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.015e-06 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865352+0000", 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2390000000000002e-06 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865364+0000", 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865371+0000", 2024-09-10T05:55:55.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2249999999999997e-06 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865422+0000", 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0939000000000001e-05 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865510+0000", 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8802999999999997e-05 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865633+0000", 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012270900000000001 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866082+0000", 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044930399999999998 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870875+0000", 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047923890000000002 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870929+0000", 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4314999999999998e-05 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870968+0000", 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9121e-05 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:647 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.294765233, 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049129430000000003, 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 647 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866177+0000", 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-10T05:55:55.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866182+0000", 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5079999999999999e-06 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866191+0000", 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6520000000000001e-06 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866197+0000", 2024-09-10T05:55:55.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4360000000000001e-06 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866247+0000", 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0047999999999999e-05 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866306+0000", 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8910999999999999e-05 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866415+0000", 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010889499999999999 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866857+0000", 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044269399999999999 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871019+0000", 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041621200000000001 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871065+0000", 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5439999999999999e-05 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871089+0000", 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4386e-05 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:823 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.249646025000001, 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034604840000000002, 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 823 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911296+0000", 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-10T05:55:55.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911300+0000", 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911307+0000", 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5399999999999998e-06 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911312+0000", 2024-09-10T05:55:55.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070000000000003e-06 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911344+0000", 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2203000000000003e-05 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911385+0000", 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1544000000000001e-05 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911481+0000", 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5716000000000003e-05 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911947+0000", 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000466327 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914701+0000", 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002753307 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914732+0000", 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1393000000000003e-05 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914756+0000", 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3842e-05 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:883 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.222856389, 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00325596, 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 883 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938086+0000", 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4399999999999999e-07 2024-09-10T05:55:55.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938090+0000", 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0069999999999999e-06 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938099+0000", 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6190000000000006e-06 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938105+0000", 2024-09-10T05:55:55.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0989999999999998e-06 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938159+0000", 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4317000000000002e-05 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938233+0000", 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4317e-05 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938395+0000", 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016220300000000001 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938964+0000", 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056826499999999998 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941280+0000", 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002316196 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941315+0000", 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5193e-05 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941341+0000", 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5999999999999998e-05 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.309 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:888 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.221642494000001, 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004820525, 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 888 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939300+0000", 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.032e-06 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939307+0000", 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.827e-06 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939318+0000", 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1105e-05 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939323+0000", 2024-09-10T05:55:55.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939374+0000", 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1232e-05 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939437+0000", 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2472999999999996e-05 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939576+0000", 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138837 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.940035+0000", 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000459414 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944026+0000", 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003990352 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944074+0000", 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8417000000000001e-05 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944120+0000", 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5516000000000003e-05 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.315 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1072 6.16 6:6d4431ed:lc::lc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.138515400999999, 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048653860000000002, 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022427+0000", 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022431+0000", 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4520000000000002e-06 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022439+0000", 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8419999999999994e-06 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022444+0000", 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:55:55.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022495+0000", 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1314999999999999e-05 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022589+0000", 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3917000000000002e-05 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:55.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022781+0000", 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000192158 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.023273+0000", 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049226000000000001 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027217+0000", 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039431780000000003 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027248+0000", 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1248999999999998e-05 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027291+0000", 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3677000000000002e-05 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.321 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:55.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:55:55.323 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:55.322+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:55.424 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:55.422+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:55.451 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:55.451 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:55.451 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:55.451 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:55.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:55:55.525 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:55.522+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:55.585 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:55.585 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:55.585 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:55.585 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:55.585 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:55.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:55:55.626 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:55.622+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:55.721 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.166384527000002, 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:55:55.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:55:55.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:55:55.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.727 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.084638862999999, 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.728 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:55:55.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.034749084000001, 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:55:55.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:55:55.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.740 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.016442216000002, 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:55:55.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.953719495000001, 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:55:55.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:55:55.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:55:55.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:55:55.753 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.948593848000002, 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:55:55.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.943431370999999, 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:55:55.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:55:55.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.766 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:55:55.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.943146206000002, 2024-09-10T05:55:55.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:55:55.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:55:55.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.772 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.93749416, 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:55:55.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:55:55.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:55.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.935170756000002, 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:55:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:55:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.929072337000001, 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:55:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:55:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:55:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.927958370999999, 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:55:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:55:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.892770084999999, 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:55:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:55:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:55:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.886526639, 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:55:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:55:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.882254569000001, 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:55:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.875335774, 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:55:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:55:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:55:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:55:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.871211337999998, 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:55:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:55:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:55:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.809851455, 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:55:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:55:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.803413385999999, 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:55:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:55:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.796142675999999, 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:55:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:55:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:55:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:55:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:55.846 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:55.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:55:55.848 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:55.844+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:55.948 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:55.944+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:56.024 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:56.024 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:56.024 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:56.024 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:56.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:55:56.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:55:56.081 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:56.080+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:56.150 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:56.148+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:56.170 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:56.171 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:56.187 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:56.188 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:56.198 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:56.198 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:56.198 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:56.198 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:56.198 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:56.204 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:56.204 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:56.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:55:56.221 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:56.221 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:56.242 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:56.251 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:56.248+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:56.263 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:56.264 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:56.285 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:56.285 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:56.321 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:56.350 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:56.366 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:56.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:55:56.368 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:56.364+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:56.468 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:56.466+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:56.530 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:56.530 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:56.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:55:56.593 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:56.592+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:56.665 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:56.666 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:56.670 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:56.668+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:56.680 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:55:56.772 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:56.770+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:56.811 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:55:56.846 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:56.847 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:56.862 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:55:56.909 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:56.908+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:56.973 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:56.972+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:56.993 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:56.993 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:57.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:55:57.074 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:57.074+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:57.131 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:57.131 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:57.145 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:55:57.186 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:57.186+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:57.276 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:57.272+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:57.307 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:57.308 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:57.322 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:55:57.377 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:57.374+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:57.441 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:57.441 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:57.455 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:55:57.499 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:57.498+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:57.579 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:57.576+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:57.619 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:57.619 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:57.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:55:57.682 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:57.682+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:57.758 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:57.758 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:57.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:55:57.812 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:55:57.816 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:57.814+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:57.885 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:57.888+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:57.933 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:57.934 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:57.948 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:55:57.984 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:55:57.984+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:58.071 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:58.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:55:58.086 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:55:58.082+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:55:58.190 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:58.186+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:58.251 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:58.251 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:58.265 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:55:58.307 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:58.306+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:58.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:55:58.392 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:58.390+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:58.432 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:58.433 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:58.447 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:55:58.493 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:58.492+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:58.493 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:55:58.493 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:55:58.510 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:55:58.510 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:55:58.526 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:55:58.526 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:55:58.542 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:55:58.543 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:55:58.562 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:55:58.563 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:55:58.581 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:55:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:55:58.593 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:55:58.596+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:55:58.600 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:55:58.601 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:55:58.610 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:55:58.611 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:55:58.620 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:55:58.620 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:55:58.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:55:58.694 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:58.696+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:58.751 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:55:58.751 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:55:58.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:55:58.751 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:55:58.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.751 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:55:58.751 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 51.765174408, 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:55:58.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:55:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:55:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:55:58.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:55:58.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:55:58.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:55:58.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:55:58.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:55:58.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:55:58.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810842952000002, 2024-09-10T05:55:58.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010177393999999999, 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:58.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937121+0000", 2024-09-10T05:55:58.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937122+0000", 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.624e-06 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937136+0000", 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.359e-05 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937157+0000", 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0953000000000001e-05 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937173+0000", 2024-09-10T05:55:58.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5897e-05 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.941996+0000", 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048236349999999997 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942219+0000", 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000222609 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.942422+0000", 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020308500000000001 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946080+0000", 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036577379999999998 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947146+0000", 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001066607 2024-09-10T05:55:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947216+0000", 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9888999999999994e-05 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947298+0000", 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1767000000000005e-05 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810734732999997, 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011563665000000001, 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 44 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937229+0000", 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937230+0000", 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937398+0000", 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016799600000000001 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937424+0000", 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5239999999999999e-05 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937485+0000", 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1029999999999997e-05 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943654+0000", 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006169384 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.943798+0000", 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.944008+0000", 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209562 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947319+0000", 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033113499999999998 2024-09-10T05:55:58.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948656+0000", 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013365849999999999 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948733+0000", 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7082000000000005e-05 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948793+0000", 2024-09-10T05:55:58.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9910000000000001e-05 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810444343999997, 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011644801, 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 45 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937519+0000", 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937521+0000", 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937562+0000", 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1325999999999997e-05 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937586+0000", 2024-09-10T05:55:58.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.427e-05 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937602+0000", 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5393999999999999e-05 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945047+0000", 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007445119 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945167+0000", 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120233 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.945351+0000", 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184599 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948941+0000", 2024-09-10T05:55:58.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035892739999999999 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.948975+0000", 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4459999999999999e-05 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949057+0000", 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1353000000000005e-05 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949164+0000", 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010747999999999999 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.780 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810334740999998, 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012744626, 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937629+0000", 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937630+0000", 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-10T05:55:58.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937640+0000", 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0317e-05 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937660+0000", 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0049000000000001e-05 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937674+0000", 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.401e-05 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946184+0000", 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085092269999999994 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946324+0000", 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013997900000000001 2024-09-10T05:55:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.946567+0000", 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024366899999999999 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949295+0000", 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027277130000000001 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950244+0000", 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00094850000000000002 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950311+0000", 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7972999999999994e-05 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950373+0000", 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1995999999999994e-05 2024-09-10T05:55:58.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810228981999998, 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013893696000000001, 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 47 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937735+0000", 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937736+0000", 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4759999999999999e-06 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937863+0000", 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012669299999999999 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937887+0000", 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4125999999999999e-05 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937904+0000", 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.749e-05 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947400+0000", 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094954949999999996 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947551+0000", 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150929 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.947752+0000", 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020166199999999999 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950521+0000", 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002768969 2024-09-10T05:55:58.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951502+0000", 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000980477 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951571+0000", 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8780000000000002e-05 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951628+0000", 2024-09-10T05:55:58.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7599000000000002e-05 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.810028852999999, 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015425703000000001, 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 48 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937935+0000", 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937936+0000", 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6759999999999999e-06 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937947+0000", 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0507e-05 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937967+0000", 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0137e-05 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.937982+0000", 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4636e-05 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949376+0000", 2024-09-10T05:55:58.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011394235000000001 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949508+0000", 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013255299999999999 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.949708+0000", 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019957199999999999 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953070+0000", 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003362182 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953217+0000", 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146329 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953291+0000", 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4809999999999997e-05 2024-09-10T05:55:58.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953360+0000", 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9066000000000006e-05 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.809958844000001, 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017394456999999999, 2024-09-10T05:55:58.799 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:58.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938005+0000", 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938006+0000", 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.113e-06 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938016+0000", 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7699999999999996e-06 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938034+0000", 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8700000000000001e-05 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938048+0000", 2024-09-10T05:55:58.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3886999999999999e-05 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950635+0000", 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012587167999999999 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950750+0000", 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114146 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.950963+0000", 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021314200000000001 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953193+0000", 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022307519999999999 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955262+0000", 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020683870000000001 2024-09-10T05:55:58.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955335+0000", 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2819999999999997e-05 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955399+0000", 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4572000000000005e-05 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.809885440999999, 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017649246, 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-09-10T05:55:58.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938078+0000", 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938079+0000", 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1799999999999999e-06 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938200+0000", 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120909 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938222+0000", 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2027000000000001e-05 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938238+0000", 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951706+0000", 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013468226 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.951865+0000", 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015928900000000001 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.952072+0000", 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020730499999999999 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955427+0000", 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033544680000000002 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955561+0000", 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000133769 2024-09-10T05:55:58.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955664+0000", 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103037 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955727+0000", 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3706000000000003e-05 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.809698978999997, 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017909134, 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 51 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938265+0000", 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938266+0000", 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.33e-06 2024-09-10T05:55:58.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938278+0000", 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.254e-05 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938297+0000", 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8870000000000001e-05 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938311+0000", 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3976e-05 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953401+0000", 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015089939 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953553+0000", 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000151619 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.953766+0000", 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213456 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955443+0000", 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016762859999999999 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.955961+0000", 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00051787700000000003 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956053+0000", 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2829000000000002e-05 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956174+0000", 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120412 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.809629872999999, 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:55:58.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:55:58.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.571857723000001, 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079199360000000007, 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 67 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.824 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176106+0000", 2024-09-10T05:55:58.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1699999999999998e-07 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176110+0000", 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2660000000000002e-06 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176115+0000", 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0919999999999997e-06 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176120+0000", 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8099999999999997e-06 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179722+0000", 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036025150000000001 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.179836+0000", 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011409299999999999 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.180038+0000", 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000202096 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183798+0000", 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037592139999999999 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183887+0000", 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9087999999999998e-05 2024-09-10T05:55:58.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.183966+0000", 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9034000000000003e-05 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184026+0000", 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0111000000000001e-05 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.571244427000003, 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098813330000000008, 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 69 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176719+0000", 2024-09-10T05:55:58.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176720+0000", 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9599999999999999e-07 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176769+0000", 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9638000000000001e-05 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176780+0000", 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0183000000000001e-05 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176786+0000", 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1020000000000002e-06 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182183+0000", 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053968380000000002 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182329+0000", 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014657900000000001 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.182634+0000", 2024-09-10T05:55:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030473099999999998 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186383+0000", 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037490900000000001 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186466+0000", 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2535999999999997e-05 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186541+0000", 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.572e-05 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186600+0000", 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9219999999999999e-05 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.836 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.571164388, 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010079565, 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 70 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176799+0000", 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176800+0000", 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176806+0000", 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9939999999999997e-06 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176815+0000", 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4579999999999999e-06 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176824+0000", 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8729999999999996e-06 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184431+0000", 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076067360000000002 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184549+0000", 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118238 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.184729+0000", 2024-09-10T05:55:58.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017982299999999999 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186702+0000", 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001972999 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186723+0000", 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.101e-05 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186808+0000", 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4363000000000005e-05 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186879+0000", 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1255999999999997e-05 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.842 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.571125326000001, 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013908907999999999, 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 71 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176838+0000", 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176839+0000", 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9500000000000001e-07 2024-09-10T05:55:58.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176844+0000", 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.147e-06 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176854+0000", 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6469999999999993e-06 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176860+0000", 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5119999999999997e-06 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185245+0000", 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083848519999999999 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185389+0000", 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014402600000000001 2024-09-10T05:55:58.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.185703+0000", 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000313935 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189360+0000", 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036563530000000002 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190587+0000", 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001227456 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190677+0000", 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0019000000000007e-05 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190747+0000", 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0166000000000005e-05 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.848 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.571083967, 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015237794000000001, 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.849 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 72 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176880+0000", 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000004e-07 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.176999+0000", 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118935 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177019+0000", 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9337000000000001e-05 2024-09-10T05:55:58.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177029+0000", 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0147e-05 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.186918+0000", 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098897099999999995 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187037+0000", 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011831400000000001 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.187214+0000", 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017770000000000001 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190764+0000", 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035500129999999999 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191969+0000", 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001205036 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192056+0000", 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6929999999999996e-05 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192117+0000", 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1019e-05 2024-09-10T05:55:58.854 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.570914547999998, 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015303199, 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.855 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 73 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177049+0000", 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177050+0000", 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7000000000000004e-07 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177054+0000", 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5430000000000004e-06 2024-09-10T05:55:58.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177061+0000", 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7170000000000002e-06 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177066+0000", 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6140000000000002e-06 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188130+0000", 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011064153 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188276+0000", 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014621600000000001 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.188580+0000", 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030395800000000001 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192139+0000", 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003558627 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192223+0000", 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4056999999999998e-05 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192296+0000", 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3744000000000004e-05 2024-09-10T05:55:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192352+0000", 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5899999999999997e-05 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:58.861 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.570890335000001, 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015532812999999999, 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 74 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:58.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177073+0000", 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177074+0000", 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6100000000000001e-07 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177078+0000", 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4329999999999997e-06 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177087+0000", 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4400000000000005e-06 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177093+0000", 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1489999999999999e-06 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189439+0000", 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012346398999999999 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189611+0000", 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017199199999999999 2024-09-10T05:55:58.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.189927+0000", 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031553499999999998 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192450+0000", 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002522851 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192470+0000", 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0383000000000001e-05 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192542+0000", 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2000000000000002e-05 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192606+0000", 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4170000000000004e-05 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.570833477999997, 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017090899999999999, 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 75 2024-09-10T05:55:58.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177130+0000", 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177131+0000", 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4000000000000001e-07 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177233+0000", 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102378 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177244+0000", 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1032999999999999e-05 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177254+0000", 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9299999999999998e-06 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190840+0000", 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013585488999999999 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.190983+0000", 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014378899999999999 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.191170+0000", 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018661099999999999 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193379+0000", 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002208574 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194090+0000", 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071146999999999996 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194168+0000", 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7770999999999998e-05 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194221+0000", 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3115000000000002e-05 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.570692858999998, 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017505636000000002, 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:55:58.874 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 76 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:55:58.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177271+0000", 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4199999999999995e-07 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177278+0000", 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8569999999999997e-06 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177287+0000", 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0899999999999994e-06 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.177294+0000", 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3099999999999997e-06 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192645+0000", 2024-09-10T05:55:58.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015351205999999999 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192759+0000", 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114194 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.192937+0000", 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178319 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.193807+0000", 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000869841 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194636+0000", 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00082883499999999999 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194713+0000", 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7189999999999998e-05 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:09.194776+0000", 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3052000000000006e-05 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:55:58.880 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:55:58.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:55:58.883 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:58.884+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:58.983 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:55:58.984+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:55:59.015 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:59.015 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:59.015 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:59.029 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:55:59.118 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:59.120+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:59.185 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:59.182+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:59.196 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:59.196 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:59.196 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:59.196 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:59.196 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:59.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:55:59.286 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:55:59.286+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:59.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.765423658, 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:55:59.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:55:59.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.735012040000001, 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039429599999999997, 2024-09-10T05:55:59.390 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 210 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646914+0000", 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646928+0000", 2024-09-10T05:55:59.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.47e-05 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646972+0000", 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3619999999999999e-05 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646995+0000", 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3366999999999998e-05 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647130+0000", 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013420500000000001 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647345+0000", 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647767+0000", 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042202 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.649519+0000", 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017519230000000001 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650567+0000", 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001047755 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650728+0000", 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160896 2024-09-10T05:55:59.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650852+0000", 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124635 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.654126204000001, 2024-09-10T05:55:59.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032374489999999999, 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:59.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727798+0000", 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727810+0000", 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727839+0000", 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9960000000000001e-05 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727857+0000", 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7229999999999999e-05 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727966+0000", 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010930299999999999 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728184+0000", 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021791399999999999 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728656+0000", 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047184000000000001 2024-09-10T05:55:59.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730163+0000", 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015069689999999999 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730830+0000", 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066677499999999998 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730924+0000", 2024-09-10T05:55:59.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4518999999999994e-05 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731033+0000", 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108749 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:272 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:59.402 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.622639170999999, 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038580870000000001, 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 272 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759284+0000", 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.389e-06 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759290+0000", 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2299999999999996e-06 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759306+0000", 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5534999999999999e-05 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759315+0000", 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9749999999999996e-06 2024-09-10T05:55:59.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759390+0000", 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5964999999999995e-05 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759509+0000", 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118069 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759725+0000", 2024-09-10T05:55:59.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021602899999999999 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760294+0000", 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056910499999999998 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763042+0000", 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027483960000000002 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763097+0000", 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4981000000000001e-05 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763140+0000", 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3412999999999999e-05 2024-09-10T05:55:59.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:283 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.621433519, 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003248969, 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 283 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760489+0000", 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.339e-06 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760496+0000", 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760510+0000", 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4630000000000001e-05 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760518+0000", 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429999999999997e-06 2024-09-10T05:55:59.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760590+0000", 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2002000000000006e-05 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760739+0000", 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014892 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760956+0000", 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021756100000000001 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.761617+0000", 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066045600000000002 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763653+0000", 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020359639999999999 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763701+0000", 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8712999999999999e-05 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763737+0000", 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5695000000000003e-05 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:302 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.617286255, 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043845380000000003, 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 302 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764636+0000", 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764641+0000", 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764651+0000", 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0223e-05 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764658+0000", 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764919+0000", 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026097700000000002 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764970+0000", 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1082000000000003e-05 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765083+0000", 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011311000000000001 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765878+0000", 2024-09-10T05:55:59.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079446699999999998 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768931+0000", 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030533190000000001 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768974+0000", 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2815000000000003e-05 2024-09-10T05:55:59.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769020+0000", 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6150999999999999e-05 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.422 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:305 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.616806359999998, 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040725470000000001, 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 305 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765117+0000", 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.491e-06 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765123+0000", 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765139+0000", 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5896000000000002e-05 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765148+0000", 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6719999999999999e-06 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765357+0000", 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020874700000000001 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765441+0000", 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4016000000000003e-05 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765623+0000", 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018151500000000001 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766209+0000", 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000586514 2024-09-10T05:55:59.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769086+0000", 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028770169999999999 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769145+0000", 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8338000000000003e-05 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3173999999999997e-05 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:330 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.612732374, 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044565830000000001, 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 330 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769191+0000", 2024-09-10T05:55:59.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4249999999999999e-06 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769197+0000", 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1190000000000002e-06 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769212+0000", 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5617999999999999e-05 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769224+0000", 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569999999999999e-05 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769282+0000", 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7986999999999999e-05 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769414+0000", 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132485 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769627+0000", 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000212845 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770192+0000", 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056470000000000001 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773540+0000", 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033483739999999999 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773603+0000", 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3096999999999996e-05 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773646+0000", 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2363000000000001e-05 2024-09-10T05:55:59.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:334 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.611850683, 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037038150000000001, 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 334 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770072+0000", 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2810000000000001e-06 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770078+0000", 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2570000000000004e-06 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770093+0000", 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4127e-05 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770099+0000", 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5780000000000004e-06 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770161+0000", 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770231+0000", 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770344+0000", 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113435 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770852+0000", 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050825999999999996 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773708+0000", 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028555310000000001 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773749+0000", 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0719000000000001e-05 2024-09-10T05:55:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773775+0000", 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6066000000000001e-05 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:360 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.606981381000001, 2024-09-10T05:55:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003515392, 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 360 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774941+0000", 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000005e-07 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774946+0000", 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7360000000000001e-06 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774957+0000", 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774969+0000", 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775059+0000", 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0119999999999998e-05 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775147+0000", 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-05 2024-09-10T05:55:59.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775336+0000", 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018901399999999999 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.776189+0000", 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085303699999999996 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778360+0000", 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002170936 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778413+0000", 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3366999999999999e-05 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778456+0000", 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2395000000000003e-05 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.448 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:476 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.573470445000002, 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033473259999999999, 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 476 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:55:59.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808452+0000", 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.105e-06 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808458+0000", 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1430000000000003e-06 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808472+0000", 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3759e-05 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808478+0000", 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3400000000000003e-06 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808555+0000", 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6439000000000005e-05 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808619+0000", 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3649e-05 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808749+0000", 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013027399999999999 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809571+0000", 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082185400000000001 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811686+0000", 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021150959999999999 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811752+0000", 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6085000000000002e-05 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811798+0000", 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6582000000000002e-05 2024-09-10T05:55:59.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:488 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.570001152, 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035493080000000002, 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 488 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811923+0000", 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209999999999999e-06 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811931+0000", 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7849999999999992e-06 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811950+0000", 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8848e-05 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811960+0000", 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0396e-05 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812031+0000", 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0632999999999999e-05 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812181+0000", 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015055900000000001 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812344+0000", 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016297300000000001 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812905+0000", 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056038799999999999 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815344+0000", 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024393520000000001 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815416+0000", 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1985999999999998e-05 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815470+0000", 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3667e-05 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:610 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.529966116000001, 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046567709999999997, 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 610 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851957+0000", 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1850000000000001e-06 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851964+0000", 2024-09-10T05:55:59.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9059999999999996e-06 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851980+0000", 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6725e-05 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851987+0000", 2024-09-10T05:55:59.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852056+0000", 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9453000000000001e-05 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852111+0000", 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5176999999999997e-05 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852250+0000", 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013836600000000001 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852726+0000", 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047576900000000002 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856557+0000", 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038316639999999998 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856586+0000", 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9266999999999999e-05 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856612+0000", 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5738999999999999e-05 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:628 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.523760623000001, 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046452960000000001, 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 628 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858162+0000", 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.083e-06 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858167+0000", 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858180+0000", 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3461e-05 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858187+0000", 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0199999999999997e-06 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858236+0000", 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9005999999999998e-05 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858301+0000", 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4593999999999999e-05 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858421+0000", 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011972399999999999 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858914+0000", 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049326199999999995 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862730+0000", 2024-09-10T05:55:59.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038160120000000001 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862768+0000", 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8550999999999997e-05 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862806+0000", 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725999999999998e-05 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:645 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.516575922000001, 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056225549999999996, 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 645 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865347+0000", 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.015e-06 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865352+0000", 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2390000000000002e-06 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865364+0000", 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865371+0000", 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2249999999999997e-06 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865422+0000", 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0939000000000001e-05 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865510+0000", 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8802999999999997e-05 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865633+0000", 2024-09-10T05:55:59.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012270900000000001 2024-09-10T05:55:59.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866082+0000", 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044930399999999998 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870875+0000", 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047923890000000002 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870929+0000", 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4314999999999998e-05 2024-09-10T05:55:59.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870968+0000", 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9121e-05 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:647 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:59.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.515745315, 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049129430000000003, 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 647 2024-09-10T05:55:59.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866177+0000", 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866182+0000", 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5079999999999999e-06 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866191+0000", 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6520000000000001e-06 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866197+0000", 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4360000000000001e-06 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866247+0000", 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0047999999999999e-05 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866306+0000", 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8910999999999999e-05 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866415+0000", 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010889499999999999 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866857+0000", 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044269399999999999 2024-09-10T05:55:59.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871019+0000", 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041621200000000001 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871065+0000", 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5439999999999999e-05 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871089+0000", 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4386e-05 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:823 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.470626107000001, 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034604840000000002, 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 823 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:59.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911296+0000", 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911300+0000", 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911307+0000", 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5399999999999998e-06 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911312+0000", 2024-09-10T05:55:59.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070000000000003e-06 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911344+0000", 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2203000000000003e-05 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911385+0000", 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1544000000000001e-05 2024-09-10T05:55:59.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911481+0000", 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5716000000000003e-05 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911947+0000", 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000466327 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914701+0000", 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002753307 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914732+0000", 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1393000000000003e-05 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914756+0000", 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3842e-05 2024-09-10T05:55:59.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:883 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.443836471000001, 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00325596, 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.498 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 883 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:55:59.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938086+0000", 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4399999999999999e-07 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938090+0000", 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0069999999999999e-06 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938099+0000", 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6190000000000006e-06 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938105+0000", 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0989999999999998e-06 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938159+0000", 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4317000000000002e-05 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938233+0000", 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4317e-05 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938395+0000", 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016220300000000001 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938964+0000", 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056826499999999998 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941280+0000", 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002316196 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941315+0000", 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5193e-05 2024-09-10T05:55:59.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941341+0000", 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5999999999999998e-05 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:888 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.442622576000002, 2024-09-10T05:55:59.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004820525, 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 888 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939300+0000", 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.032e-06 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939307+0000", 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.827e-06 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939318+0000", 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1105e-05 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939323+0000", 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939374+0000", 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1232e-05 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939437+0000", 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2472999999999996e-05 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939576+0000", 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138837 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.940035+0000", 2024-09-10T05:55:59.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000459414 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944026+0000", 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003990352 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944074+0000", 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8417000000000001e-05 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944120+0000", 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5516000000000003e-05 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1072 6.16 6:6d4431ed:lc::lc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.359495483, 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048653860000000002, 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:55:59.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:55:59.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022427+0000", 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:55:59.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022431+0000", 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4520000000000002e-06 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022439+0000", 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8419999999999994e-06 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022444+0000", 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022495+0000", 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1314999999999999e-05 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022589+0000", 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3917000000000002e-05 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022781+0000", 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000192158 2024-09-10T05:55:59.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.023273+0000", 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049226000000000001 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027217+0000", 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039431780000000003 2024-09-10T05:55:59.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:55:59.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027248+0000", 2024-09-10T05:55:59.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1248999999999998e-05 2024-09-10T05:55:59.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:55:59.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:55:59.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027291+0000", 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3677000000000002e-05 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:55:59.518 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:59.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:55:59.520 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:55:59.518+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:55:59.621 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:59.620+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:59.647 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:59.647 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:59.647 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:55:59.647 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:59.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:55:59.757 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:59.760+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:55:59.823 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:55:59.822+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:55:59.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:55:59.845 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:55:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:55:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:55:59.845 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:55:59.845 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:55:59.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:55:59.945 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:55:59.948+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:00.025 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:00.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.469802625, 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:00.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:00.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.388056961, 2024-09-10T05:56:00.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:00.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:00.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.338167181999999, 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:00.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.319860314, 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:00.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:00.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:00.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.257137592999999, 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:00.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:00.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.252011946, 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:00.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:00.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.246849469000001, 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:00.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:00.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:00.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.246564304, 2024-09-10T05:56:00.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:00.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:00.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:00.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.240912258000002, 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:00.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:00.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.238588854, 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:00.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:00.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:00.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.232490434999999, 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:00.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.231376469000001, 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:00.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:00.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:00.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.196188183, 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:00.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:00.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:00.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.189944737000001, 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:00.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:00.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.185672666999999, 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:00.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:00.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.178753872000001, 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:00.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:00.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:00.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.174629436, 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:00.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:00.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.113269552999999, 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:00.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:00.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.106831484000001, 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:00.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:00.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:00.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:00.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:00.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:00.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.099560774, 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:00.159 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:00.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:00.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:00.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:00.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.166 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:00.167 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:00.022+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:00.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:00.169 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:00.168+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:00.268 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:00.266+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:00.333 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:00.333 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:00.333 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:00.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:00.369 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:00.366+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:00.456 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:00.457 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:00.457 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:00.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:00.471 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:00.472+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:00.571 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:00.570+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:00.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:00.640 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.008931586000003, 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.004020018999999, 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.891526964000001, 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.886679676, 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.882162336, 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.873951014999999, 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.839567195000001, 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.833799195000001, 2024-09-10T05:56:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.833207219999998, 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.829774725, 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.826838782999999, 2024-09-10T05:56:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:00.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.675695049000002, 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:00.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:00.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.732 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.415324196, 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:00.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:00.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:00.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.411303576000002, 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:00.739 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:00.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:00.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:00.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.745 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.401859308999999, 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:00.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:00.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:00.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.397938180000001, 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.752 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:00.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.356945436, 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:00.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:00.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:00.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.27605689, 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.765 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:00.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:00.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.771 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.186416049000002, 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:00.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:00.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.174950024000001, 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:00.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:00.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:00.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:00.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:00.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:00.784 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:00.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:00.787 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:00.788+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:00.842 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:56:00.887 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:00.886+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:00.940 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:00.940 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:00.954 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:00.955 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:00.955 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:00.957 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:00.957 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:00.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:00.974 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:00.974 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:00.988 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:00.986+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:00.991 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:00.992 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:01.012 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:01.013 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:01.034 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:01.054 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:01.054 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:01.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:01.074 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:01.082 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:01.082 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:01.088 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:01.087+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:01.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:01.190 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:01.186+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:01.258 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:01.259 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:01.272 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:01.319 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:01.318+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:01.392 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:01.390+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:01.405 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:01.405 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:01.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:01.506 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:01.506+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:01.586 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:01.586 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:01.593 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:01.590+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:01.600 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:01.694 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:01.695+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:01.767 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:01.767 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:01.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:01.795 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:01.795+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:01.896 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:01.894+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:01.902 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:01.902 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:01.916 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:02.006 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:02.006+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:02.083 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:02.083 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:02.098 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:02.098 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:02.099+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:02.198 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:02.199+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:02.262 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:02.262 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:02.276 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:02.322 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:02.322+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:02.399 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:02.400 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:02.398+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:02.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:02.501 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:02.498+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:02.581 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:02.581 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:02.595 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:02.601 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:02.599+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:02.702 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:02.698+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:02.767 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:02.767 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:02.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:02.802 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:02.803+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:02.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:56:02.918 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:02.919+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:02.945 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:02.945 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:02.959 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:03.004 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:03.003+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:03.077 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:03.078 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:03.092 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:03.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:03.138 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:03.139+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:03.205 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:03.207+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:03.210 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:03.210 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:03.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:03.228 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:03.229 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:03.247 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:03.248 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:03.276 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:03.276 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:03.293 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:03.293 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:03.306 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:03.302+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:03.313 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:03.313 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:03.333 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:03.333 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:03.354 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:03.354 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:03.356 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:03.356 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:03.356 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:03.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:03.374 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:03.374 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:03.407 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:03.406+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:03.486 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:03.486 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:03.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:03.546 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:03.547+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:03.608 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:03.606+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:03.620 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.004234211, 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:56:03.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:56:03.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:56:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.973822593000001, 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039429599999999997, 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 210 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646914+0000", 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646928+0000", 2024-09-10T05:56:03.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.47e-05 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646972+0000", 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3619999999999999e-05 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646995+0000", 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3366999999999998e-05 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647130+0000", 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013420500000000001 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647345+0000", 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647767+0000", 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042202 2024-09-10T05:56:03.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.649519+0000", 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017519230000000001 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650567+0000", 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001047755 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650728+0000", 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160896 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650852+0000", 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124635 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.634 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.892936757000001, 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032374489999999999, 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727798+0000", 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:03.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727810+0000", 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727839+0000", 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9960000000000001e-05 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727857+0000", 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7229999999999999e-05 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727966+0000", 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010930299999999999 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728184+0000", 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021791399999999999 2024-09-10T05:56:03.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728656+0000", 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047184000000000001 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730163+0000", 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015069689999999999 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730830+0000", 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066677499999999998 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730924+0000", 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4518999999999994e-05 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731033+0000", 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108749 2024-09-10T05:56:03.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:272 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.861449724, 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038580870000000001, 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.641 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 272 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759284+0000", 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.389e-06 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759290+0000", 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2299999999999996e-06 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759306+0000", 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5534999999999999e-05 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759315+0000", 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9749999999999996e-06 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759390+0000", 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5964999999999995e-05 2024-09-10T05:56:03.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759509+0000", 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118069 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759725+0000", 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021602899999999999 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760294+0000", 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056910499999999998 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763042+0000", 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027483960000000002 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763097+0000", 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4981000000000001e-05 2024-09-10T05:56:03.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763140+0000", 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3412999999999999e-05 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:283 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.860244072, 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003248969, 2024-09-10T05:56:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 283 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760489+0000", 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.339e-06 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760496+0000", 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760510+0000", 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4630000000000001e-05 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760518+0000", 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429999999999997e-06 2024-09-10T05:56:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760590+0000", 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2002000000000006e-05 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760739+0000", 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014892 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760956+0000", 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021756100000000001 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.761617+0000", 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066045600000000002 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763653+0000", 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020359639999999999 2024-09-10T05:56:03.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763701+0000", 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8712999999999999e-05 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763737+0000", 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5695000000000003e-05 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:302 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.856096808, 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043845380000000003, 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 302 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.654 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764636+0000", 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764641+0000", 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764651+0000", 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0223e-05 2024-09-10T05:56:03.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764658+0000", 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764919+0000", 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026097700000000002 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764970+0000", 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1082000000000003e-05 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765083+0000", 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011311000000000001 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765878+0000", 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079446699999999998 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768931+0000", 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030533190000000001 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768974+0000", 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2815000000000003e-05 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769020+0000", 2024-09-10T05:56:03.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6150999999999999e-05 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:305 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.855616912999999, 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040725470000000001, 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.660 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 305 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765117+0000", 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.491e-06 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765123+0000", 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765139+0000", 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5896000000000002e-05 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765148+0000", 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6719999999999999e-06 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765357+0000", 2024-09-10T05:56:03.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020874700000000001 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765441+0000", 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4016000000000003e-05 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765623+0000", 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018151500000000001 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766209+0000", 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000586514 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769086+0000", 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028770169999999999 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769145+0000", 2024-09-10T05:56:03.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8338000000000003e-05 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3173999999999997e-05 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:330 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:56:03.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.851542927000001, 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044565830000000001, 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 330 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769191+0000", 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4249999999999999e-06 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769197+0000", 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1190000000000002e-06 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769212+0000", 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5617999999999999e-05 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769224+0000", 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569999999999999e-05 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769282+0000", 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7986999999999999e-05 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769414+0000", 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132485 2024-09-10T05:56:03.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769627+0000", 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000212845 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770192+0000", 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056470000000000001 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773540+0000", 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033483739999999999 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773603+0000", 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3096999999999996e-05 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773646+0000", 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2363000000000001e-05 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.672 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:334 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.850661236000001, 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037038150000000001, 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.673 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 334 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770072+0000", 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2810000000000001e-06 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770078+0000", 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2570000000000004e-06 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770093+0000", 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4127e-05 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770099+0000", 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5780000000000004e-06 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770161+0000", 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770231+0000", 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770344+0000", 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113435 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770852+0000", 2024-09-10T05:56:03.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050825999999999996 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773708+0000", 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028555310000000001 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773749+0000", 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0719000000000001e-05 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773775+0000", 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6066000000000001e-05 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:360 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.845791934000001, 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003515392, 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 360 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774941+0000", 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000005e-07 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774946+0000", 2024-09-10T05:56:03.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7360000000000001e-06 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774957+0000", 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774969+0000", 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775059+0000", 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0119999999999998e-05 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775147+0000", 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-05 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775336+0000", 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018901399999999999 2024-09-10T05:56:03.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.776189+0000", 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085303699999999996 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778360+0000", 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002170936 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778413+0000", 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3366999999999999e-05 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778456+0000", 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2395000000000003e-05 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:476 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.812280997999999, 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033473259999999999, 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 476 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808452+0000", 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.105e-06 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808458+0000", 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1430000000000003e-06 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808472+0000", 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3759e-05 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808478+0000", 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3400000000000003e-06 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808555+0000", 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6439000000000005e-05 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808619+0000", 2024-09-10T05:56:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3649e-05 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808749+0000", 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013027399999999999 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809571+0000", 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082185400000000001 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811686+0000", 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021150959999999999 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811752+0000", 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6085000000000002e-05 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811798+0000", 2024-09-10T05:56:03.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6582000000000002e-05 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:488 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.808811705, 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035493080000000002, 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 488 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811923+0000", 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209999999999999e-06 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811931+0000", 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7849999999999992e-06 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811950+0000", 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8848e-05 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811960+0000", 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0396e-05 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812031+0000", 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0632999999999999e-05 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812181+0000", 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015055900000000001 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812344+0000", 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016297300000000001 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812905+0000", 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056038799999999999 2024-09-10T05:56:03.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815344+0000", 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024393520000000001 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815416+0000", 2024-09-10T05:56:03.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1985999999999998e-05 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815470+0000", 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3667e-05 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:610 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.768776669000001, 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046567709999999997, 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 610 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851957+0000", 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1850000000000001e-06 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851964+0000", 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9059999999999996e-06 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851980+0000", 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6725e-05 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851987+0000", 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852056+0000", 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9453000000000001e-05 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852111+0000", 2024-09-10T05:56:03.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5176999999999997e-05 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852250+0000", 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013836600000000001 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852726+0000", 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047576900000000002 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856557+0000", 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038316639999999998 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856586+0000", 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9266999999999999e-05 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856612+0000", 2024-09-10T05:56:03.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5738999999999999e-05 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:628 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.762571176000002, 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046452960000000001, 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.706 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 628 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:56:03.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858162+0000", 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.083e-06 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858167+0000", 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858180+0000", 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3461e-05 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858187+0000", 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0199999999999997e-06 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858236+0000", 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9005999999999998e-05 2024-09-10T05:56:03.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858301+0000", 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4593999999999999e-05 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858421+0000", 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011972399999999999 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858914+0000", 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049326199999999995 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862730+0000", 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038160120000000001 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862768+0000", 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8550999999999997e-05 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862806+0000", 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725999999999998e-05 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:645 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.755386475000002, 2024-09-10T05:56:03.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056225549999999996, 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 645 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:56:03.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865347+0000", 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.015e-06 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865352+0000", 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2390000000000002e-06 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865364+0000", 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865371+0000", 2024-09-10T05:56:03.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2249999999999997e-06 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865422+0000", 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0939000000000001e-05 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865510+0000", 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8802999999999997e-05 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865633+0000", 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012270900000000001 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866082+0000", 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044930399999999998 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870875+0000", 2024-09-10T05:56:03.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047923890000000002 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870929+0000", 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4314999999999998e-05 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870968+0000", 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9121e-05 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:647 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.754555868000001, 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049129430000000003, 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 647 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866177+0000", 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866182+0000", 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5079999999999999e-06 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866191+0000", 2024-09-10T05:56:03.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6520000000000001e-06 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866197+0000", 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4360000000000001e-06 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866247+0000", 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0047999999999999e-05 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866306+0000", 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8910999999999999e-05 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866415+0000", 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010889499999999999 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866857+0000", 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044269399999999999 2024-09-10T05:56:03.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871019+0000", 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041621200000000001 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871065+0000", 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5439999999999999e-05 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871089+0000", 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4386e-05 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:823 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.709436660000001, 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034604840000000002, 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.725 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 823 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911296+0000", 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911300+0000", 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:56:03.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911307+0000", 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5399999999999998e-06 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911312+0000", 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070000000000003e-06 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911344+0000", 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2203000000000003e-05 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911385+0000", 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1544000000000001e-05 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911481+0000", 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5716000000000003e-05 2024-09-10T05:56:03.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911947+0000", 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000466327 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914701+0000", 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002753307 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914732+0000", 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1393000000000003e-05 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914756+0000", 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3842e-05 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.731 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:883 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.682647024000001, 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00325596, 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 883 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938086+0000", 2024-09-10T05:56:03.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4399999999999999e-07 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938090+0000", 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0069999999999999e-06 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938099+0000", 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6190000000000006e-06 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938105+0000", 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0989999999999998e-06 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938159+0000", 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4317000000000002e-05 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938233+0000", 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4317e-05 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938395+0000", 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016220300000000001 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938964+0000", 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056826499999999998 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941280+0000", 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002316196 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941315+0000", 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5193e-05 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941341+0000", 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5999999999999998e-05 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.737 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:888 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.681433128999998, 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004820525, 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.738 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 888 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939300+0000", 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.032e-06 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939307+0000", 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.827e-06 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939318+0000", 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1105e-05 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939323+0000", 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939374+0000", 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1232e-05 2024-09-10T05:56:03.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939437+0000", 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2472999999999996e-05 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939576+0000", 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138837 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.940035+0000", 2024-09-10T05:56:03.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000459414 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944026+0000", 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003990352 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944074+0000", 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8417000000000001e-05 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944120+0000", 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5516000000000003e-05 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1072 6.16 6:6d4431ed:lc::lc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.598306036, 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048653860000000002, 2024-09-10T05:56:03.744 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022427+0000", 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022431+0000", 2024-09-10T05:56:03.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4520000000000002e-06 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022439+0000", 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8419999999999994e-06 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022444+0000", 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022495+0000", 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1314999999999999e-05 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022589+0000", 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3917000000000002e-05 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022781+0000", 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000192158 2024-09-10T05:56:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.023273+0000", 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049226000000000001 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027217+0000", 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039431780000000003 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:03.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027248+0000", 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1248999999999998e-05 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027291+0000", 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3677000000000002e-05 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:03.750 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:03.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:03.752 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:03.750+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:03.853 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:03.851+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:56:03.915 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:03.916 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:03.916 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:03.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:03.954 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:03.950+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:04.055 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:04.054+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:04.091 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:04.092 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:04.092 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:04.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:04.156 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:04.154+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:04.235 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:04.235 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.678550915999999, 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:04.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:04.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.596805251999999, 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:04.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:04.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.546915472999999, 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:04.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:04.253 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.528608604999999, 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.254 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:04.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:04.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:04.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.465885883999999, 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.260 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:04.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.460760236999999, 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:04.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:04.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.45559776, 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.272 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:04.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:04.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:04.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.455312594999999, 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:04.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:04.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.449660549000001, 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.285 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:04.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.290 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.447337144999999, 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:04.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:04.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:04.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.441238726000002, 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:04.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:04.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.44012476, 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:04.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:04.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:04.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:04.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.404936473999999, 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:04.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:04.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.398693028, 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:04.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:04.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:04.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.394420958000001, 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:04.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:04.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.387502163000001, 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:04.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:04.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.383377726999999, 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:04.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:04.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:04.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.322017844000001, 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:04.341 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:04.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:04.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.315579775, 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:04.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:04.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.308309065, 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:04.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:04.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:04.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.360 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.360 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:04.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:04.362 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:04.358+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:04.462 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:04.463+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:04.492 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:04.492 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:04.492 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:04.506 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:04.563 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:04.562+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:04.664 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:04.663+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:04.668 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:04.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:04.668 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:04.668 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:04.668 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:04.681 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:04.766 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:04.762+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:04.843 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.211430933000003, 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:04.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.849 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.206519366000002, 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:04.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:04.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.094026311, 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:04.857 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:04.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:04.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:04.864 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.089179023, 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:04.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.084661683, 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:04.871 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:04.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.076450361999999, 2024-09-10T05:56:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:04.880 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:04.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:04.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.042066542000001, 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.887 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:04.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:04.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.893 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.036298542000001, 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.894 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:04.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:04.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.035706566999998, 2024-09-10T05:56:04.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:04.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:04.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.032274072, 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.908 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:04.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:04.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:04.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:04.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.029338129999999, 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:04.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.878194396000001, 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.922 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:04.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.617823543, 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:04.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:04.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.613802923000001, 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:04.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:04.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.604358655999999, 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:04.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:04.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.600437527, 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:04.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:04.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:04.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.559444783, 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:04.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:04.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:04.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.478556236999999, 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:04.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.388915396000002, 2024-09-10T05:56:04.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:04.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.377449371000001, 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:04.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:04.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:04.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:04.985 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:04.986 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:04.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:04.987 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:04.987+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:05.088 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:05.086+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:05.168 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:05.168 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:05.168 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:05.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:05.230 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:05.231+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:05.290 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:05.286+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:05.295 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:05.295 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:05.295 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:05.295 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:05.295 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:05.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:05.391 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:05.390+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:05.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.851648625999999, 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.802445817999999, 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.761387949, 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.754664866999999, 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030436529999999999, 2024-09-10T05:56:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 229 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724529+0000", 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4059999999999999e-06 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724540+0000", 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1474000000000001e-05 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724570+0000", 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9765999999999999e-05 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724585+0000", 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5126999999999999e-05 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724692+0000", 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010668200000000001 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724902+0000", 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020998800000000001 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.725307+0000", 2024-09-10T05:56:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040542099999999999 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.726637+0000", 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013293059999999999 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727416+0000", 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077963800000000003 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727503+0000", 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6881999999999999e-05 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727570+0000", 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6963000000000002e-05 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.747972407999999, 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.682383156, 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.678359297, 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.677791729999999, 2024-09-10T05:56:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.660499143999999, 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.644173295000002, 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.567038582999999, 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.561037191, 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:05.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.532389967, 2024-09-10T05:56:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.524199747000001, 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.458562259000001, 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.451802444999998, 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.447973235999999, 2024-09-10T05:56:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.334959673, 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.261309881999999, 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:05.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:05.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 31.140617385999999, 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:05.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:05.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:05.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:05.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:05.614 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:05.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:05.616 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:05.617 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:05.617 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:05.617 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:05.618 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:05.618 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:05.618 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:05.618 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:05.619 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:05.619 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:05.619 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:05.614+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:05.623 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:05.623 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:05.642 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:05.643 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:05.663 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:05.663 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:05.716 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:05.714+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:05.750 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:05.750 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:05.764 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:05.854 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:05.854+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:05.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:56:05.918 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:05.914+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:05.936 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:05.936 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:05.950 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:06.019 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:06.019+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:06.119 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:06.119 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:06.120 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:06.118+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:06.133 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:06.220 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:06.219+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:06.297 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:06.297 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:06.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:06.321 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:06.319+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:06.422 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:06.423+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:06.431 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:06.432 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:06.446 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:06.523 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:06.522+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:06.570 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:06.571 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:06.586 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:06.624 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:06.623+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:06.725 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:06.722+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:06.756 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:06.756 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:06.770 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:06.859 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:06.858+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:56:06.934 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:06.935+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:06.940 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:06.940 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:06.954 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:07.027 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:07.027+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:07.125 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:07.126 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:07.131 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:07.127+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:07.143 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:07.229 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:07.226+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:07.266 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:07.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:07.366 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:07.366+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:07.431 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:07.431+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:07.444 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:07.444 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:07.458 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:07.531 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:07.531+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:07.629 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:07.630 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:07.633 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:07.631+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:07.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:07.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:07.734 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:07.735+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:07.765 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:07.765 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:07.784 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:07.828 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:07.829 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:07.835 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:07.835+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:07.863 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:07.882 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:07.903 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:07.904 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:07.925 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:07.925 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:07.936 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:07.935+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:07.945 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:07.946 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:07.946 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:07.946 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:07.946 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:07.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:07.966 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:07.967 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:08.037 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:08.034+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.468772080999997, 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:56:08.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:56:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.438360463000002, 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039429599999999997, 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 210 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646910+0000", 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646914+0000", 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.25e-06 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646928+0000", 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.47e-05 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646972+0000", 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3619999999999999e-05 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.646995+0000", 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3366999999999998e-05 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647130+0000", 2024-09-10T05:56:08.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013420500000000001 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647345+0000", 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000215589 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.647767+0000", 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042202 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.649519+0000", 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017519230000000001 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650567+0000", 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001047755 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650728+0000", 2024-09-10T05:56:08.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000160896 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.650852+0000", 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124635 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:56:08.100 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.357474627000002, 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032374489999999999, 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 230 2024-09-10T05:56:08.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727795+0000", 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727798+0000", 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727810+0000", 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1446e-05 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727839+0000", 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9960000000000001e-05 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727857+0000", 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7229999999999999e-05 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727966+0000", 2024-09-10T05:56:08.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010930299999999999 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728184+0000", 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021791399999999999 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.728656+0000", 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047184000000000001 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730163+0000", 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015069689999999999 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730830+0000", 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066677499999999998 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.730924+0000", 2024-09-10T05:56:08.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4518999999999994e-05 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731033+0000", 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108749 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:272 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:56:08.107 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.325987593999997, 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038580870000000001, 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 272 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759282+0000", 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759284+0000", 2024-09-10T05:56:08.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.389e-06 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759290+0000", 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2299999999999996e-06 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759306+0000", 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5534999999999999e-05 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759315+0000", 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9749999999999996e-06 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759390+0000", 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5964999999999995e-05 2024-09-10T05:56:08.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759509+0000", 2024-09-10T05:56:08.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118069 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.759725+0000", 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021602899999999999 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760294+0000", 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056910499999999998 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763042+0000", 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027483960000000002 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763097+0000", 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4981000000000001e-05 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763140+0000", 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3412999999999999e-05 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:283 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.324781942000001, 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003248969, 2024-09-10T05:56:08.115 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 283 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760488+0000", 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760489+0000", 2024-09-10T05:56:08.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.339e-06 2024-09-10T05:56:08.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760496+0000", 2024-09-10T05:56:08.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.246e-06 2024-09-10T05:56:08.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760510+0000", 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4630000000000001e-05 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760518+0000", 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4429999999999997e-06 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760590+0000", 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2002000000000006e-05 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760739+0000", 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014892 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760956+0000", 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021756100000000001 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.761617+0000", 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00066045600000000002 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763653+0000", 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020359639999999999 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763701+0000", 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8712999999999999e-05 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.763737+0000", 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5695000000000003e-05 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:302 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.320634677999998, 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043845380000000003, 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 302 2024-09-10T05:56:08.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764635+0000", 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764636+0000", 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764641+0000", 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6580000000000001e-06 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764651+0000", 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0223e-05 2024-09-10T05:56:08.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764658+0000", 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9009999999999997e-06 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764919+0000", 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026097700000000002 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.764970+0000", 2024-09-10T05:56:08.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1082000000000003e-05 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765083+0000", 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011311000000000001 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765878+0000", 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079446699999999998 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768931+0000", 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030533190000000001 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768974+0000", 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2815000000000003e-05 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769020+0000", 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6150999999999999e-05 2024-09-10T05:56:08.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:305 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.320154783, 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040725470000000001, 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 305 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765115+0000", 2024-09-10T05:56:08.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765117+0000", 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.491e-06 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765123+0000", 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1670000000000004e-06 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765139+0000", 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5896000000000002e-05 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765148+0000", 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6719999999999999e-06 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765357+0000", 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020874700000000001 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765441+0000", 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4016000000000003e-05 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765623+0000", 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018151500000000001 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766209+0000", 2024-09-10T05:56:08.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000586514 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769086+0000", 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028770169999999999 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769145+0000", 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8338000000000003e-05 2024-09-10T05:56:08.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3173999999999997e-05 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:330 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.316080796999998, 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044565830000000001, 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 330 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769189+0000", 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769191+0000", 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4249999999999999e-06 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769197+0000", 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1190000000000002e-06 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769212+0000", 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5617999999999999e-05 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769224+0000", 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1569999999999999e-05 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769282+0000", 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7986999999999999e-05 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769414+0000", 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000132485 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769627+0000", 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000212845 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770192+0000", 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056470000000000001 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773540+0000", 2024-09-10T05:56:08.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033483739999999999 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773603+0000", 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3096999999999996e-05 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773646+0000", 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2363000000000001e-05 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:334 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.315199106000001, 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037038150000000001, 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 334 2024-09-10T05:56:08.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770071+0000", 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770072+0000", 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2810000000000001e-06 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770078+0000", 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2570000000000004e-06 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770093+0000", 2024-09-10T05:56:08.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4127e-05 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770099+0000", 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5780000000000004e-06 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770161+0000", 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770231+0000", 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770344+0000", 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113435 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.770852+0000", 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050825999999999996 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773708+0000", 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028555310000000001 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773749+0000", 2024-09-10T05:56:08.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0719000000000001e-05 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773775+0000", 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6066000000000001e-05 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:360 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:56:08.149 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.310329803999998, 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003515392, 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 360 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774940+0000", 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774941+0000", 2024-09-10T05:56:08.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6600000000000005e-07 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774946+0000", 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7360000000000001e-06 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774957+0000", 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0905e-05 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774969+0000", 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775059+0000", 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0119999999999998e-05 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775147+0000", 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7520000000000002e-05 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775336+0000", 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018901399999999999 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.776189+0000", 2024-09-10T05:56:08.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085303699999999996 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778360+0000", 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002170936 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778413+0000", 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3366999999999999e-05 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.778456+0000", 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2395000000000003e-05 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:476 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.276818867999999, 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033473259999999999, 2024-09-10T05:56:08.156 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 476 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:56:08.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808451+0000", 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808452+0000", 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.105e-06 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808458+0000", 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1430000000000003e-06 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808472+0000", 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3759e-05 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808478+0000", 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3400000000000003e-06 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808555+0000", 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6439000000000005e-05 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808619+0000", 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3649e-05 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808749+0000", 2024-09-10T05:56:08.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013027399999999999 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809571+0000", 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00082185400000000001 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811686+0000", 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021150959999999999 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811752+0000", 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6085000000000002e-05 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811798+0000", 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6582000000000002e-05 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:488 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.273349574999997, 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035493080000000002, 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 488 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811920+0000", 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811923+0000", 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209999999999999e-06 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811931+0000", 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7849999999999992e-06 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811950+0000", 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8848e-05 2024-09-10T05:56:08.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811960+0000", 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0396e-05 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812031+0000", 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0632999999999999e-05 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812181+0000", 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015055900000000001 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812344+0000", 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016297300000000001 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812905+0000", 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056038799999999999 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815344+0000", 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024393520000000001 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815416+0000", 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1985999999999998e-05 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.815470+0000", 2024-09-10T05:56:08.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3667e-05 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:610 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.233314538999998, 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046567709999999997, 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 610 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851955+0000", 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851957+0000", 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1850000000000001e-06 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851964+0000", 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9059999999999996e-06 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851980+0000", 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6725e-05 2024-09-10T05:56:08.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851987+0000", 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5200000000000003e-06 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852056+0000", 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9453000000000001e-05 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852111+0000", 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5176999999999997e-05 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852250+0000", 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013836600000000001 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852726+0000", 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047576900000000002 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856557+0000", 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038316639999999998 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856586+0000", 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9266999999999999e-05 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856612+0000", 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5738999999999999e-05 2024-09-10T05:56:08.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:628 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.227109046000002, 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046452960000000001, 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 628 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858161+0000", 2024-09-10T05:56:08.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858162+0000", 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.083e-06 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858167+0000", 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8570000000000003e-06 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858180+0000", 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3461e-05 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858187+0000", 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0199999999999997e-06 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858236+0000", 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9005999999999998e-05 2024-09-10T05:56:08.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858301+0000", 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4593999999999999e-05 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858421+0000", 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011972399999999999 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.858914+0000", 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049326199999999995 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862730+0000", 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038160120000000001 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862768+0000", 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8550999999999997e-05 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.862806+0000", 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7725999999999998e-05 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:645 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.219924345000003, 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056225549999999996, 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 645 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865346+0000", 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865347+0000", 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.015e-06 2024-09-10T05:56:08.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865352+0000", 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2390000000000002e-06 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865364+0000", 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2496e-05 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865371+0000", 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2249999999999997e-06 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865422+0000", 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0939000000000001e-05 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865510+0000", 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8802999999999997e-05 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.865633+0000", 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012270900000000001 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866082+0000", 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044930399999999998 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870875+0000", 2024-09-10T05:56:08.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047923890000000002 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870929+0000", 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4314999999999998e-05 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.870968+0000", 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9121e-05 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:647 6.16 6:6d4431ed:lc::lc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.219093737999998, 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049129430000000003, 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 647 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866176+0000", 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866177+0000", 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5300000000000003e-07 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866182+0000", 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5079999999999999e-06 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866191+0000", 2024-09-10T05:56:08.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6520000000000001e-06 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866197+0000", 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4360000000000001e-06 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866247+0000", 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0047999999999999e-05 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866306+0000", 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8910999999999999e-05 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866415+0000", 2024-09-10T05:56:08.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010889499999999999 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.866857+0000", 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044269399999999999 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871019+0000", 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041621200000000001 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871065+0000", 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5439999999999999e-05 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.871089+0000", 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4386e-05 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:823 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.173974530000002, 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034604840000000002, 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 823 2024-09-10T05:56:08.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911295+0000", 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911296+0000", 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6499999999999998e-07 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911300+0000", 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911307+0000", 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5399999999999998e-06 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911312+0000", 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4070000000000003e-06 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911344+0000", 2024-09-10T05:56:08.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2203000000000003e-05 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911385+0000", 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1544000000000001e-05 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911481+0000", 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5716000000000003e-05 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.911947+0000", 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000466327 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914701+0000", 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002753307 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914732+0000", 2024-09-10T05:56:08.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1393000000000003e-05 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.914756+0000", 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3842e-05 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:883 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.147184893999999, 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00325596, 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 883 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938085+0000", 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938086+0000", 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4399999999999999e-07 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938090+0000", 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0069999999999999e-06 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938099+0000", 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6190000000000006e-06 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938105+0000", 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0989999999999998e-06 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938159+0000", 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4317000000000002e-05 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938233+0000", 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4317e-05 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938395+0000", 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016220300000000001 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.938964+0000", 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056826499999999998 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941280+0000", 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002316196 2024-09-10T05:56:08.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941315+0000", 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5193e-05 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.941341+0000", 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5999999999999998e-05 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:888 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.145970998999999, 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004820525, 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 888 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939299+0000", 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939300+0000", 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.032e-06 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939307+0000", 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.827e-06 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939318+0000", 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1105e-05 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939323+0000", 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3199999999999999e-06 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939374+0000", 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1232e-05 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939437+0000", 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2472999999999996e-05 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.939576+0000", 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138837 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.940035+0000", 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000459414 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944026+0000", 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003990352 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944074+0000", 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8417000000000001e-05 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.944120+0000", 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5516000000000003e-05 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1072 6.16 6:6d4431ed:lc::lc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.062843905999998, 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048653860000000002, 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1072 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:56:08.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022426+0000", 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022427+0000", 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:08.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022431+0000", 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4520000000000002e-06 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022439+0000", 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8419999999999994e-06 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022444+0000", 2024-09-10T05:56:08.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022495+0000", 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1314999999999999e-05 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022589+0000", 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3917000000000002e-05 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.022781+0000", 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000192158 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.023273+0000", 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049226000000000001 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027217+0000", 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039431780000000003 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027248+0000", 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1248999999999998e-05 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027291+0000", 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3677000000000002e-05 2024-09-10T05:56:08.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.223 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:08.224 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:08.225 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:08.223+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:08.325 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:08.322+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:08.387 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:08.387 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:08.388 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:08.388 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:08.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:08.430 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:08.426+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:08.519 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:08.519 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:08.519 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:08.519 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:08.519 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:08.531 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:08.530+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:08.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:08.631 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:08.631+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:08.649 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.093371685999998, 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:08.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.655 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.011626022000002, 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.656 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:08.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:08.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.662 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.961736242999997, 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:08.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:08.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:08.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.943429375000001, 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:08.669 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:08.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.880706654000001, 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:08.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:08.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:08.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.682 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.875581007000001, 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:08.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:08.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:08.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.870418530000002, 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:08.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:08.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:08.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:08.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.696 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.870133365000001, 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:08.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:08.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:08.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:08.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.864481318999999, 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:08.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:08.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.862157914999997, 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:08.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.856059496, 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:08.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:08.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:08.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.854945530000002, 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:08.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.819757244000002, 2024-09-10T05:56:08.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:08.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:08.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:08.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.813513798000002, 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:08.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:08.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:08.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.809241728000003, 2024-09-10T05:56:08.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:08.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:08.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:08.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:08.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:08.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:08.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.802322932999999, 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:08.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:08.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:08.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:08.755 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.798198497000001, 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:08.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:08.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:08.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.736838614, 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.762 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:08.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:08.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.768 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.730400545000002, 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:08.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:08.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:08.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.723129835000002, 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:08.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:08.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:08.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:08.781 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:08.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:08.783 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:08.782+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:08.884 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:08.883+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:08.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:56:08.956 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:08.956 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:08.956 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:08.957 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:08.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:09.022 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:09.023+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:09.086 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:09.087+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:09.089 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:09.090 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:09.090 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:09.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:09.194 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:09.195+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:09.261 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.631143172000002, 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.626231605000001, 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.513738549999999, 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.508891261999999, 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.504373921999999, 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.496162601000002, 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.461778781, 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.456010781000003, 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.455418805999997, 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.451986310999999, 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.449050368999998, 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.297906634999997, 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.037535781999999, 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.033515162, 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.024070895000001, 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.020149766000003, 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.979157022000003, 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.898268475999998, 2024-09-10T05:56:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.808627635000001, 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.797161610000003, 2024-09-10T05:56:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.384 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:09.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:09.386 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:09.383+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:09.486 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:09.486+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:09.546 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:09.546 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:09.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:09.602 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:09.603+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:09.676 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:09.676 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:09.688 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:09.686+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:09.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:09.788 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:09.786+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.226364590999999, 2024-09-10T05:56:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.177161783000003, 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.136103914000003, 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.129380832000002, 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030436529999999999, 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 229 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724529+0000", 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4059999999999999e-06 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724540+0000", 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1474000000000001e-05 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724570+0000", 2024-09-10T05:56:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9765999999999999e-05 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724585+0000", 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5126999999999999e-05 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724692+0000", 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010668200000000001 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724902+0000", 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020998800000000001 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.725307+0000", 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040542099999999999 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.726637+0000", 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013293059999999999 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727416+0000", 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077963800000000003 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727503+0000", 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6881999999999999e-05 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727570+0000", 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6963000000000002e-05 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.122688373000003, 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.057099121, 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.053075262, 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.052507695000003, 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.035215108999999, 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.018889260000002, 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.941754547999999, 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.935753155999997, 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.907105932, 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.898915711999997, 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.833278223999997, 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.826518409999998, 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.822689201000003, 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.709675638, 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.636025846999999, 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 35.515333351000002, 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:09.979 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:09.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:09.982 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:56:09.982 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:09.978+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:09.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:10.080 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:10.079+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:10.114 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:10.114 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:10.114 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:10.114 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:10.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:10.132 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:10.148 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:10.148 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:10.164 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:10.164 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:10.181 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:10.181 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:10.181 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:10.178+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:10.197 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:10.198 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:10.216 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:10.216 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:10.234 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:10.234 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:10.252 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:10.252 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:10.256 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:10.256 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:10.270 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:10.310 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:10.311+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:10.382 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:10.383+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:10.439 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:10.439 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:10.453 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:10.499 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:10.498+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:10.571 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:10.572 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:10.584 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:10.582+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:10.586 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:10.685 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:10.683+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:10.752 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:10.752 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:10.766 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:10.810 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:10.810+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:10.884 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:10.884 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:10.887 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:10.886+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:10.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:10.988 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:10.987+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:11.061 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:11.061 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:11.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:11.089 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:11.087+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:11.191 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:11.190+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:11.202 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:11.202 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:11.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:11.302 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:11.302+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:11.375 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:11.375 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:11.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:11.392 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:11.391+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:11.493 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:11.490+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:11.553 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:11.553 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:11.567 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:11.611 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:11.610+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:11.694 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:11.695+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:11.734 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:11.734 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:11.748 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:11.795 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:11.795+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:11.871 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:11.871 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:11.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:11.897 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:11.894+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:11.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:56:11.995 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:11.995 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:11.997 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:11.994+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:12.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:12.102 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:12.103+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:12.199 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:12.198+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:12.208 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:12.208 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:12.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:12.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:12.314 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:12.315+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:12.391 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:12.391 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:12.399 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:12.398+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:12.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:12.456 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:12.456 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:12.472 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:12.497 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:12.497 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:12.500 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:12.499+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:12.513 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:12.513 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:12.545 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:12.545 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:12.577 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:12.577 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:12.599 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:12.599 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:12.601 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:12.598+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:12.611 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:12.612 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:12.612 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:12.612 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:12.623 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:12.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:12.701 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:12.698+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:12.755 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T05:56:12.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-10T05:56:12.799 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:12.800 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:12.800 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:12.801 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:12.798+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:12.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:12.900 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:56:12.905 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:12.902+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:13.003 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:13.003+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:13.018 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:13.018 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.461845609000001, 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.380099944999998, 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.025 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:13.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:13.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.330210166000001, 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:13.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:13.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:13.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.038 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.311903297999997, 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:13.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:13.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.249180576999997, 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:13.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:13.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.244054929999997, 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.238892452999998, 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:13.057 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:13.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.238607287999997, 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.064 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:13.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.069 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.232955242000003, 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:13.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:13.075 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.230631838000001, 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.076 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:13.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:13.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:13.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.082 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.224533418999997, 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:13.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:13.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.223419452999998, 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:13.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:13.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.188231166999998, 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.095 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:13.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:13.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.181987720999999, 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:13.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:13.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.107 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.177715651, 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.108 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:13.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.170796856000003, 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:13.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:13.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:13.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.166672419999998, 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:13.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:13.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:13.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.105312537000003, 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:13.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:13.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.098874467999998, 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:13.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:13.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.091603757999998, 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:13.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.144 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:13.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:13.146 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:13.142+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:13.247 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:13.247+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:13.301 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:13.301 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:13.301 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:13.301 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:13.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:13.348 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:13.346+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:13.448 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:13.447+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:13.470 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:13.470 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:13.470 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:13.487 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:13.574 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:13.575+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:13.650 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:13.651+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.045238888999997, 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:13.678 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.040327322000003, 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.685 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:13.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:13.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.927834267000001, 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:13.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.922986979000001, 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:13.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:13.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:13.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:13.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.918469639000001, 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:13.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:13.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:13.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.910258317999997, 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:13.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:13.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:13.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.875874498000002, 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:13.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.870106497999998, 2024-09-10T05:56:13.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.724 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:13.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:13.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.869514522999999, 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:13.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:13.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:13.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:13.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.866082028000001, 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:13.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.863146086, 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.748 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.712002351999999, 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:13.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:13.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.451631499000001, 2024-09-10T05:56:13.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:13.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:13.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.447610879000003, 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:13.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:13.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:13.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:13.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.438166612000003, 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:13.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:13.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.434245482999998, 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.781 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.393252738999998, 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:13.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:13.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.312364193000001, 2024-09-10T05:56:13.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:13.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.222723352000003, 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.793 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.798 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.211257326999998, 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:13.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:13.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:13.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:13.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:13.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:13.805 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:13.805 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:13.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:13.807 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:13.806+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:13.907 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:13.907+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:13.916 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-10T05:56:13.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-10T05:56:13.974 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:13.974 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:13.974 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:13.974 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:13.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:14.030 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:14.031+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:14.109 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:14.106+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:14.146 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:14.146 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:14.147 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:14.147 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:14.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:14.210 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:14.206+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:14.274 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.646220159999999, 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:14.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:14.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:14.283 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.597017352000002, 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:14.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:14.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:14.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:14.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:14.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:14.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:14.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:14.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.555959483000002, 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:14.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:14.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:14.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:14.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:14.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:14.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:14.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:14.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:14.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:14.303 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.549236401000002, 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030436529999999999, 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 229 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724529+0000", 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4059999999999999e-06 2024-09-10T05:56:14.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724540+0000", 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1474000000000001e-05 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724570+0000", 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9765999999999999e-05 2024-09-10T05:56:14.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724585+0000", 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5126999999999999e-05 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724692+0000", 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010668200000000001 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724902+0000", 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020998800000000001 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.725307+0000", 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040542099999999999 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.726637+0000", 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013293059999999999 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727416+0000", 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077963800000000003 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727503+0000", 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6881999999999999e-05 2024-09-10T05:56:14.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727570+0000", 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6963000000000002e-05 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.542543942000002, 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:14.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:14.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.476954689999999, 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:14.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:14.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:14.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.472930830999999, 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:14.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:14.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:14.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:14.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:14.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.331 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.331 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.472363264000002, 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:14.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:14.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:14.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:14.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:14.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:14.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:14.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:14.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:14.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:14.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:14.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.455070677999998, 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:14.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:14.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.349 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.438744829000001, 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:14.350 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:14.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:14.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:14.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.361610116999998, 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:14.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:14.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:14.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:14.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:14.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:14.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:14.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:14.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.355608725000003, 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:14.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:14.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:14.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.326961501, 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:14.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:14.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:14.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:14.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.318771280999997, 2024-09-10T05:56:14.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:14.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:14.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.253133793000003, 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:14.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:14.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:14.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.246373978999998, 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:14.392 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:14.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:14.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:14.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.242544770000002, 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:14.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.129531206999999, 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.405 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:14.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:14.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:14.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.055881415999998, 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.411 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:14.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:14.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 39.935188920000002, 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:14.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:14.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:14.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:14.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:14.424 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:14.426 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:14.426 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:14.422+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:14.527 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:14.526+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:14.559 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:14.559 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:14.559 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:14.559 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:14.575 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:14.628 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:14.626+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:14.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:14.698 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:14.698 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:14.698 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:14.698 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:14.698 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:14.712 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:14.728 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:14.726+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:14.797 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:14.797 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:14.821 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:14.821 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:14.829 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:14.826+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:14.837 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:14.837 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.278303465999997, 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.218701795999998, 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.188033468999997, 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:278 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.07911146, 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042062799999999997, 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 278 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757174+0000", 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.01e-06 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757188+0000", 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3566e-05 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757220+0000", 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2366000000000001e-05 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757242+0000", 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2123000000000001e-05 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757475+0000", 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232933 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757676+0000", 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201015 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.758046+0000", 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037016700000000002 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.759750+0000", 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001703743 2024-09-10T05:56:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761239+0000", 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001489074 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761318+0000", 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9153000000000006e-05 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761377+0000", 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9129999999999998e-05 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.070085919999997, 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.031926947000002, 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.028986871999997, 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.025686555999997, 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.025462654999998, 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.022231453000003, 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.017627988999998, 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.017299835999999, 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.014694163000001, 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:541 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.010989301999999, 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040888419999999997, 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 541 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825295+0000", 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2240000000000001e-06 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825299+0000", 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.78e-06 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825310+0000", 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0472000000000001e-05 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825318+0000", 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2470000000000008e-06 2024-09-10T05:56:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825389+0000", 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0562000000000006e-05 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825523+0000", 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013447700000000001 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825807+0000", 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028389799999999998 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826735+0000", 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000928399 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829214+0000", 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024790739999999999 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829310+0000", 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5409999999999996e-05 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829382+0000", 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2298999999999993e-05 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:542 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.010805945999998, 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043528350000000002, 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 542 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825478+0000", 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-06 2024-09-10T05:56:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825483+0000", 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5999999999999997e-06 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825492+0000", 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7979999999999995e-06 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825498+0000", 2024-09-10T05:56:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825542+0000", 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3473999999999997e-05 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825612+0000", 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9827999999999996e-05 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825887+0000", 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027574400000000002 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829399+0000", 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035113480000000001 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829709+0000", 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030994399999999999 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829785+0000", 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6397999999999996e-05 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829830+0000", 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499000000000002e-05 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:549 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.008077520999997, 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037770590000000001, 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828206+0000", 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.184e-06 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828213+0000", 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5339999999999996e-06 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828227+0000", 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4364e-05 2024-09-10T05:56:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828235+0000", 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3140000000000004e-06 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828307+0000", 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1069999999999995e-05 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828381+0000", 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3962999999999996e-05 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828634+0000", 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025348699999999999 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831434+0000", 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028002410000000002 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831802+0000", 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000367611 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831907+0000", 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831982+0000", 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5174999999999998e-05 2024-09-10T05:56:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:572 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.998924234999997, 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042700999999999998, 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 572 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837360+0000", 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.852e-06 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837370+0000", 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4320000000000005e-06 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837395+0000", 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4913e-05 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837423+0000", 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.868e-05 2024-09-10T05:56:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837521+0000", 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7781000000000005e-05 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837663+0000", 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141879 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837942+0000", 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027889499999999998 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839924+0000", 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019820860000000001 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841150+0000", 2024-09-10T05:56:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226502 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841232+0000", 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1862999999999999e-05 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841628+0000", 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039621699999999998 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:595 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.992247542999998, 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043611129999999998, 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 595 2024-09-10T05:56:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844037+0000", 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5880000000000001e-06 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844044+0000", 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9999999999999999e-06 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844073+0000", 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9487000000000001e-05 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844085+0000", 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844199+0000", 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113949 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844345+0000", 2024-09-10T05:56:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014550199999999999 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844724+0000", 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037932299999999999 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.846072+0000", 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001348199 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848244+0000", 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002171264 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848328+0000", 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4724999999999999e-05 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848396+0000", 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7896000000000002e-05 2024-09-10T05:56:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.891704707000002, 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.886050711999999, 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:14.959 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:14.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:56:14.961 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:14.961 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:14.962 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:14.962 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:14.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:14.963 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:14.958+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:14.963 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:14.963 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:14.964 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:14.964 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-10T05:56:14.964 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:14.965 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:14.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-10T05:56:15.062 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:15.062+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:15.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:15.163 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:15.162+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:15.264 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:15.262+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:15.276 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:15.276 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:15.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:15.382 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:15.382+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:15.466 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:15.466 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:15.466 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:15.462+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:15.481 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:15.567 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:15.566+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:15.648 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:15.649 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:15.663 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:15.707 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:15.706+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:15.768 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:15.766+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:15.789 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:15.789 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:15.805 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:15.898 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:15.898+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:15.926 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:56:15.936 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-10T05:56:15.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-10T05:56:15.973 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:15.973 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:15.988 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:16.000 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:15.998+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:16.070 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:16.070+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:16.148 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:16.149 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:16.163 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:16.206 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:16.206+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:16.272 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:16.272 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:16.272 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:16.270+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:16.284 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:16.373 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:16.370+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:16.451 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:16.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:16.510 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:16.510+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:16.575 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:16.574+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:16.605 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:16.605 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:16.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:16.710 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:16.710+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:16.777 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:16.774+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:16.805 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:16.805 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:16.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:16.878 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:16.878+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:16.932 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-10T05:56:16.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-10T05:56:16.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:17.002 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:17.002 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:17.003 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:17.002+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:17.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:17.106 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:17.106+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:17.180 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:17.178+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:17.200 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:17.212 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:17.212 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:17.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:17.229 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:17.249 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:17.250 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:17.281 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:17.282 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:17.278+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:17.315 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:17.348 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:17.348 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:17.364 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:17.364 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:17.364 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:17.364 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:17.364 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:17.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:17.382 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:17.382 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:17.382 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:17.382+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:17.415 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:17.415 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:17.483 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:17.482+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:17.492 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:17.492 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:17.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:17.492 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.936491699999998, 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:17.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:17.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.498 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.854746036000002, 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.804856256999997, 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.505 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:17.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:17.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.786549389000001, 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:17.511 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:17.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:17.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:17.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:17.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.723826668000001, 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:17.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:17.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.718701021000001, 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:17.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:17.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.713538544000002, 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:17.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:17.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.713253379000001, 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.537 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:17.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:17.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.707601332999999, 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:17.543 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:17.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.705277928999998, 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.550 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:17.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:17.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.69917951, 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:17.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:17.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:17.561 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.698065544000002, 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:17.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:17.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:17.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.662877258000002, 2024-09-10T05:56:17.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:17.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:17.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.656633812000003, 2024-09-10T05:56:17.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:17.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.652361741999997, 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:17.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:17.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:17.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.645442946999999, 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:17.585 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:17.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:17.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:17.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.641318511000001, 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:17.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.579958628, 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:17.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:17.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.573520559000002, 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.604 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:17.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.566249849000002, 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:17.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:17.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:17.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:17.617 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:17.617 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:17.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:17.619 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:17.618+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:17.718 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:17.718+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:17.819 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:17.818+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:17.834 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:17.834 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:17.834 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:17.834 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:17.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:17.920 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:17.918+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:17.944 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-10T05:56:17.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:56:17.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-10T05:56:18.058 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:18.058+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:18.073 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:18.073 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:18.073 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:18.073 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:18.073 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:18.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:18.122 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:18.118+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:18.223 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:18.222+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:18.311 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:18.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.679422268000003, 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:18.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.674510701000003, 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:18.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:18.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.562017646000001, 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:18.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:18.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.557170358, 2024-09-10T05:56:18.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:18.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.552653018000001, 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:18.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:18.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:18.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.544441697000003, 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:18.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:18.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.349 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.510057877000001, 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:18.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:18.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.504289876999998, 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:18.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:18.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.503697901999999, 2024-09-10T05:56:18.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:18.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:18.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.500265407000001, 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:18.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:18.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:18.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.497329465, 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:18.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.346185730999998, 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:18.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:18.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.085814878000001, 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:18.391 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.081794258000002, 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.392 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:18.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:18.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:18.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.072349991000003, 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:18.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.068428861999998, 2024-09-10T05:56:18.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:18.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:18.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.027436117999997, 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:18.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:18.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.946547572, 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:18.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:18.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:18.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.856906731000002, 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:18.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:18.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:18.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.845440705999998, 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:18.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:18.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:18.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:18.432 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:18.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:18.434 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:18.430+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:18.535 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:18.534+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:18.635 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:18.634+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:18.648 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:18.648 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:18.648 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:18.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:18.736 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:18.734+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:18.837 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:18.834+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:18.878 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:18.878 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:18.878 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:18.878 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:18.878 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:18.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:18.942 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:18.942+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:18.966 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:56:18.966 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-10T05:56:18.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-10T05:56:19.039 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:19.038+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:19.070 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:19.070 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:19.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:19.070 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.441969514999997, 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:19.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:19.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:19.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:19.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:19.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:19.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.392766707, 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:19.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:19.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.351708838, 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.344985756, 2024-09-10T05:56:19.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030436529999999999, 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 229 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724526+0000", 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724529+0000", 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4059999999999999e-06 2024-09-10T05:56:19.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724540+0000", 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1474000000000001e-05 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724570+0000", 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9765999999999999e-05 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724585+0000", 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5126999999999999e-05 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724692+0000", 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010668200000000001 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.724902+0000", 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020998800000000001 2024-09-10T05:56:19.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.725307+0000", 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040542099999999999 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.726637+0000", 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013293059999999999 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727416+0000", 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077963800000000003 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727503+0000", 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6881999999999999e-05 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.727570+0000", 2024-09-10T05:56:19.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6963000000000002e-05 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.338293297, 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:19.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:19.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:19.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.272704044999998, 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:19.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:19.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:19.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:19.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.268680185999997, 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:19.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:19.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:19.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:19.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.268112619, 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:19.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:19.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.250820032999997, 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:19.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:19.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.234494183999999, 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:19.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:19.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.157359472000003, 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.136 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:19.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:19.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.151358080000001, 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:19.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:19.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.122710855999998, 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:19.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:19.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:19.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:19.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:19.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.114520636000002, 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:19.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:19.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.048883148000002, 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:19.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:19.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.042123334000003, 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:19.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:19.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:19.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.038294125, 2024-09-10T05:56:19.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:19.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:19.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.925280561999998, 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:19.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:19.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.851630771000004, 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:19.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:19.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:19.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 44.730938275, 2024-09-10T05:56:19.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:19.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:19.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:19.198 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:19.199 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:19.200 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:19.200 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:19.198+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:19.301 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:19.298+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:19.332 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:19.332 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:19.346 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:19.402 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:19.402+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:19.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:19.504 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:19.502+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:19.512 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:19.512 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:19.513 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:19.513 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:19.526 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:19.604 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:19.602+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:19.638 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:19.639 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:19.669 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:19.669 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.699 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 51.138451592000003, 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.700 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:19.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.078849922000003, 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:19.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.048181595000003, 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:278 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.939259585999999, 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042062799999999997, 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 278 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757174+0000", 2024-09-10T05:56:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.01e-06 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757188+0000", 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3566e-05 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757220+0000", 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2366000000000001e-05 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757242+0000", 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2123000000000001e-05 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757475+0000", 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232933 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757676+0000", 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201015 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.758046+0000", 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037016700000000002 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.759750+0000", 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001703743 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761239+0000", 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001489074 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761318+0000", 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9153000000000006e-05 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761377+0000", 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9129999999999998e-05 2024-09-10T05:56:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.930234046000002, 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.892075073000001, 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.889134998000003, 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.885834682000002, 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.885610780999997, 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.882379579000002, 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.877776115000003, 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.877447961999998, 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:19.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.874842289, 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:541 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.871137427999997, 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040888419999999997, 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.780 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 541 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:19.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825295+0000", 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2240000000000001e-06 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825299+0000", 2024-09-10T05:56:19.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.78e-06 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825310+0000", 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0472000000000001e-05 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825318+0000", 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2470000000000008e-06 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825389+0000", 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0562000000000006e-05 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825523+0000", 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013447700000000001 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825807+0000", 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028389799999999998 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826735+0000", 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000928399 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829214+0000", 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024790739999999999 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829310+0000", 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5409999999999996e-05 2024-09-10T05:56:19.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829382+0000", 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2298999999999993e-05 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:542 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.870954072000004, 2024-09-10T05:56:19.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043528350000000002, 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 542 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825478+0000", 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-06 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825483+0000", 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5999999999999997e-06 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825492+0000", 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7979999999999995e-06 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825498+0000", 2024-09-10T05:56:19.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825542+0000", 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3473999999999997e-05 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825612+0000", 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9827999999999996e-05 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:19.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825887+0000", 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027574400000000002 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829399+0000", 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035113480000000001 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829709+0000", 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030994399999999999 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829785+0000", 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6397999999999996e-05 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829830+0000", 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499000000000002e-05 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.792 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:549 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.868225647000003, 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037770590000000001, 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828206+0000", 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.184e-06 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828213+0000", 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5339999999999996e-06 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828227+0000", 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4364e-05 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828235+0000", 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3140000000000004e-06 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828307+0000", 2024-09-10T05:56:19.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1069999999999995e-05 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828381+0000", 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3962999999999996e-05 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:19.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828634+0000", 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025348699999999999 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831434+0000", 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028002410000000002 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831802+0000", 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000367611 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831907+0000", 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831982+0000", 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5174999999999998e-05 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.799 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:572 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.859072361000003, 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042700999999999998, 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 572 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837360+0000", 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.852e-06 2024-09-10T05:56:19.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837370+0000", 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4320000000000005e-06 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837395+0000", 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4913e-05 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837423+0000", 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.868e-05 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837521+0000", 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7781000000000005e-05 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837663+0000", 2024-09-10T05:56:19.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141879 2024-09-10T05:56:19.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:19.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837942+0000", 2024-09-10T05:56:19.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027889499999999998 2024-09-10T05:56:19.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839924+0000", 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019820860000000001 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841150+0000", 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226502 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841232+0000", 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1862999999999999e-05 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841628+0000", 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039621699999999998 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:595 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.852395669000003, 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043611129999999998, 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 595 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844037+0000", 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5880000000000001e-06 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844044+0000", 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9999999999999999e-06 2024-09-10T05:56:19.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844073+0000", 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9487000000000001e-05 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844085+0000", 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844199+0000", 2024-09-10T05:56:19.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113949 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844345+0000", 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014550199999999999 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844724+0000", 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037932299999999999 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.846072+0000", 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001348199 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848244+0000", 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002171264 2024-09-10T05:56:19.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848328+0000", 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4724999999999999e-05 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848396+0000", 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7896000000000002e-05 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.751852833000001, 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:19.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:19.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.746198837999998, 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:19.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:19.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:19.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:19.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:19.827 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:19.828 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:19.829 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:19.829 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:19.830 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:19.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:19.830 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:19.826+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:19.831 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:19.831 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:19.831 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:19.832 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:19.832 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:19.832 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:19.859 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:19.859 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:19.930 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:19.926+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:19.962 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-10T05:56:19.984 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-10T05:56:19.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:56:20.005 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:20.005 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:20.019 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:20.063 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:20.062+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:20.131 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:20.130+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:20.186 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:20.186 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:20.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:20.246 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:20.246+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:20.323 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:20.324 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:20.333 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:20.330+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:20.337 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:20.434 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:20.430+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:20.503 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:20.503 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:20.521 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:56:20.528 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:56:20.530 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:20.543 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-10T05:56:19.959497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":1040,"num_read_kb":756,"num_write":724,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":68,"num_bytes_recovered":2203,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":682,"ondisk_log_size":682,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":228060,"kb_used_data":5568,"kb_used_omap":10,"kb_used_meta":222325,"kb_avail":660374820,"statfs":{"total":676457349120,"available":676223815680,"internally_reserved":0,"allocated":5701632,"data_stored":3331351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11159,"internal_metadata":227660905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031580"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865300+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:56:15.865300+0000","last_peered":"2024-09-10T05:56:15.865300+0000","last_clean":"2024-09-10T05:56:15.865300+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:56:15.865300+0000","last_undegraded":"2024-09-10T05:56:15.865300+0000","last_fullsized":"2024-09-10T05:56:15.865300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149738+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:56:14.149738+0000","last_peered":"2024-09-10T05:56:14.149738+0000","last_clean":"2024-09-10T05:56:14.149738+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:56:14.149738+0000","last_undegraded":"2024-09-10T05:56:14.149738+0000","last_fullsized":"2024-09-10T05:56:14.149738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963139+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:56:18.963139+0000","last_peered":"2024-09-10T05:56:18.963139+0000","last_clean":"2024-09-10T05:56:18.963139+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:56:18.963139+0000","last_undegraded":"2024-09-10T05:56:18.963139+0000","last_fullsized":"2024-09-10T05:56:18.963139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864179+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:56:15.864179+0000","last_peered":"2024-09-10T05:56:15.864179+0000","last_clean":"2024-09-10T05:56:15.864179+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:56:15.864179+0000","last_undegraded":"2024-09-10T05:56:15.864179+0000","last_fullsized":"2024-09-10T05:56:15.864179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434852+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:56:19.434852+0000","last_peered":"2024-09-10T05:56:19.434852+0000","last_clean":"2024-09-10T05:56:19.434852+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:56:19.434852+0000","last_undegraded":"2024-09-10T05:56:19.434852+0000","last_fullsized":"2024-09-10T05:56:19.434852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432371+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:56:19.432371+0000","last_peered":"2024-09-10T05:56:19.432371+0000","last_clean":"2024-09-10T05:56:19.432371+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:56:19.432371+0000","last_undegraded":"2024-09-10T05:56:19.432371+0000","last_fullsized":"2024-09-10T05:56:19.432371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147520+0000","last_change":"2024-09-10T05:55:43.804731+0000","last_active":"2024-09-10T05:56:14.147520+0000","last_peered":"2024-09-10T05:56:14.147520+0000","last_clean":"2024-09-10T05:56:14.147520+0000","last_became_active":"2024-09-10T05:55:43.803747+0000","last_became_peered":"2024-09-10T05:55:43.803747+0000","last_unstale":"2024-09-10T05:56:14.147520+0000","last_undegraded":"2024-09-10T05:56:14.147520+0000","last_fullsized":"2024-09-10T05:56:14.147520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:30.829033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435178+0000","last_change":"2024-09-10T05:55:43.788656+0000","last_active":"2024-09-10T05:56:19.435178+0000","last_peered":"2024-09-10T05:56:19.435178+0000","last_clean":"2024-09-10T05:56:19.435178+0000","last_became_active":"2024-09-10T05:55:43.788140+0000","last_became_peered":"2024-09-10T05:55:43.788140+0000","last_unstale":"2024-09-10T05:56:19.435178+0000","last_undegraded":"2024-09-10T05:56:19.435178+0000","last_fullsized":"2024-09-10T05:56:19.435178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:48.182521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864452+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:56:15.864452+0000","last_peered":"2024-09-10T05:56:15.864452+0000","last_clean":"2024-09-10T05:56:15.864452+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:56:15.864452+0000","last_undegraded":"2024-09-10T05:56:15.864452+0000","last_fullsized":"2024-09-10T05:56:15.864452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147690+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:56:14.147690+0000","last_peered":"2024-09-10T05:56:14.147690+0000","last_clean":"2024-09-10T05:56:14.147690+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:56:14.147690+0000","last_undegraded":"2024-09-10T05:56:14.147690+0000","last_fullsized":"2024-09-10T05:56:14.147690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146860+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:56:14.146860+0000","last_peered":"2024-09-10T05:56:14.146860+0000","last_clean":"2024-09-10T05:56:14.146860+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:56:14.146860+0000","last_undegraded":"2024-09-10T05:56:14.146860+0000","last_fullsized":"2024-09-10T05:56:14.146860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434365+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:56:19.434365+0000","last_peered":"2024-09-10T05:56:19.434365+0000","last_clean":"2024-09-10T05:56:19.434365+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:56:19.434365+0000","last_undegraded":"2024-09-10T05:56:19.434365+0000","last_fullsized":"2024-09-10T05:56:19.434365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864311+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:56:15.864311+0000","last_peered":"2024-09-10T05:56:15.864311+0000","last_clean":"2024-09-10T05:56:15.864311+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:56:15.864311+0000","last_undegraded":"2024-09-10T05:56:15.864311+0000","last_fullsized":"2024-09-10T05:56:15.864311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150979+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:56:14.150979+0000","last_peered":"2024-09-10T05:56:14.150979+0000","last_clean":"2024-09-10T05:56:14.150979+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:56:14.150979+0000","last_undegraded":"2024-09-10T05:56:14.150979+0000","last_fullsized":"2024-09-10T05:56:14.150979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149972+0000","last_change":"2024-09-10T05:55:43.790799+0000","last_active":"2024-09-10T05:56:14.149972+0000","last_peered":"2024-09-10T05:56:14.149972+0000","last_clean":"2024-09-10T05:56:14.149972+0000","last_became_active":"2024-09-10T05:55:43.789586+0000","last_became_peered":"2024-09-10T05:55:43.789586+0000","last_unstale":"2024-09-10T05:56:14.149972+0000","last_undegraded":"2024-09-10T05:56:14.149972+0000","last_fullsized":"2024-09-10T05:56:14.149972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:40.561423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434804+0000","last_change":"2024-09-10T05:55:43.775788+0000","last_active":"2024-09-10T05:56:19.434804+0000","last_peered":"2024-09-10T05:56:19.434804+0000","last_clean":"2024-09-10T05:56:19.434804+0000","last_became_active":"2024-09-10T05:55:43.775401+0000","last_became_peered":"2024-09-10T05:55:43.775401+0000","last_unstale":"2024-09-10T05:56:19.434804+0000","last_undegraded":"2024-09-10T05:56:19.434804+0000","last_fullsized":"2024-09-10T05:56:19.434804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:15.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428519+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:56:19.428519+0000","last_peered":"2024-09-10T05:56:19.428519+0000","last_clean":"2024-09-10T05:56:19.428519+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:56:19.428519+0000","last_undegraded":"2024-09-10T05:56:19.428519+0000","last_fullsized":"2024-09-10T05:56:19.428519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865365+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:56:15.865365+0000","last_peered":"2024-09-10T05:56:15.865365+0000","last_clean":"2024-09-10T05:56:15.865365+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:56:15.865365+0000","last_undegraded":"2024-09-10T05:56:15.865365+0000","last_fullsized":"2024-09-10T05:56:15.865365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864250+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:56:15.864250+0000","last_peered":"2024-09-10T05:56:15.864250+0000","last_clean":"2024-09-10T05:56:15.864250+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:56:15.864250+0000","last_undegraded":"2024-09-10T05:56:15.864250+0000","last_fullsized":"2024-09-10T05:56:15.864250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148088+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:56:14.148088+0000","last_peered":"2024-09-10T05:56:14.148088+0000","last_clean":"2024-09-10T05:56:14.148088+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:56:14.148088+0000","last_undegraded":"2024-09-10T05:56:14.148088+0000","last_fullsized":"2024-09-10T05:56:14.148088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149762+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:56:14.149762+0000","last_peered":"2024-09-10T05:56:14.149762+0000","last_clean":"2024-09-10T05:56:14.149762+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:56:14.149762+0000","last_undegraded":"2024-09-10T05:56:14.149762+0000","last_fullsized":"2024-09-10T05:56:14.149762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148185+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:56:14.148185+0000","last_peered":"2024-09-10T05:56:14.148185+0000","last_clean":"2024-09-10T05:56:14.148185+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:56:14.148185+0000","last_undegraded":"2024-09-10T05:56:14.148185+0000","last_fullsized":"2024-09-10T05:56:14.148185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432481+0000","last_change":"2024-09-10T05:55:43.773318+0000","last_active":"2024-09-10T05:56:19.432481+0000","last_peered":"2024-09-10T05:56:19.432481+0000","last_clean":"2024-09-10T05:56:19.432481+0000","last_became_active":"2024-09-10T05:55:43.771765+0000","last_became_peered":"2024-09-10T05:55:43.771765+0000","last_unstale":"2024-09-10T05:56:19.432481+0000","last_undegraded":"2024-09-10T05:56:19.432481+0000","last_fullsized":"2024-09-10T05:56:19.432481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:55.396963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434052+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:56:19.434052+0000","last_peered":"2024-09-10T05:56:19.434052+0000","last_clean":"2024-09-10T05:56:19.434052+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:56:19.434052+0000","last_undegraded":"2024-09-10T05:56:19.434052+0000","last_fullsized":"2024-09-10T05:56:19.434052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433265+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:56:19.433265+0000","last_peered":"2024-09-10T05:56:19.433265+0000","last_clean":"2024-09-10T05:56:19.433265+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:56:19.433265+0000","last_undegraded":"2024-09-10T05:56:19.433265+0000","last_fullsized":"2024-09-10T05:56:19.433265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146865+0000","last_change":"2024-09-10T05:55:43.786424+0000","last_active":"2024-09-10T05:56:14.146865+0000","last_peered":"2024-09-10T05:56:14.146865+0000","last_clean":"2024-09-10T05:56:14.146865+0000","last_became_active":"2024-09-10T05:55:43.785736+0000","last_became_peered":"2024-09-10T05:55:43.785736+0000","last_unstale":"2024-09-10T05:56:14.146865+0000","last_undegraded":"2024-09-10T05:56:14.146865+0000","last_fullsized":"2024-09-10T05:56:14.146865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:42.745694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434498+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:56:19.434498+0000","last_peered":"2024-09-10T05:56:19.434498+0000","last_clean":"2024-09-10T05:56:19.434498+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:56:19.434498+0000","last_undegraded":"2024-09-10T05:56:19.434498+0000","last_fullsized":"2024-09-10T05:56:19.434498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435089+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:56:19.435089+0000","last_peered":"2024-09-10T05:56:19.435089+0000","last_clean":"2024-09-10T05:56:19.435089+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:56:19.435089+0000","last_undegraded":"2024-09-10T05:56:19.435089+0000","last_fullsized":"2024-09-10T05:56:19.435089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428252+0000","last_change":"2024-09-10T05:55:43.798168+0000","last_active":"2024-09-10T05:56:19.428252+0000","last_peered":"2024-09-10T05:56:19.428252+0000","last_clean":"2024-09-10T05:56:19.428252+0000","last_became_active":"2024-09-10T05:55:43.797637+0000","last_became_peered":"2024-09-10T05:55:43.797637+0000","last_unstale":"2024-09-10T05:56:19.428252+0000","last_undegraded":"2024-09-10T05:56:19.428252+0000","last_fullsized":"2024-09-10T05:56:19.428252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:56.326108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964920+0000","last_change":"2024-09-10T05:55:43.788530+0000","last_active":"2024-09-10T05:56:18.964920+0000","last_peered":"2024-09-10T05:56:18.964920+0000","last_clean":"2024-09-10T05:56:18.964920+0000","last_became_active":"2024-09-10T05:55:43.788081+0000","last_became_peered":"2024-09-10T05:55:43.788081+0000","last_unstale":"2024-09-10T05:56:18.964920+0000","last_undegraded":"2024-09-10T05:56:18.964920+0000","last_fullsized":"2024-09-10T05:56:18.964920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:23.116687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864607+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:56:15.864607+0000","last_peered":"2024-09-10T05:56:15.864607+0000","last_clean":"2024-09-10T05:56:15.864607+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:56:15.864607+0000","last_undegraded":"2024-09-10T05:56:15.864607+0000","last_fullsized":"2024-09-10T05:56:15.864607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146172+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:56:14.146172+0000","last_peered":"2024-09-10T05:56:14.146172+0000","last_clean":"2024-09-10T05:56:14.146172+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:56:14.146172+0000","last_undegraded":"2024-09-10T05:56:14.146172+0000","last_fullsized":"2024-09-10T05:56:14.146172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"36'21","reported_seq":98,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433985+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:56:19.433985+0000","last_peered":"2024-09-10T05:56:19.433985+0000","last_clean":"2024-09-10T05:56:19.433985+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:56:19.433985+0000","last_undegraded":"2024-09-10T05:56:19.433985+0000","last_fullsized":"2024-09-10T05:56:19.433985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865077+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:56:15.865077+0000","last_peered":"2024-09-10T05:56:15.865077+0000","last_clean":"2024-09-10T05:56:15.865077+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:56:15.865077+0000","last_undegraded":"2024-09-10T05:56:15.865077+0000","last_fullsized":"2024-09-10T05:56:15.865077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145187+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:56:14.145187+0000","last_peered":"2024-09-10T05:56:14.145187+0000","last_clean":"2024-09-10T05:56:14.145187+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:56:14.145187+0000","last_undegraded":"2024-09-10T05:56:14.145187+0000","last_fullsized":"2024-09-10T05:56:14.145187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147092+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:56:14.147092+0000","last_peered":"2024-09-10T05:56:14.147092+0000","last_clean":"2024-09-10T05:56:14.147092+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:56:14.147092+0000","last_undegraded":"2024-09-10T05:56:14.147092+0000","last_fullsized":"2024-09-10T05:56:14.147092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435225+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:56:19.435225+0000","last_peered":"2024-09-10T05:56:19.435225+0000","last_clean":"2024-09-10T05:56:19.435225+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:56:19.435225+0000","last_undegraded":"2024-09-10T05:56:19.435225+0000","last_fullsized":"2024-09-10T05:56:19.435225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863085+0000","last_change":"2024-09-10T05:55:43.781137+0000","last_active":"2024-09-10T05:56:15.863085+0000","last_peered":"2024-09-10T05:56:15.863085+0000","last_clean":"2024-09-10T05:56:15.863085+0000","last_became_active":"2024-09-10T05:55:43.780355+0000","last_became_peered":"2024-09-10T05:55:43.780355+0000","last_unstale":"2024-09-10T05:56:15.863085+0000","last_undegraded":"2024-09-10T05:56:15.863085+0000","last_fullsized":"2024-09-10T05:56:15.863085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:06.200157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.436650+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:56:19.436650+0000","last_peered":"2024-09-10T05:56:19.436650+0000","last_clean":"2024-09-10T05:56:19.436650+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:56:19.436650+0000","last_undegraded":"2024-09-10T05:56:19.436650+0000","last_fullsized":"2024-09-10T05:56:19.436650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434259+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:56:19.434259+0000","last_peered":"2024-09-10T05:56:19.434259+0000","last_clean":"2024-09-10T05:56:19.434259+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:56:19.434259+0000","last_undegraded":"2024-09-10T05:56:19.434259+0000","last_fullsized":"2024-09-10T05:56:19.434259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431377+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:56:19.431377+0000","last_peered":"2024-09-10T05:56:19.431377+0000","last_clean":"2024-09-10T05:56:19.431377+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:56:19.431377+0000","last_undegraded":"2024-09-10T05:56:19.431377+0000","last_fullsized":"2024-09-10T05:56:19.431377+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434504+0000","last_change":"2024-09-10T05:55:43.795909+0000","last_active":"2024-09-10T05:56:19.434504+0000","last_peered":"2024-09-10T05:56:19.434504+0000","last_clean":"2024-09-10T05:56:19.434504+0000","last_became_active":"2024-09-10T05:55:43.795415+0000","last_became_peered":"2024-09-10T05:55:43.795415+0000","last_unstale":"2024-09-10T05:56:19.434504+0000","last_undegraded":"2024-09-10T05:56:19.434504+0000","last_fullsized":"2024-09-10T05:56:19.434504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:03.765583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864362+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:56:15.864362+0000","last_peered":"2024-09-10T05:56:15.864362+0000","last_clean":"2024-09-10T05:56:15.864362+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:56:15.864362+0000","last_undegraded":"2024-09-10T05:56:15.864362+0000","last_fullsized":"2024-09-10T05:56:15.864362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963578+0000","last_change":"2024-09-10T05:55:43.795794+0000","last_active":"2024-09-10T05:56:18.963578+0000","last_peered":"2024-09-10T05:56:18.963578+0000","last_clean":"2024-09-10T05:56:18.963578+0000","last_became_active":"2024-09-10T05:55:43.795416+0000","last_became_peered":"2024-09-10T05:55:43.795416+0000","last_unstale":"2024-09-10T05:56:18.963578+0000","last_undegraded":"2024-09-10T05:56:18.963578+0000","last_fullsized":"2024-09-10T05:56:18.963578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:42.056013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"36'22","reported_seq":97,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433084+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:56:19.433084+0000","last_peered":"2024-09-10T05:56:19.433084+0000","last_clean":"2024-09-10T05:56:19.433084+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:56:19.433084+0000","last_undegraded":"2024-09-10T05:56:19.433084+0000","last_fullsized":"2024-09-10T05:56:19.433084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864699+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:56:15.864699+0000","last_peered":"2024-09-10T05:56:15.864699+0000","last_clean":"2024-09-10T05:56:15.864699+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:56:15.864699+0000","last_undegraded":"2024-09-10T05:56:15.864699+0000","last_fullsized":"2024-09-10T05:56:15.864699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433709+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:56:19.433709+0000","last_peered":"2024-09-10T05:56:19.433709+0000","last_clean":"2024-09-10T05:56:19.433709+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:56:19.433709+0000","last_undegraded":"2024-09-10T05:56:19.433709+0000","last_fullsized":"2024-09-10T05:56:19.433709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865158+0000","last_change":"2024-09-10T05:55:43.784661+0000","last_active":"2024-09-10T05:56:15.865158+0000","last_peered":"2024-09-10T05:56:15.865158+0000","last_clean":"2024-09-10T05:56:15.865158+0000","last_became_active":"2024-09-10T05:55:43.784277+0000","last_became_peered":"2024-09-10T05:55:43.784277+0000","last_unstale":"2024-09-10T05:56:15.865158+0000","last_undegraded":"2024-09-10T05:56:15.865158+0000","last_fullsized":"2024-09-10T05:56:15.865158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:28.154316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144842+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:56:14.144842+0000","last_peered":"2024-09-10T05:56:14.144842+0000","last_clean":"2024-09-10T05:56:14.144842+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:56:14.144842+0000","last_undegraded":"2024-09-10T05:56:14.144842+0000","last_fullsized":"2024-09-10T05:56:14.144842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":59,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150855+0000","last_change":"2024-09-10T05:55:43.761821+0000","last_active":"2024-09-10T05:56:14.150855+0000","last_peered":"2024-09-10T05:56:14.150855+0000","last_clean":"2024-09-10T05:56:14.150855+0000","last_became_active":"2024-09-10T05:55:43.761009+0000","last_became_peered":"2024-09-10T05:55:43.761009+0000","last_unstale":"2024-09-10T05:56:14.150855+0000","last_undegraded":"2024-09-10T05:56:14.150855+0000","last_fullsized":"2024-09-10T05:56:14.150855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:18.510650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'15","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865091+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:56:15.865091+0000","last_peered":"2024-09-10T05:56:15.865091+0000","last_clean":"2024-09-10T05:56:15.865091+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:56:15.865091+0000","last_undegraded":"2024-09-10T05:56:15.865091+0000","last_fullsized":"2024-09-10T05:56:15.865091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"38'3","reported_seq":67,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433000+0000","last_change":"2024-09-10T05:55:43.818014+0000","last_active":"2024-09-10T05:56:19.433000+0000","last_peered":"2024-09-10T05:56:19.433000+0000","last_clean":"2024-09-10T05:56:19.433000+0000","last_became_active":"2024-09-10T05:55:43.775963+0000","last_became_peered":"2024-09-10T05:55:43.775963+0000","last_unstale":"2024-09-10T05:56:19.433000+0000","last_undegraded":"2024-09-10T05:56:19.433000+0000","last_fullsized":"2024-09-10T05:56:19.433000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:00.783230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149973+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:56:14.149973+0000","last_peered":"2024-09-10T05:56:14.149973+0000","last_clean":"2024-09-10T05:56:14.149973+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:56:14.149973+0000","last_undegraded":"2024-09-10T05:56:14.149973+0000","last_fullsized":"2024-09-10T05:56:14.149973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865415+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:56:15.865415+0000","last_peered":"2024-09-10T05:56:15.865415+0000","last_clean":"2024-09-10T05:56:15.865415+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:56:15.865415+0000","last_undegraded":"2024-09-10T05:56:15.865415+0000","last_fullsized":"2024-09-10T05:56:15.865415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863846+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:56:15.863846+0000","last_peered":"2024-09-10T05:56:15.863846+0000","last_clean":"2024-09-10T05:56:15.863846+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:56:15.863846+0000","last_undegraded":"2024-09-10T05:56:15.863846+0000","last_fullsized":"2024-09-10T05:56:15.863846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"36'25","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146126+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:56:14.146126+0000","last_peered":"2024-09-10T05:56:14.146126+0000","last_clean":"2024-09-10T05:56:14.146126+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:56:14.146126+0000","last_undegraded":"2024-09-10T05:56:14.146126+0000","last_fullsized":"2024-09-10T05:56:14.146126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964338+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:56:18.964338+0000","last_peered":"2024-09-10T05:56:18.964338+0000","last_clean":"2024-09-10T05:56:18.964338+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:56:18.964338+0000","last_undegraded":"2024-09-10T05:56:18.964338+0000","last_fullsized":"2024-09-10T05:56:18.964338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146866+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:56:14.146866+0000","last_peered":"2024-09-10T05:56:14.146866+0000","last_clean":"2024-09-10T05:56:14.146866+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:56:14.146866+0000","last_undegraded":"2024-09-10T05:56:14.146866+0000","last_fullsized":"2024-09-10T05:56:14.146866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432700+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:56:19.432700+0000","last_peered":"2024-09-10T05:56:19.432700+0000","last_clean":"2024-09-10T05:56:19.432700+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:56:19.432700+0000","last_undegraded":"2024-09-10T05:56:19.432700+0000","last_fullsized":"2024-09-10T05:56:19.432700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865079+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:56:15.865079+0000","last_peered":"2024-09-10T05:56:15.865079+0000","last_clean":"2024-09-10T05:56:15.865079+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:56:15.865079+0000","last_undegraded":"2024-09-10T05:56:15.865079+0000","last_fullsized":"2024-09-10T05:56:15.865079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430865+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:56:19.430865+0000","last_peered":"2024-09-10T05:56:19.430865+0000","last_clean":"2024-09-10T05:56:19.430865+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:56:19.430865+0000","last_undegraded":"2024-09-10T05:56:19.430865+0000","last_fullsized":"2024-09-10T05:56:19.430865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'15","reported_seq":97,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863948+0000","last_change":"2024-09-10T05:55:43.802630+0000","last_active":"2024-09-10T05:56:15.863948+0000","last_peered":"2024-09-10T05:56:15.863948+0000","last_clean":"2024-09-10T05:56:15.863948+0000","last_became_active":"2024-09-10T05:55:43.773806+0000","last_became_peered":"2024-09-10T05:55:43.773806+0000","last_unstale":"2024-09-10T05:56:15.863948+0000","last_undegraded":"2024-09-10T05:56:15.863948+0000","last_fullsized":"2024-09-10T05:56:15.863948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:59.565736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432016+0000","last_change":"2024-09-10T05:55:43.778724+0000","last_active":"2024-09-10T05:56:19.432016+0000","last_peered":"2024-09-10T05:56:19.432016+0000","last_clean":"2024-09-10T05:56:19.432016+0000","last_became_active":"2024-09-10T05:55:43.777710+0000","last_became_peered":"2024-09-10T05:55:43.777710+0000","last_unstale":"2024-09-10T05:56:19.432016+0000","last_undegraded":"2024-09-10T05:56:19.432016+0000","last_fullsized":"2024-09-10T05:56:19.432016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:20.180853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147038+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:56:14.147038+0000","last_peered":"2024-09-10T05:56:14.147038+0000","last_clean":"2024-09-10T05:56:14.147038+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:56:14.147038+0000","last_undegraded":"2024-09-10T05:56:14.147038+0000","last_fullsized":"2024-09-10T05:56:14.147038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148285+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:56:14.148285+0000","last_peered":"2024-09-10T05:56:14.148285+0000","last_clean":"2024-09-10T05:56:14.148285+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:56:14.148285+0000","last_undegraded":"2024-09-10T05:56:14.148285+0000","last_fullsized":"2024-09-10T05:56:14.148285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865779+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:56:15.865779+0000","last_peered":"2024-09-10T05:56:15.865779+0000","last_clean":"2024-09-10T05:56:15.865779+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:56:15.865779+0000","last_undegraded":"2024-09-10T05:56:15.865779+0000","last_fullsized":"2024-09-10T05:56:15.865779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432760+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:56:19.432760+0000","last_peered":"2024-09-10T05:56:19.432760+0000","last_clean":"2024-09-10T05:56:19.432760+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:56:19.432760+0000","last_undegraded":"2024-09-10T05:56:19.432760+0000","last_fullsized":"2024-09-10T05:56:19.432760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'27","reported_seq":100,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864153+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:56:15.864153+0000","last_peered":"2024-09-10T05:56:15.864153+0000","last_clean":"2024-09-10T05:56:15.864153+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:56:15.864153+0000","last_undegraded":"2024-09-10T05:56:15.864153+0000","last_fullsized":"2024-09-10T05:56:15.864153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435452+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:56:19.435452+0000","last_peered":"2024-09-10T05:56:19.435452+0000","last_clean":"2024-09-10T05:56:19.435452+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:56:19.435452+0000","last_undegraded":"2024-09-10T05:56:19.435452+0000","last_fullsized":"2024-09-10T05:56:19.435452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434065+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:56:19.434065+0000","last_peered":"2024-09-10T05:56:19.434065+0000","last_clean":"2024-09-10T05:56:19.434065+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:56:19.434065+0000","last_undegraded":"2024-09-10T05:56:19.434065+0000","last_fullsized":"2024-09-10T05:56:19.434065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435871+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:56:19.435871+0000","last_peered":"2024-09-10T05:56:19.435871+0000","last_clean":"2024-09-10T05:56:19.435871+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:56:19.435871+0000","last_undegraded":"2024-09-10T05:56:19.435871+0000","last_fullsized":"2024-09-10T05:56:19.435871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148119+0000","last_change":"2024-09-10T05:55:43.782175+0000","last_active":"2024-09-10T05:56:14.148119+0000","last_peered":"2024-09-10T05:56:14.148119+0000","last_clean":"2024-09-10T05:56:14.148119+0000","last_became_active":"2024-09-10T05:55:43.781529+0000","last_became_peered":"2024-09-10T05:55:43.781529+0000","last_unstale":"2024-09-10T05:56:14.148119+0000","last_undegraded":"2024-09-10T05:56:14.148119+0000","last_fullsized":"2024-09-10T05:56:14.148119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:51.726984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432192+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:56:19.432192+0000","last_peered":"2024-09-10T05:56:19.432192+0000","last_clean":"2024-09-10T05:56:19.432192+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:56:19.432192+0000","last_undegraded":"2024-09-10T05:56:19.432192+0000","last_fullsized":"2024-09-10T05:56:19.432192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'24","reported_seq":105,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437613+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:56:19.437613+0000","last_peered":"2024-09-10T05:56:19.437613+0000","last_clean":"2024-09-10T05:56:19.437613+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:56:19.437613+0000","last_undegraded":"2024-09-10T05:56:19.437613+0000","last_fullsized":"2024-09-10T05:56:19.437613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430726+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:56:19.430726+0000","last_peered":"2024-09-10T05:56:19.430726+0000","last_clean":"2024-09-10T05:56:19.430726+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:56:19.430726+0000","last_undegraded":"2024-09-10T05:56:19.430726+0000","last_fullsized":"2024-09-10T05:56:19.430726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963463+0000","last_change":"2024-09-10T05:55:43.791193+0000","last_active":"2024-09-10T05:56:18.963463+0000","last_peered":"2024-09-10T05:56:18.963463+0000","last_clean":"2024-09-10T05:56:18.963463+0000","last_became_active":"2024-09-10T05:55:43.790472+0000","last_became_peered":"2024-09-10T05:55:43.790472+0000","last_unstale":"2024-09-10T05:56:18.963463+0000","last_undegraded":"2024-09-10T05:56:18.963463+0000","last_fullsized":"2024-09-10T05:56:18.963463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434165+0000","last_change":"2024-09-10T05:55:43.760288+0000","last_active":"2024-09-10T05:56:19.434165+0000","last_peered":"2024-09-10T05:56:19.434165+0000","last_clean":"2024-09-10T05:56:19.434165+0000","last_became_active":"2024-09-10T05:55:43.747995+0000","last_became_peered":"2024-09-10T05:55:43.747995+0000","last_unstale":"2024-09-10T05:56:19.434165+0000","last_undegraded":"2024-09-10T05:56:19.434165+0000","last_fullsized":"2024-09-10T05:56:19.434165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:43.892408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435644+0000","last_change":"2024-09-10T05:55:43.782540+0000","last_active":"2024-09-10T05:56:19.435644+0000","last_peered":"2024-09-10T05:56:19.435644+0000","last_clean":"2024-09-10T05:56:19.435644+0000","last_became_active":"2024-09-10T05:55:43.782267+0000","last_became_peered":"2024-09-10T05:55:43.782267+0000","last_unstale":"2024-09-10T05:56:19.435644+0000","last_undegraded":"2024-09-10T05:56:19.435644+0000","last_fullsized":"2024-09-10T05:56:19.435644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:07.747698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433570+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:56:19.433570+0000","last_peered":"2024-09-10T05:56:19.433570+0000","last_clean":"2024-09-10T05:56:19.433570+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:56:19.433570+0000","last_undegraded":"2024-09-10T05:56:19.433570+0000","last_fullsized":"2024-09-10T05:56:19.433570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'19","reported_seq":91,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434346+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:56:19.434346+0000","last_peered":"2024-09-10T05:56:19.434346+0000","last_clean":"2024-09-10T05:56:19.434346+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:56:19.434346+0000","last_undegraded":"2024-09-10T05:56:19.434346+0000","last_fullsized":"2024-09-10T05:56:19.434346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433178+0000","last_change":"2024-09-10T05:55:43.795947+0000","last_active":"2024-09-10T05:56:19.433178+0000","last_peered":"2024-09-10T05:56:19.433178+0000","last_clean":"2024-09-10T05:56:19.433178+0000","last_became_active":"2024-09-10T05:55:43.795420+0000","last_became_peered":"2024-09-10T05:55:43.795420+0000","last_unstale":"2024-09-10T05:56:19.433178+0000","last_undegraded":"2024-09-10T05:56:19.433178+0000","last_fullsized":"2024-09-10T05:56:19.433178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:54.709923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149679+0000","last_change":"2024-09-10T05:55:43.790125+0000","last_active":"2024-09-10T05:56:14.149679+0000","last_peered":"2024-09-10T05:56:14.149679+0000","last_clean":"2024-09-10T05:56:14.149679+0000","last_became_active":"2024-09-10T05:55:43.789048+0000","last_became_peered":"2024-09-10T05:55:43.789048+0000","last_unstale":"2024-09-10T05:56:14.149679+0000","last_undegraded":"2024-09-10T05:56:14.149679+0000","last_fullsized":"2024-09-10T05:56:14.149679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:16.637837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434642+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:56:19.434642+0000","last_peered":"2024-09-10T05:56:19.434642+0000","last_clean":"2024-09-10T05:56:19.434642+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:56:19.434642+0000","last_undegraded":"2024-09-10T05:56:19.434642+0000","last_fullsized":"2024-09-10T05:56:19.434642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148667+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:56:14.148667+0000","last_peered":"2024-09-10T05:56:14.148667+0000","last_clean":"2024-09-10T05:56:14.148667+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:56:14.148667+0000","last_undegraded":"2024-09-10T05:56:14.148667+0000","last_fullsized":"2024-09-10T05:56:14.148667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964831+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:56:18.964831+0000","last_peered":"2024-09-10T05:56:18.964831+0000","last_clean":"2024-09-10T05:56:18.964831+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:56:18.964831+0000","last_undegraded":"2024-09-10T05:56:18.964831+0000","last_fullsized":"2024-09-10T05:56:18.964831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":105,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434641+0000","last_change":"2024-09-10T05:55:43.844826+0000","last_active":"2024-09-10T05:56:19.434641+0000","last_peered":"2024-09-10T05:56:19.434641+0000","last_clean":"2024-09-10T05:56:19.434641+0000","last_became_active":"2024-09-10T05:55:43.784802+0000","last_became_peered":"2024-09-10T05:55:43.784802+0000","last_unstale":"2024-09-10T05:56:19.434641+0000","last_undegraded":"2024-09-10T05:56:19.434641+0000","last_fullsized":"2024-09-10T05:56:19.434641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433996+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:56:19.433996+0000","last_peered":"2024-09-10T05:56:19.433996+0000","last_clean":"2024-09-10T05:56:19.433996+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:56:19.433996+0000","last_undegraded":"2024-09-10T05:56:19.433996+0000","last_fullsized":"2024-09-10T05:56:19.433996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965180+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:56:18.965180+0000","last_peered":"2024-09-10T05:56:18.965180+0000","last_clean":"2024-09-10T05:56:18.965180+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:56:18.965180+0000","last_undegraded":"2024-09-10T05:56:18.965180+0000","last_fullsized":"2024-09-10T05:56:18.965180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434614+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:56:19.434614+0000","last_peered":"2024-09-10T05:56:19.434614+0000","last_clean":"2024-09-10T05:56:19.434614+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:56:19.434614+0000","last_undegraded":"2024-09-10T05:56:19.434614+0000","last_fullsized":"2024-09-10T05:56:19.434614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433738+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:56:19.433738+0000","last_peered":"2024-09-10T05:56:19.433738+0000","last_clean":"2024-09-10T05:56:19.433738+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:56:19.433738+0000","last_undegraded":"2024-09-10T05:56:19.433738+0000","last_fullsized":"2024-09-10T05:56:19.433738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151264+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:56:14.151264+0000","last_peered":"2024-09-10T05:56:14.151264+0000","last_clean":"2024-09-10T05:56:14.151264+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:56:14.151264+0000","last_undegraded":"2024-09-10T05:56:14.151264+0000","last_fullsized":"2024-09-10T05:56:14.151264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":82,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147291+0000","last_change":"2024-09-10T05:55:43.813877+0000","last_active":"2024-09-10T05:56:14.147291+0000","last_peered":"2024-09-10T05:56:14.147291+0000","last_clean":"2024-09-10T05:56:14.147291+0000","last_became_active":"2024-09-10T05:55:43.783681+0000","last_became_peered":"2024-09-10T05:55:43.783681+0000","last_unstale":"2024-09-10T05:56:14.147291+0000","last_undegraded":"2024-09-10T05:56:14.147291+0000","last_fullsized":"2024-09-10T05:56:14.147291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:26.548640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147449+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:56:14.147449+0000","last_peered":"2024-09-10T05:56:14.147449+0000","last_clean":"2024-09-10T05:56:14.147449+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:56:14.147449+0000","last_undegraded":"2024-09-10T05:56:14.147449+0000","last_fullsized":"2024-09-10T05:56:14.147449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432366+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:56:19.432366+0000","last_peered":"2024-09-10T05:56:19.432366+0000","last_clean":"2024-09-10T05:56:19.432366+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:56:19.432366+0000","last_undegraded":"2024-09-10T05:56:19.432366+0000","last_fullsized":"2024-09-10T05:56:19.432366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963718+0000","last_change":"2024-09-10T05:55:43.787138+0000","last_active":"2024-09-10T05:56:18.963718+0000","last_peered":"2024-09-10T05:56:18.963718+0000","last_clean":"2024-09-10T05:56:18.963718+0000","last_became_active":"2024-09-10T05:55:43.786492+0000","last_became_peered":"2024-09-10T05:55:43.786492+0000","last_unstale":"2024-09-10T05:56:18.963718+0000","last_undegraded":"2024-09-10T05:56:18.963718+0000","last_fullsized":"2024-09-10T05:56:18.963718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:45.863027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961604+0000","last_change":"2024-09-10T05:55:43.790575+0000","last_active":"2024-09-10T05:56:18.961604+0000","last_peered":"2024-09-10T05:56:18.961604+0000","last_clean":"2024-09-10T05:56:18.961604+0000","last_became_active":"2024-09-10T05:55:43.790048+0000","last_became_peered":"2024-09-10T05:55:43.790048+0000","last_unstale":"2024-09-10T05:56:18.961604+0000","last_undegraded":"2024-09-10T05:56:18.961604+0000","last_fullsized":"2024-09-10T05:56:18.961604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:56.946415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434471+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:56:19.434471+0000","last_peered":"2024-09-10T05:56:19.434471+0000","last_clean":"2024-09-10T05:56:19.434471+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:56:19.434471+0000","last_undegraded":"2024-09-10T05:56:19.434471+0000","last_fullsized":"2024-09-10T05:56:19.434471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144842+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:56:14.144842+0000","last_peered":"2024-09-10T05:56:14.144842+0000","last_clean":"2024-09-10T05:56:14.144842+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:56:14.144842+0000","last_undegraded":"2024-09-10T05:56:14.144842+0000","last_fullsized":"2024-09-10T05:56:14.144842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147015+0000","last_change":"2024-09-10T05:55:43.805379+0000","last_active":"2024-09-10T05:56:14.147015+0000","last_peered":"2024-09-10T05:56:14.147015+0000","last_clean":"2024-09-10T05:56:14.147015+0000","last_became_active":"2024-09-10T05:55:43.804869+0000","last_became_peered":"2024-09-10T05:55:43.804869+0000","last_unstale":"2024-09-10T05:56:14.147015+0000","last_undegraded":"2024-09-10T05:56:14.147015+0000","last_fullsized":"2024-09-10T05:56:14.147015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:50.109759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961932+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:56:18.961932+0000","last_peered":"2024-09-10T05:56:18.961932+0000","last_clean":"2024-09-10T05:56:18.961932+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:56:18.961932+0000","last_undegraded":"2024-09-10T05:56:18.961932+0000","last_fullsized":"2024-09-10T05:56:18.961932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148001+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:56:14.148001+0000","last_peered":"2024-09-10T05:56:14.148001+0000","last_clean":"2024-09-10T05:56:14.148001+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:56:14.148001+0000","last_undegraded":"2024-09-10T05:56:14.148001+0000","last_fullsized":"2024-09-10T05:56:14.148001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":168,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864183+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:56:15.864183+0000","last_peered":"2024-09-10T05:56:15.864183+0000","last_clean":"2024-09-10T05:56:15.864183+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:56:15.864183+0000","last_undegraded":"2024-09-10T05:56:15.864183+0000","last_fullsized":"2024-09-10T05:56:15.864183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145844+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:56:14.145844+0000","last_peered":"2024-09-10T05:56:14.145844+0000","last_clean":"2024-09-10T05:56:14.145844+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:56:14.145844+0000","last_undegraded":"2024-09-10T05:56:14.145844+0000","last_fullsized":"2024-09-10T05:56:14.145844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146634+0000","last_change":"2024-09-10T05:55:43.771383+0000","last_active":"2024-09-10T05:56:14.146634+0000","last_peered":"2024-09-10T05:56:14.146634+0000","last_clean":"2024-09-10T05:56:14.146634+0000","last_became_active":"2024-09-10T05:55:43.770582+0000","last_became_peered":"2024-09-10T05:55:43.770582+0000","last_unstale":"2024-09-10T05:56:14.146634+0000","last_undegraded":"2024-09-10T05:56:14.146634+0000","last_fullsized":"2024-09-10T05:56:14.146634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:01.378507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864882+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:56:15.864882+0000","last_peered":"2024-09-10T05:56:15.864882+0000","last_clean":"2024-09-10T05:56:15.864882+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:56:15.864882+0000","last_undegraded":"2024-09-10T05:56:15.864882+0000","last_fullsized":"2024-09-10T05:56:15.864882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"36'19","reported_seq":108,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151408+0000","last_change":"2024-09-10T05:55:43.817149+0000","last_active":"2024-09-10T05:56:14.151408+0000","last_peered":"2024-09-10T05:56:14.151408+0000","last_clean":"2024-09-10T05:56:14.151408+0000","last_became_active":"2024-09-10T05:55:43.795185+0000","last_became_peered":"2024-09-10T05:55:43.795185+0000","last_unstale":"2024-09-10T05:56:14.151408+0000","last_undegraded":"2024-09-10T05:56:14.151408+0000","last_fullsized":"2024-09-10T05:56:14.151408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:51.132750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434138+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:56:19.434138+0000","last_peered":"2024-09-10T05:56:19.434138+0000","last_clean":"2024-09-10T05:56:19.434138+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:56:19.434138+0000","last_undegraded":"2024-09-10T05:56:19.434138+0000","last_fullsized":"2024-09-10T05:56:19.434138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145007+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:56:14.145007+0000","last_peered":"2024-09-10T05:56:14.145007+0000","last_clean":"2024-09-10T05:56:14.145007+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:56:14.145007+0000","last_undegraded":"2024-09-10T05:56:14.145007+0000","last_fullsized":"2024-09-10T05:56:14.145007+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434391+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:56:19.434391+0000","last_peered":"2024-09-10T05:56:19.434391+0000","last_clean":"2024-09-10T05:56:19.434391+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:56:19.434391+0000","last_undegraded":"2024-09-10T05:56:19.434391+0000","last_fullsized":"2024-09-10T05:56:19.434391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864038+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:56:15.864038+0000","last_peered":"2024-09-10T05:56:15.864038+0000","last_clean":"2024-09-10T05:56:15.864038+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:56:15.864038+0000","last_undegraded":"2024-09-10T05:56:15.864038+0000","last_fullsized":"2024-09-10T05:56:15.864038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437699+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:56:19.437699+0000","last_peered":"2024-09-10T05:56:19.437699+0000","last_clean":"2024-09-10T05:56:19.437699+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:56:19.437699+0000","last_undegraded":"2024-09-10T05:56:19.437699+0000","last_fullsized":"2024-09-10T05:56:19.437699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151721+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:56:14.151721+0000","last_peered":"2024-09-10T05:56:14.151721+0000","last_clean":"2024-09-10T05:56:14.151721+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:56:14.151721+0000","last_undegraded":"2024-09-10T05:56:14.151721+0000","last_fullsized":"2024-09-10T05:56:14.151721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"36'29","reported_seq":121,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964809+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:56:18.964809+0000","last_peered":"2024-09-10T05:56:18.964809+0000","last_clean":"2024-09-10T05:56:18.964809+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:56:18.964809+0000","last_undegraded":"2024-09-10T05:56:18.964809+0000","last_fullsized":"2024-09-10T05:56:18.964809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865076+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:56:15.865076+0000","last_peered":"2024-09-10T05:56:15.865076+0000","last_clean":"2024-09-10T05:56:15.865076+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:56:15.865076+0000","last_undegraded":"2024-09-10T05:56:15.865076+0000","last_fullsized":"2024-09-10T05:56:15.865076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961173+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:56:18.961173+0000","last_peered":"2024-09-10T05:56:18.961173+0000","last_clean":"2024-09-10T05:56:18.961173+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:56:18.961173+0000","last_undegraded":"2024-09-10T05:56:18.961173+0000","last_fullsized":"2024-09-10T05:56:18.961173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963786+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:56:18.963786+0000","last_peered":"2024-09-10T05:56:18.963786+0000","last_clean":"2024-09-10T05:56:18.963786+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:56:18.963786+0000","last_undegraded":"2024-09-10T05:56:18.963786+0000","last_fullsized":"2024-09-10T05:56:18.963786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431750+0000","last_change":"2024-09-10T05:55:43.773232+0000","last_active":"2024-09-10T05:56:19.431750+0000","last_peered":"2024-09-10T05:56:19.431750+0000","last_clean":"2024-09-10T05:56:19.431750+0000","last_became_active":"2024-09-10T05:55:43.772584+0000","last_became_peered":"2024-09-10T05:55:43.772584+0000","last_unstale":"2024-09-10T05:56:19.431750+0000","last_undegraded":"2024-09-10T05:56:19.431750+0000","last_fullsized":"2024-09-10T05:56:19.431750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:58.886050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961679+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:56:18.961679+0000","last_peered":"2024-09-10T05:56:18.961679+0000","last_clean":"2024-09-10T05:56:18.961679+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:56:18.961679+0000","last_undegraded":"2024-09-10T05:56:18.961679+0000","last_fullsized":"2024-09-10T05:56:18.961679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":63,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434166+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:56:19.434166+0000","last_peered":"2024-09-10T05:56:19.434166+0000","last_clean":"2024-09-10T05:56:19.434166+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:56:19.434166+0000","last_undegraded":"2024-09-10T05:56:19.434166+0000","last_fullsized":"2024-09-10T05:56:19.434166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865408+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:56:15.865408+0000","last_peered":"2024-09-10T05:56:15.865408+0000","last_clean":"2024-09-10T05:56:15.865408+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:56:15.865408+0000","last_undegraded":"2024-09-10T05:56:15.865408+0000","last_fullsized":"2024-09-10T05:56:15.865408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433617+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:56:19.433617+0000","last_peered":"2024-09-10T05:56:19.433617+0000","last_clean":"2024-09-10T05:56:19.433617+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:56:19.433617+0000","last_undegraded":"2024-09-10T05:56:19.433617+0000","last_fullsized":"2024-09-10T05:56:19.433617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433932+0000","last_change":"2024-09-10T05:55:43.767421+0000","last_active":"2024-09-10T05:56:19.433932+0000","last_peered":"2024-09-10T05:56:19.433932+0000","last_clean":"2024-09-10T05:56:19.433932+0000","last_became_active":"2024-09-10T05:55:43.765601+0000","last_became_peered":"2024-09-10T05:55:43.765601+0000","last_unstale":"2024-09-10T05:56:19.433932+0000","last_undegraded":"2024-09-10T05:56:19.433932+0000","last_fullsized":"2024-09-10T05:56:19.433932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:31.389291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964997+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:56:18.964997+0000","last_peered":"2024-09-10T05:56:18.964997+0000","last_clean":"2024-09-10T05:56:18.964997+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:56:18.964997+0000","last_undegraded":"2024-09-10T05:56:18.964997+0000","last_fullsized":"2024-09-10T05:56:18.964997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149073+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:56:14.149073+0000","last_peered":"2024-09-10T05:56:14.149073+0000","last_clean":"2024-09-10T05:56:14.149073+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:56:14.149073+0000","last_undegraded":"2024-09-10T05:56:14.149073+0000","last_fullsized":"2024-09-10T05:56:14.149073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434063+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:56:19.434063+0000","last_peered":"2024-09-10T05:56:19.434063+0000","last_clean":"2024-09-10T05:56:19.434063+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:56:19.434063+0000","last_undegraded":"2024-09-10T05:56:19.434063+0000","last_fullsized":"2024-09-10T05:56:19.434063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434736+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:56:19.434736+0000","last_peered":"2024-09-10T05:56:19.434736+0000","last_clean":"2024-09-10T05:56:19.434736+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:56:19.434736+0000","last_undegraded":"2024-09-10T05:56:19.434736+0000","last_fullsized":"2024-09-10T05:56:19.434736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":96,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434628+0000","last_change":"2024-09-10T05:55:43.822091+0000","last_active":"2024-09-10T05:56:19.434628+0000","last_peered":"2024-09-10T05:56:19.434628+0000","last_clean":"2024-09-10T05:56:19.434628+0000","last_became_active":"2024-09-10T05:55:43.775690+0000","last_became_peered":"2024-09-10T05:55:43.775690+0000","last_unstale":"2024-09-10T05:56:19.434628+0000","last_undegraded":"2024-09-10T05:56:19.434628+0000","last_fullsized":"2024-09-10T05:56:19.434628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:14.882799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":45,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148453+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:56:14.148453+0000","last_peered":"2024-09-10T05:56:14.148453+0000","last_clean":"2024-09-10T05:56:14.148453+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:56:14.148453+0000","last_undegraded":"2024-09-10T05:56:14.148453+0000","last_fullsized":"2024-09-10T05:56:14.148453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149502+0000","last_change":"2024-09-10T05:55:43.804799+0000","last_active":"2024-09-10T05:56:14.149502+0000","last_peered":"2024-09-10T05:56:14.149502+0000","last_clean":"2024-09-10T05:56:14.149502+0000","last_became_active":"2024-09-10T05:55:43.804353+0000","last_became_peered":"2024-09-10T05:55:43.804353+0000","last_unstale":"2024-09-10T05:56:14.149502+0000","last_undegraded":"2024-09-10T05:56:14.149502+0000","last_fullsized":"2024-09-10T05:56:14.149502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:01.726995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431845+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:56:19.431845+0000","last_peered":"2024-09-10T05:56:19.431845+0000","last_clean":"2024-09-10T05:56:19.431845+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:56:19.431845+0000","last_undegraded":"2024-09-10T05:56:19.431845+0000","last_fullsized":"2024-09-10T05:56:19.431845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147565+0000","last_change":"2024-09-10T05:55:43.764072+0000","last_active":"2024-09-10T05:56:14.147565+0000","last_peered":"2024-09-10T05:56:14.147565+0000","last_clean":"2024-09-10T05:56:14.147565+0000","last_became_active":"2024-09-10T05:55:43.763265+0000","last_became_peered":"2024-09-10T05:55:43.763265+0000","last_unstale":"2024-09-10T05:56:14.147565+0000","last_undegraded":"2024-09-10T05:56:14.147565+0000","last_fullsized":"2024-09-10T05:56:14.147565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:04.381491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965212+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:56:18.965212+0000","last_peered":"2024-09-10T05:56:18.965212+0000","last_clean":"2024-09-10T05:56:18.965212+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:56:18.965212+0000","last_undegraded":"2024-09-10T05:56:18.965212+0000","last_fullsized":"2024-09-10T05:56:18.965212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":64,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435333+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:56:19.435333+0000","last_peered":"2024-09-10T05:56:19.435333+0000","last_clean":"2024-09-10T05:56:19.435333+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:56:19.435333+0000","last_undegraded":"2024-09-10T05:56:19.435333+0000","last_fullsized":"2024-09-10T05:56:19.435333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'30","reported_seq":142,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431150+0000","last_change":"2024-09-10T05:55:43.824206+0000","last_active":"2024-09-10T05:56:19.431150+0000","last_peered":"2024-09-10T05:56:19.431150+0000","last_clean":"2024-09-10T05:56:19.431150+0000","last_became_active":"2024-09-10T05:55:43.777118+0000","last_became_peered":"2024-09-10T05:55:43.777118+0000","last_unstale":"2024-09-10T05:56:19.431150+0000","last_undegraded":"2024-09-10T05:56:19.431150+0000","last_fullsized":"2024-09-10T05:56:19.431150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:46.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428351+0000","last_change":"2024-09-10T05:55:43.765816+0000","last_active":"2024-09-10T05:56:19.428351+0000","last_peered":"2024-09-10T05:56:19.428351+0000","last_clean":"2024-09-10T05:56:19.428351+0000","last_became_active":"2024-09-10T05:55:43.761773+0000","last_became_peered":"2024-09-10T05:55:43.761773+0000","last_unstale":"2024-09-10T05:56:19.428351+0000","last_undegraded":"2024-09-10T05:56:19.428351+0000","last_fullsized":"2024-09-10T05:56:19.428351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:13.756785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433864+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:56:19.433864+0000","last_peered":"2024-09-10T05:56:19.433864+0000","last_clean":"2024-09-10T05:56:19.433864+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:56:19.433864+0000","last_undegraded":"2024-09-10T05:56:19.433864+0000","last_fullsized":"2024-09-10T05:56:19.433864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435801+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:56:19.435801+0000","last_peered":"2024-09-10T05:56:19.435801+0000","last_clean":"2024-09-10T05:56:19.435801+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:56:19.435801+0000","last_undegraded":"2024-09-10T05:56:19.435801+0000","last_fullsized":"2024-09-10T05:56:19.435801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965069+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:56:18.965069+0000","last_peered":"2024-09-10T05:56:18.965069+0000","last_clean":"2024-09-10T05:56:18.965069+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:56:18.965069+0000","last_undegraded":"2024-09-10T05:56:18.965069+0000","last_fullsized":"2024-09-10T05:56:18.965069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865986+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:56:15.865986+0000","last_peered":"2024-09-10T05:56:15.865986+0000","last_clean":"2024-09-10T05:56:15.865986+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:56:15.865986+0000","last_undegraded":"2024-09-10T05:56:15.865986+0000","last_fullsized":"2024-09-10T05:56:15.865986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146391+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:56:14.146391+0000","last_peered":"2024-09-10T05:56:14.146391+0000","last_clean":"2024-09-10T05:56:14.146391+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:56:14.146391+0000","last_undegraded":"2024-09-10T05:56:14.146391+0000","last_fullsized":"2024-09-10T05:56:14.146391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":91,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964917+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:56:18.964917+0000","last_peered":"2024-09-10T05:56:18.964917+0000","last_clean":"2024-09-10T05:56:18.964917+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:56:18.964917+0000","last_undegraded":"2024-09-10T05:56:18.964917+0000","last_fullsized":"2024-09-10T05:56:18.964917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149818+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:56:14.149818+0000","last_peered":"2024-09-10T05:56:14.149818+0000","last_clean":"2024-09-10T05:56:14.149818+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:56:14.149818+0000","last_undegraded":"2024-09-10T05:56:14.149818+0000","last_fullsized":"2024-09-10T05:56:14.149818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434727+0000","last_change":"2024-09-10T05:55:43.753889+0000","last_active":"2024-09-10T05:56:19.434727+0000","last_peered":"2024-09-10T05:56:19.434727+0000","last_clean":"2024-09-10T05:56:19.434727+0000","last_became_active":"2024-09-10T05:55:43.753106+0000","last_became_peered":"2024-09-10T05:55:43.753106+0000","last_unstale":"2024-09-10T05:56:19.434727+0000","last_undegraded":"2024-09-10T05:56:19.434727+0000","last_fullsized":"2024-09-10T05:56:19.434727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:07.383551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863784+0000","last_change":"2024-09-10T05:55:43.770735+0000","last_active":"2024-09-10T05:56:15.863784+0000","last_peered":"2024-09-10T05:56:15.863784+0000","last_clean":"2024-09-10T05:56:15.863784+0000","last_became_active":"2024-09-10T05:55:43.768802+0000","last_became_peered":"2024-09-10T05:55:43.768802+0000","last_unstale":"2024-09-10T05:56:15.863784+0000","last_undegraded":"2024-09-10T05:56:15.863784+0000","last_fullsized":"2024-09-10T05:56:15.863784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:01.360943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865192+0000","last_change":"2024-09-10T05:55:43.788377+0000","last_active":"2024-09-10T05:56:15.865192+0000","last_peered":"2024-09-10T05:56:15.865192+0000","last_clean":"2024-09-10T05:56:15.865192+0000","last_became_active":"2024-09-10T05:55:43.784426+0000","last_became_peered":"2024-09-10T05:55:43.784426+0000","last_unstale":"2024-09-10T05:56:15.865192+0000","last_undegraded":"2024-09-10T05:56:15.865192+0000","last_fullsized":"2024-09-10T05:56:15.865192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:14.968924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963210+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:56:18.963210+0000","last_peered":"2024-09-10T05:56:18.963210+0000","last_clean":"2024-09-10T05:56:18.963210+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:56:18.963210+0000","last_undegraded":"2024-09-10T05:56:18.963210+0000","last_fullsized":"2024-09-10T05:56:18.963210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":68,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432307+0000","last_change":"2024-09-10T05:55:43.775857+0000","last_active":"2024-09-10T05:56:19.432307+0000","last_peered":"2024-09-10T05:56:19.432307+0000","last_clean":"2024-09-10T05:56:19.432307+0000","last_became_active":"2024-09-10T05:55:43.775153+0000","last_became_peered":"2024-09-10T05:55:43.775153+0000","last_unstale":"2024-09-10T05:56:19.432307+0000","last_undegraded":"2024-09-10T05:56:19.432307+0000","last_fullsized":"2024-09-10T05:56:19.432307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:31:39.307376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":105,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432487+0000","last_change":"2024-09-10T05:55:43.802259+0000","last_active":"2024-09-10T05:56:19.432487+0000","last_peered":"2024-09-10T05:56:19.432487+0000","last_clean":"2024-09-10T05:56:19.432487+0000","last_became_active":"2024-09-10T05:55:43.760217+0000","last_became_peered":"2024-09-10T05:55:43.760217+0000","last_unstale":"2024-09-10T05:56:19.432487+0000","last_undegraded":"2024-09-10T05:56:19.432487+0000","last_fullsized":"2024-09-10T05:56:19.432487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:13.640343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"38'3","reported_seq":67,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432558+0000","last_change":"2024-09-10T05:55:43.794753+0000","last_active":"2024-09-10T05:56:19.432558+0000","last_peered":"2024-09-10T05:56:19.432558+0000","last_clean":"2024-09-10T05:56:19.432558+0000","last_became_active":"2024-09-10T05:55:43.773136+0000","last_became_peered":"2024-09-10T05:55:43.773136+0000","last_unstale":"2024-09-10T05:56:19.432558+0000","last_undegraded":"2024-09-10T05:56:19.432558+0000","last_fullsized":"2024-09-10T05:56:19.432558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:04.463784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433690+0000","last_change":"2024-09-10T05:55:43.774119+0000","last_active":"2024-09-10T05:56:19.433690+0000","last_peered":"2024-09-10T05:56:19.433690+0000","last_clean":"2024-09-10T05:56:19.433690+0000","last_became_active":"2024-09-10T05:55:43.773414+0000","last_became_peered":"2024-09-10T05:55:43.773414+0000","last_unstale":"2024-09-10T05:56:19.433690+0000","last_undegraded":"2024-09-10T05:56:19.433690+0000","last_fullsized":"2024-09-10T05:56:19.433690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:41.853625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432914+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:56:19.432914+0000","last_peered":"2024-09-10T05:56:19.432914+0000","last_clean":"2024-09-10T05:56:19.432914+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:56:19.432914+0000","last_undegraded":"2024-09-10T05:56:19.432914+0000","last_fullsized":"2024-09-10T05:56:19.432914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434575+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:56:19.434575+0000","last_peered":"2024-09-10T05:56:19.434575+0000","last_clean":"2024-09-10T05:56:19.434575+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:56:19.434575+0000","last_undegraded":"2024-09-10T05:56:19.434575+0000","last_fullsized":"2024-09-10T05:56:19.434575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149343+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:56:14.149343+0000","last_peered":"2024-09-10T05:56:14.149343+0000","last_clean":"2024-09-10T05:56:14.149343+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:56:14.149343+0000","last_undegraded":"2024-09-10T05:56:14.149343+0000","last_fullsized":"2024-09-10T05:56:14.149343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961386+0000","last_change":"2024-09-10T05:55:43.781726+0000","last_active":"2024-09-10T05:56:18.961386+0000","last_peered":"2024-09-10T05:56:18.961386+0000","last_clean":"2024-09-10T05:56:18.961386+0000","last_became_active":"2024-09-10T05:55:43.781265+0000","last_became_peered":"2024-09-10T05:55:43.781265+0000","last_unstale":"2024-09-10T05:56:18.961386+0000","last_undegraded":"2024-09-10T05:56:18.961386+0000","last_fullsized":"2024-09-10T05:56:18.961386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:04.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"36'26","reported_seq":100,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864239+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:56:15.864239+0000","last_peered":"2024-09-10T05:56:15.864239+0000","last_clean":"2024-09-10T05:56:15.864239+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:56:15.864239+0000","last_undegraded":"2024-09-10T05:56:15.864239+0000","last_fullsized":"2024-09-10T05:56:15.864239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963879+0000","last_change":"2024-09-10T05:55:43.780991+0000","last_active":"2024-09-10T05:56:18.963879+0000","last_peered":"2024-09-10T05:56:18.963879+0000","last_clean":"2024-09-10T05:56:18.963879+0000","last_became_active":"2024-09-10T05:55:43.780336+0000","last_became_peered":"2024-09-10T05:55:43.780336+0000","last_unstale":"2024-09-10T05:56:18.963879+0000","last_undegraded":"2024-09-10T05:56:18.963879+0000","last_fullsized":"2024-09-10T05:56:18.963879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:17.301652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144548+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:56:14.144548+0000","last_peered":"2024-09-10T05:56:14.144548+0000","last_clean":"2024-09-10T05:56:14.144548+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:56:14.144548+0000","last_undegraded":"2024-09-10T05:56:14.144548+0000","last_fullsized":"2024-09-10T05:56:14.144548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433040+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:56:19.433040+0000","last_peered":"2024-09-10T05:56:19.433040+0000","last_clean":"2024-09-10T05:56:19.433040+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:56:19.433040+0000","last_undegraded":"2024-09-10T05:56:19.433040+0000","last_fullsized":"2024-09-10T05:56:19.433040+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433863+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:56:19.433863+0000","last_peered":"2024-09-10T05:56:19.433863+0000","last_clean":"2024-09-10T05:56:19.433863+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:56:19.433863+0000","last_undegraded":"2024-09-10T05:56:19.433863+0000","last_fullsized":"2024-09-10T05:56:19.433863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434011+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:56:19.434011+0000","last_peered":"2024-09-10T05:56:19.434011+0000","last_clean":"2024-09-10T05:56:19.434011+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:56:19.434011+0000","last_undegraded":"2024-09-10T05:56:19.434011+0000","last_fullsized":"2024-09-10T05:56:19.434011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964117+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:56:18.964117+0000","last_peered":"2024-09-10T05:56:18.964117+0000","last_clean":"2024-09-10T05:56:18.964117+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:56:18.964117+0000","last_undegraded":"2024-09-10T05:56:18.964117+0000","last_fullsized":"2024-09-10T05:56:18.964117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'17","reported_seq":109,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437761+0000","last_change":"2024-09-10T05:55:43.854105+0000","last_active":"2024-09-10T05:56:19.437761+0000","last_peered":"2024-09-10T05:56:19.437761+0000","last_clean":"2024-09-10T05:56:19.437761+0000","last_became_active":"2024-09-10T05:55:43.786593+0000","last_became_peered":"2024-09-10T05:55:43.786593+0000","last_unstale":"2024-09-10T05:56:19.437761+0000","last_undegraded":"2024-09-10T05:56:19.437761+0000","last_fullsized":"2024-09-10T05:56:19.437761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:48.284583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430940+0000","last_change":"2024-09-10T05:55:43.759028+0000","last_active":"2024-09-10T05:56:19.430940+0000","last_peered":"2024-09-10T05:56:19.430940+0000","last_clean":"2024-09-10T05:56:19.430940+0000","last_became_active":"2024-09-10T05:55:43.758269+0000","last_became_peered":"2024-09-10T05:55:43.758269+0000","last_unstale":"2024-09-10T05:56:19.430940+0000","last_undegraded":"2024-09-10T05:56:19.430940+0000","last_fullsized":"2024-09-10T05:56:19.430940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:03:02.554061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863154+0000","last_change":"2024-09-10T05:55:43.789530+0000","last_active":"2024-09-10T05:56:15.863154+0000","last_peered":"2024-09-10T05:56:15.863154+0000","last_clean":"2024-09-10T05:56:15.863154+0000","last_became_active":"2024-09-10T05:55:43.788888+0000","last_became_peered":"2024-09-10T05:55:43.788888+0000","last_unstale":"2024-09-10T05:56:15.863154+0000","last_undegraded":"2024-09-10T05:56:15.863154+0000","last_fullsized":"2024-09-10T05:56:15.863154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:09.541294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964046+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:56:18.964046+0000","last_peered":"2024-09-10T05:56:18.964046+0000","last_clean":"2024-09-10T05:56:18.964046+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:56:18.964046+0000","last_undegraded":"2024-09-10T05:56:18.964046+0000","last_fullsized":"2024-09-10T05:56:18.964046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863155+0000","last_change":"2024-09-10T05:55:43.788595+0000","last_active":"2024-09-10T05:56:15.863155+0000","last_peered":"2024-09-10T05:56:15.863155+0000","last_clean":"2024-09-10T05:56:15.863155+0000","last_became_active":"2024-09-10T05:55:43.788184+0000","last_became_peered":"2024-09-10T05:55:43.788184+0000","last_unstale":"2024-09-10T05:56:15.863155+0000","last_undegraded":"2024-09-10T05:56:15.863155+0000","last_fullsized":"2024-09-10T05:56:15.863155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:15.977679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435943+0000","last_change":"2024-09-10T05:55:43.768329+0000","last_active":"2024-09-10T05:56:19.435943+0000","last_peered":"2024-09-10T05:56:19.435943+0000","last_clean":"2024-09-10T05:56:19.435943+0000","last_became_active":"2024-09-10T05:55:43.768047+0000","last_became_peered":"2024-09-10T05:55:43.768047+0000","last_unstale":"2024-09-10T05:56:19.435943+0000","last_undegraded":"2024-09-10T05:56:19.435943+0000","last_fullsized":"2024-09-10T05:56:19.435943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:32.381418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":65,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430977+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:56:19.430977+0000","last_peered":"2024-09-10T05:56:19.430977+0000","last_clean":"2024-09-10T05:56:19.430977+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:56:19.430977+0000","last_undegraded":"2024-09-10T05:56:19.430977+0000","last_fullsized":"2024-09-10T05:56:19.430977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864085+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:56:15.864085+0000","last_peered":"2024-09-10T05:56:15.864085+0000","last_clean":"2024-09-10T05:56:15.864085+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:56:15.864085+0000","last_undegraded":"2024-09-10T05:56:15.864085+0000","last_fullsized":"2024-09-10T05:56:15.864085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434661+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:56:19.434661+0000","last_peered":"2024-09-10T05:56:19.434661+0000","last_clean":"2024-09-10T05:56:19.434661+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:56:19.434661+0000","last_undegraded":"2024-09-10T05:56:19.434661+0000","last_fullsized":"2024-09-10T05:56:19.434661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864009+0000","last_change":"2024-09-10T05:55:43.807390+0000","last_active":"2024-09-10T05:56:15.864009+0000","last_peered":"2024-09-10T05:56:15.864009+0000","last_clean":"2024-09-10T05:56:15.864009+0000","last_became_active":"2024-09-10T05:55:43.806936+0000","last_became_peered":"2024-09-10T05:55:43.806936+0000","last_unstale":"2024-09-10T05:56:15.864009+0000","last_undegraded":"2024-09-10T05:56:15.864009+0000","last_fullsized":"2024-09-10T05:56:15.864009+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:33.727161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151433+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:56:14.151433+0000","last_peered":"2024-09-10T05:56:14.151433+0000","last_clean":"2024-09-10T05:56:14.151433+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:56:14.151433+0000","last_undegraded":"2024-09-10T05:56:14.151433+0000","last_fullsized":"2024-09-10T05:56:14.151433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863611+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:56:15.863611+0000","last_peered":"2024-09-10T05:56:15.863611+0000","last_clean":"2024-09-10T05:56:15.863611+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:56:15.863611+0000","last_undegraded":"2024-09-10T05:56:15.863611+0000","last_fullsized":"2024-09-10T05:56:15.863611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435720+0000","last_change":"2024-09-10T05:55:43.811328+0000","last_active":"2024-09-10T05:56:19.435720+0000","last_peered":"2024-09-10T05:56:19.435720+0000","last_clean":"2024-09-10T05:56:19.435720+0000","last_became_active":"2024-09-10T05:55:43.779853+0000","last_became_peered":"2024-09-10T05:55:43.779853+0000","last_unstale":"2024-09-10T05:56:19.435720+0000","last_undegraded":"2024-09-10T05:56:19.435720+0000","last_fullsized":"2024-09-10T05:56:19.435720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:47.370502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":45,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146168+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:56:14.146168+0000","last_peered":"2024-09-10T05:56:14.146168+0000","last_clean":"2024-09-10T05:56:14.146168+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:56:14.146168+0000","last_undegraded":"2024-09-10T05:56:14.146168+0000","last_fullsized":"2024-09-10T05:56:14.146168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146616+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:56:14.146616+0000","last_peered":"2024-09-10T05:56:14.146616+0000","last_clean":"2024-09-10T05:56:14.146616+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:56:14.146616+0000","last_undegraded":"2024-09-10T05:56:14.146616+0000","last_fullsized":"2024-09-10T05:56:14.146616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961526+0000","last_change":"2024-09-10T05:55:43.788719+0000","last_active":"2024-09-10T05:56:18.961526+0000","last_peered":"2024-09-10T05:56:18.961526+0000","last_clean":"2024-09-10T05:56:18.961526+0000","last_became_active":"2024-09-10T05:55:43.788432+0000","last_became_peered":"2024-09-10T05:55:43.788432+0000","last_unstale":"2024-09-10T05:56:18.961526+0000","last_undegraded":"2024-09-10T05:56:18.961526+0000","last_fullsized":"2024-09-10T05:56:18.961526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:18.891041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433441+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:56:19.433441+0000","last_peered":"2024-09-10T05:56:19.433441+0000","last_clean":"2024-09-10T05:56:19.433441+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:56:19.433441+0000","last_undegraded":"2024-09-10T05:56:19.433441+0000","last_fullsized":"2024-09-10T05:56:19.433441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145931+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:56:14.145931+0000","last_peered":"2024-09-10T05:56:14.145931+0000","last_clean":"2024-09-10T05:56:14.145931+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:56:14.145931+0000","last_undegraded":"2024-09-10T05:56:14.145931+0000","last_fullsized":"2024-09-10T05:56:14.145931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863653+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:56:15.863653+0000","last_peered":"2024-09-10T05:56:15.863653+0000","last_clean":"2024-09-10T05:56:15.863653+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:56:15.863653+0000","last_undegraded":"2024-09-10T05:56:15.863653+0000","last_fullsized":"2024-09-10T05:56:15.863653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435010+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:56:19.435010+0000","last_peered":"2024-09-10T05:56:19.435010+0000","last_clean":"2024-09-10T05:56:19.435010+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:56:19.435010+0000","last_undegraded":"2024-09-10T05:56:19.435010+0000","last_fullsized":"2024-09-10T05:56:19.435010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149014+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:56:14.149014+0000","last_peered":"2024-09-10T05:56:14.149014+0000","last_clean":"2024-09-10T05:56:14.149014+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:56:14.149014+0000","last_undegraded":"2024-09-10T05:56:14.149014+0000","last_fullsized":"2024-09-10T05:56:14.149014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431281+0000","last_change":"2024-09-10T05:55:43.769761+0000","last_active":"2024-09-10T05:56:19.431281+0000","last_peered":"2024-09-10T05:56:19.431281+0000","last_clean":"2024-09-10T05:56:19.431281+0000","last_became_active":"2024-09-10T05:55:43.768948+0000","last_became_peered":"2024-09-10T05:55:43.768948+0000","last_unstale":"2024-09-10T05:56:19.431281+0000","last_undegraded":"2024-09-10T05:56:19.431281+0000","last_fullsized":"2024-09-10T05:56:19.431281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:31:35.426596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434208+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:56:19.434208+0000","last_peered":"2024-09-10T05:56:19.434208+0000","last_clean":"2024-09-10T05:56:19.434208+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:56:19.434208+0000","last_undegraded":"2024-09-10T05:56:19.434208+0000","last_fullsized":"2024-09-10T05:56:19.434208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'18","reported_seq":93,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962114+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:56:18.962114+0000","last_peered":"2024-09-10T05:56:18.962114+0000","last_clean":"2024-09-10T05:56:18.962114+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:56:18.962114+0000","last_undegraded":"2024-09-10T05:56:18.962114+0000","last_fullsized":"2024-09-10T05:56:18.962114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147107+0000","last_change":"2024-09-10T05:55:43.782026+0000","last_active":"2024-09-10T05:56:14.147107+0000","last_peered":"2024-09-10T05:56:14.147107+0000","last_clean":"2024-09-10T05:56:14.147107+0000","last_became_active":"2024-09-10T05:55:43.781220+0000","last_became_peered":"2024-09-10T05:55:43.781220+0000","last_unstale":"2024-09-10T05:56:14.147107+0000","last_undegraded":"2024-09-10T05:56:14.147107+0000","last_fullsized":"2024-09-10T05:56:14.147107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:16.898159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432685+0000","last_change":"2024-09-10T05:55:43.772257+0000","last_active":"2024-09-10T05:56:19.432685+0000","last_peered":"2024-09-10T05:56:19.432685+0000","last_clean":"2024-09-10T05:56:19.432685+0000","last_became_active":"2024-09-10T05:55:43.761220+0000","last_became_peered":"2024-09-10T05:55:43.761220+0000","last_unstale":"2024-09-10T05:56:19.432685+0000","last_undegraded":"2024-09-10T05:56:19.432685+0000","last_fullsized":"2024-09-10T05:56:19.432685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:25.252163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434320+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:56:19.434320+0000","last_peered":"2024-09-10T05:56:19.434320+0000","last_clean":"2024-09-10T05:56:19.434320+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:56:19.434320+0000","last_undegraded":"2024-09-10T05:56:19.434320+0000","last_fullsized":"2024-09-10T05:56:19.434320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965513+0000","last_change":"2024-09-10T05:55:43.782454+0000","last_active":"2024-09-10T05:56:18.965513+0000","last_peered":"2024-09-10T05:56:18.965513+0000","last_clean":"2024-09-10T05:56:18.965513+0000","last_became_active":"2024-09-10T05:55:43.781992+0000","last_became_peered":"2024-09-10T05:55:43.781992+0000","last_unstale":"2024-09-10T05:56:18.965513+0000","last_undegraded":"2024-09-10T05:56:18.965513+0000","last_fullsized":"2024-09-10T05:56:18.965513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148680+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:56:14.148680+0000","last_peered":"2024-09-10T05:56:14.148680+0000","last_clean":"2024-09-10T05:56:14.148680+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:56:14.148680+0000","last_undegraded":"2024-09-10T05:56:14.148680+0000","last_fullsized":"2024-09-10T05:56:14.148680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864659+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:56:15.864659+0000","last_peered":"2024-09-10T05:56:15.864659+0000","last_clean":"2024-09-10T05:56:15.864659+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:56:15.864659+0000","last_undegraded":"2024-09-10T05:56:15.864659+0000","last_fullsized":"2024-09-10T05:56:15.864659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962285+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:56:18.962285+0000","last_peered":"2024-09-10T05:56:18.962285+0000","last_clean":"2024-09-10T05:56:18.962285+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:56:18.962285+0000","last_undegraded":"2024-09-10T05:56:18.962285+0000","last_fullsized":"2024-09-10T05:56:18.962285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.143084+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:56:14.143084+0000","last_peered":"2024-09-10T05:56:14.143084+0000","last_clean":"2024-09-10T05:56:14.143084+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:56:14.143084+0000","last_undegraded":"2024-09-10T05:56:14.143084+0000","last_fullsized":"2024-09-10T05:56:14.143084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962614+0000","last_change":"2024-09-10T05:55:43.786564+0000","last_active":"2024-09-10T05:56:18.962614+0000","last_peered":"2024-09-10T05:56:18.962614+0000","last_clean":"2024-09-10T05:56:18.962614+0000","last_became_active":"2024-09-10T05:55:43.782508+0000","last_became_peered":"2024-09-10T05:55:43.782508+0000","last_unstale":"2024-09-10T05:56:18.962614+0000","last_undegraded":"2024-09-10T05:56:18.962614+0000","last_fullsized":"2024-09-10T05:56:18.962614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:39.385386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432683+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:56:19.432683+0000","last_peered":"2024-09-10T05:56:19.432683+0000","last_clean":"2024-09-10T05:56:19.432683+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:56:19.432683+0000","last_undegraded":"2024-09-10T05:56:19.432683+0000","last_fullsized":"2024-09-10T05:56:19.432683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":74,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.436541+0000","last_change":"2024-09-10T05:55:43.824309+0000","last_active":"2024-09-10T05:56:19.436541+0000","last_peered":"2024-09-10T05:56:19.436541+0000","last_clean":"2024-09-10T05:56:19.436541+0000","last_became_active":"2024-09-10T05:55:43.775292+0000","last_became_peered":"2024-09-10T05:55:43.775292+0000","last_unstale":"2024-09-10T05:56:19.436541+0000","last_undegraded":"2024-09-10T05:56:19.436541+0000","last_fullsized":"2024-09-10T05:56:19.436541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:50.195249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"36'17","reported_seq":100,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147668+0000","last_change":"2024-09-10T05:55:43.835023+0000","last_active":"2024-09-10T05:56:14.147668+0000","last_peered":"2024-09-10T05:56:14.147668+0000","last_clean":"2024-09-10T05:56:14.147668+0000","last_became_active":"2024-09-10T05:55:43.796829+0000","last_became_peered":"2024-09-10T05:55:43.796829+0000","last_unstale":"2024-09-10T05:56:14.147668+0000","last_undegraded":"2024-09-10T05:56:14.147668+0000","last_fullsized":"2024-09-10T05:56:14.147668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:03.508040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962775+0000","last_change":"2024-09-10T05:55:43.793413+0000","last_active":"2024-09-10T05:56:18.962775+0000","last_peered":"2024-09-10T05:56:18.962775+0000","last_clean":"2024-09-10T05:56:18.962775+0000","last_became_active":"2024-09-10T05:55:43.792912+0000","last_became_peered":"2024-09-10T05:55:43.792912+0000","last_unstale":"2024-09-10T05:56:18.962775+0000","last_undegraded":"2024-09-10T05:56:18.962775+0000","last_fullsized":"2024-09-10T05:56:18.962775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:49.940275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145386+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:56:14.145386+0000","last_peered":"2024-09-10T05:56:14.145386+0000","last_clean":"2024-09-10T05:56:14.145386+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:56:14.145386+0000","last_undegraded":"2024-09-10T05:56:14.145386+0000","last_fullsized":"2024-09-10T05:56:14.145386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433343+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:56:19.433343+0000","last_peered":"2024-09-10T05:56:19.433343+0000","last_clean":"2024-09-10T05:56:19.433343+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:56:19.433343+0000","last_undegraded":"2024-09-10T05:56:19.433343+0000","last_fullsized":"2024-09-10T05:56:19.433343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435099+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:56:19.435099+0000","last_peered":"2024-09-10T05:56:19.435099+0000","last_clean":"2024-09-10T05:56:19.435099+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:56:19.435099+0000","last_undegraded":"2024-09-10T05:56:19.435099+0000","last_fullsized":"2024-09-10T05:56:19.435099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962448+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:56:18.962448+0000","last_peered":"2024-09-10T05:56:18.962448+0000","last_clean":"2024-09-10T05:56:18.962448+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:56:18.962448+0000","last_undegraded":"2024-09-10T05:56:18.962448+0000","last_fullsized":"2024-09-10T05:56:18.962448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":85,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434378+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:56:19.434378+0000","last_peered":"2024-09-10T05:56:19.434378+0000","last_clean":"2024-09-10T05:56:19.434378+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:56:19.434378+0000","last_undegraded":"2024-09-10T05:56:19.434378+0000","last_fullsized":"2024-09-10T05:56:19.434378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147398+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:56:14.147398+0000","last_peered":"2024-09-10T05:56:14.147398+0000","last_clean":"2024-09-10T05:56:14.147398+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:56:14.147398+0000","last_undegraded":"2024-09-10T05:56:14.147398+0000","last_fullsized":"2024-09-10T05:56:14.147398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863540+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:56:15.863540+0000","last_peered":"2024-09-10T05:56:15.863540+0000","last_clean":"2024-09-10T05:56:15.863540+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:56:15.863540+0000","last_undegraded":"2024-09-10T05:56:15.863540+0000","last_fullsized":"2024-09-10T05:56:15.863540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433714+0000","last_change":"2024-09-10T05:55:43.766589+0000","last_active":"2024-09-10T05:56:19.433714+0000","last_peered":"2024-09-10T05:56:19.433714+0000","last_clean":"2024-09-10T05:56:19.433714+0000","last_became_active":"2024-09-10T05:55:43.763644+0000","last_became_peered":"2024-09-10T05:55:43.763644+0000","last_unstale":"2024-09-10T05:56:19.433714+0000","last_undegraded":"2024-09-10T05:56:19.433714+0000","last_fullsized":"2024-09-10T05:56:19.433714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:52.163141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147747+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:56:14.147747+0000","last_peered":"2024-09-10T05:56:14.147747+0000","last_clean":"2024-09-10T05:56:14.147747+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:56:14.147747+0000","last_undegraded":"2024-09-10T05:56:14.147747+0000","last_fullsized":"2024-09-10T05:56:14.147747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863784+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:56:15.863784+0000","last_peered":"2024-09-10T05:56:15.863784+0000","last_clean":"2024-09-10T05:56:15.863784+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:56:15.863784+0000","last_undegraded":"2024-09-10T05:56:15.863784+0000","last_fullsized":"2024-09-10T05:56:15.863784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"36'39","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145655+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:56:14.145655+0000","last_peered":"2024-09-10T05:56:14.145655+0000","last_clean":"2024-09-10T05:56:14.145655+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:56:14.145655+0000","last_undegraded":"2024-09-10T05:56:14.145655+0000","last_fullsized":"2024-09-10T05:56:14.145655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430666+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:56:19.430666+0000","last_peered":"2024-09-10T05:56:19.430666+0000","last_clean":"2024-09-10T05:56:19.430666+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:56:19.430666+0000","last_undegraded":"2024-09-10T05:56:19.430666+0000","last_fullsized":"2024-09-10T05:56:19.430666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865543+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:56:15.865543+0000","last_peered":"2024-09-10T05:56:15.865543+0000","last_clean":"2024-09-10T05:56:15.865543+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:56:15.865543+0000","last_undegraded":"2024-09-10T05:56:15.865543+0000","last_fullsized":"2024-09-10T05:56:15.865543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432511+0000","last_change":"2024-09-10T05:55:43.777913+0000","last_active":"2024-09-10T05:56:19.432511+0000","last_peered":"2024-09-10T05:56:19.432511+0000","last_clean":"2024-09-10T05:56:19.432511+0000","last_became_active":"2024-09-10T05:55:43.775856+0000","last_became_peered":"2024-09-10T05:55:43.775856+0000","last_unstale":"2024-09-10T05:56:19.432511+0000","last_undegraded":"2024-09-10T05:56:19.432511+0000","last_fullsized":"2024-09-10T05:56:19.432511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:33.793026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147334+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:56:14.147334+0000","last_peered":"2024-09-10T05:56:14.147334+0000","last_clean":"2024-09-10T05:56:14.147334+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:56:14.147334+0000","last_undegraded":"2024-09-10T05:56:14.147334+0000","last_fullsized":"2024-09-10T05:56:14.147334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145445+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:56:14.145445+0000","last_peered":"2024-09-10T05:56:14.145445+0000","last_clean":"2024-09-10T05:56:14.145445+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:56:14.145445+0000","last_undegraded":"2024-09-10T05:56:14.145445+0000","last_fullsized":"2024-09-10T05:56:14.145445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"36'15","reported_seq":86,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430798+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:56:19.430798+0000","last_peered":"2024-09-10T05:56:19.430798+0000","last_clean":"2024-09-10T05:56:19.430798+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:56:19.430798+0000","last_undegraded":"2024-09-10T05:56:19.430798+0000","last_fullsized":"2024-09-10T05:56:19.430798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":45,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145420+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:56:14.145420+0000","last_peered":"2024-09-10T05:56:14.145420+0000","last_clean":"2024-09-10T05:56:14.145420+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:56:14.145420+0000","last_undegraded":"2024-09-10T05:56:14.145420+0000","last_fullsized":"2024-09-10T05:56:14.145420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433909+0000","last_change":"2024-09-10T05:55:43.775586+0000","last_active":"2024-09-10T05:56:19.433909+0000","last_peered":"2024-09-10T05:56:19.433909+0000","last_clean":"2024-09-10T05:56:19.433909+0000","last_became_active":"2024-09-10T05:55:43.775314+0000","last_became_peered":"2024-09-10T05:55:43.775314+0000","last_unstale":"2024-09-10T05:56:19.433909+0000","last_undegraded":"2024-09-10T05:56:19.433909+0000","last_fullsized":"2024-09-10T05:56:19.433909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:59.576863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431674+0000","last_change":"2024-09-10T05:55:43.774119+0000","last_active":"2024-09-10T05:56:19.431674+0000","last_peered":"2024-09-10T05:56:19.431674+0000","last_clean":"2024-09-10T05:56:19.431674+0000","last_became_active":"2024-09-10T05:55:43.773700+0000","last_became_peered":"2024-09-10T05:55:43.773700+0000","last_unstale":"2024-09-10T05:56:19.431674+0000","last_undegraded":"2024-09-10T05:56:19.431674+0000","last_fullsized":"2024-09-10T05:56:19.431674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:32.874692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147562+0000","last_change":"2024-09-10T05:55:43.782020+0000","last_active":"2024-09-10T05:56:14.147562+0000","last_peered":"2024-09-10T05:56:14.147562+0000","last_clean":"2024-09-10T05:56:14.147562+0000","last_became_active":"2024-09-10T05:55:43.777139+0000","last_became_peered":"2024-09-10T05:55:43.777139+0000","last_unstale":"2024-09-10T05:56:14.147562+0000","last_undegraded":"2024-09-10T05:56:14.147562+0000","last_fullsized":"2024-09-10T05:56:14.147562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:40.913796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428288+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:56:19.428288+0000","last_peered":"2024-09-10T05:56:19.428288+0000","last_clean":"2024-09-10T05:56:19.428288+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:56:19.428288+0000","last_undegraded":"2024-09-10T05:56:19.428288+0000","last_fullsized":"2024-09-10T05:56:19.428288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"36'11","reported_seq":87,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864462+0000","last_change":"2024-09-10T05:55:43.817545+0000","last_active":"2024-09-10T05:56:15.864462+0000","last_peered":"2024-09-10T05:56:15.864462+0000","last_clean":"2024-09-10T05:56:15.864462+0000","last_became_active":"2024-09-10T05:55:43.805908+0000","last_became_peered":"2024-09-10T05:55:43.805908+0000","last_unstale":"2024-09-10T05:56:15.864462+0000","last_undegraded":"2024-09-10T05:56:15.864462+0000","last_fullsized":"2024-09-10T05:56:15.864462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:46.863921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432081+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:56:19.432081+0000","last_peered":"2024-09-10T05:56:19.432081+0000","last_clean":"2024-09-10T05:56:19.432081+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:56:19.432081+0000","last_undegraded":"2024-09-10T05:56:19.432081+0000","last_fullsized":"2024-09-10T05:56:19.432081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865364+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:56:15.865364+0000","last_peered":"2024-09-10T05:56:15.865364+0000","last_clean":"2024-09-10T05:56:15.865364+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:56:15.865364+0000","last_undegraded":"2024-09-10T05:56:15.865364+0000","last_fullsized":"2024-09-10T05:56:15.865364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428577+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:56:19.428577+0000","last_peered":"2024-09-10T05:56:19.428577+0000","last_clean":"2024-09-10T05:56:19.428577+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:56:19.428577+0000","last_undegraded":"2024-09-10T05:56:19.428577+0000","last_fullsized":"2024-09-10T05:56:19.428577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434429+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:56:19.434429+0000","last_peered":"2024-09-10T05:56:19.434429+0000","last_clean":"2024-09-10T05:56:19.434429+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:56:19.434429+0000","last_undegraded":"2024-09-10T05:56:19.434429+0000","last_fullsized":"2024-09-10T05:56:19.434429+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":63,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965004+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:56:18.965004+0000","last_peered":"2024-09-10T05:56:18.965004+0000","last_clean":"2024-09-10T05:56:18.965004+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:56:18.965004+0000","last_undegraded":"2024-09-10T05:56:18.965004+0000","last_fullsized":"2024-09-10T05:56:18.965004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'21","reported_seq":98,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432225+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:56:19.432225+0000","last_peered":"2024-09-10T05:56:19.432225+0000","last_clean":"2024-09-10T05:56:19.432225+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:56:19.432225+0000","last_undegraded":"2024-09-10T05:56:19.432225+0000","last_fullsized":"2024-09-10T05:56:19.432225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435566+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:56:19.435566+0000","last_peered":"2024-09-10T05:56:19.435566+0000","last_clean":"2024-09-10T05:56:19.435566+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:56:19.435566+0000","last_undegraded":"2024-09-10T05:56:19.435566+0000","last_fullsized":"2024-09-10T05:56:19.435566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.436508+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:56:19.436508+0000","last_peered":"2024-09-10T05:56:19.436508+0000","last_clean":"2024-09-10T05:56:19.436508+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:56:19.436508+0000","last_undegraded":"2024-09-10T05:56:19.436508+0000","last_fullsized":"2024-09-10T05:56:19.436508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963648+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:56:18.963648+0000","last_peered":"2024-09-10T05:56:18.963648+0000","last_clean":"2024-09-10T05:56:18.963648+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:56:18.963648+0000","last_undegraded":"2024-09-10T05:56:18.963648+0000","last_fullsized":"2024-09-10T05:56:18.963648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144612+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:56:14.144612+0000","last_peered":"2024-09-10T05:56:14.144612+0000","last_clean":"2024-09-10T05:56:14.144612+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:56:14.144612+0000","last_undegraded":"2024-09-10T05:56:14.144612+0000","last_fullsized":"2024-09-10T05:56:14.144612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963023+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:56:18.963023+0000","last_peered":"2024-09-10T05:56:18.963023+0000","last_clean":"2024-09-10T05:56:18.963023+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:56:18.963023+0000","last_undegraded":"2024-09-10T05:56:18.963023+0000","last_fullsized":"2024-09-10T05:56:18.963023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431592+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:56:19.431592+0000","last_peered":"2024-09-10T05:56:19.431592+0000","last_clean":"2024-09-10T05:56:19.431592+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:56:19.431592+0000","last_undegraded":"2024-09-10T05:56:19.431592+0000","last_fullsized":"2024-09-10T05:56:19.431592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146405+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:56:14.146405+0000","last_peered":"2024-09-10T05:56:14.146405+0000","last_clean":"2024-09-10T05:56:14.146405+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:56:14.146405+0000","last_undegraded":"2024-09-10T05:56:14.146405+0000","last_fullsized":"2024-09-10T05:56:14.146405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148719+0000","last_change":"2024-09-10T05:55:43.781632+0000","last_active":"2024-09-10T05:56:14.148719+0000","last_peered":"2024-09-10T05:56:14.148719+0000","last_clean":"2024-09-10T05:56:14.148719+0000","last_became_active":"2024-09-10T05:55:43.772006+0000","last_became_peered":"2024-09-10T05:55:43.772006+0000","last_unstale":"2024-09-10T05:56:14.148719+0000","last_undegraded":"2024-09-10T05:56:14.148719+0000","last_fullsized":"2024-09-10T05:56:14.148719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:33.947948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965140+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:56:18.965140+0000","last_peered":"2024-09-10T05:56:18.965140+0000","last_clean":"2024-09-10T05:56:18.965140+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:56:18.965140+0000","last_undegraded":"2024-09-10T05:56:18.965140+0000","last_fullsized":"2024-09-10T05:56:18.965140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435253+0000","last_change":"2024-09-10T05:55:43.794639+0000","last_active":"2024-09-10T05:56:19.435253+0000","last_peered":"2024-09-10T05:56:19.435253+0000","last_clean":"2024-09-10T05:56:19.435253+0000","last_became_active":"2024-09-10T05:55:43.794237+0000","last_became_peered":"2024-09-10T05:55:43.794237+0000","last_unstale":"2024-09-10T05:56:19.435253+0000","last_undegraded":"2024-09-10T05:56:19.435253+0000","last_fullsized":"2024-09-10T05:56:19.435253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:21.108256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863122+0000","last_change":"2024-09-10T05:55:43.782105+0000","last_active":"2024-09-10T05:56:15.863122+0000","last_peered":"2024-09-10T05:56:15.863122+0000","last_clean":"2024-09-10T05:56:15.863122+0000","last_became_active":"2024-09-10T05:55:43.781127+0000","last_became_peered":"2024-09-10T05:55:43.781127+0000","last_unstale":"2024-09-10T05:56:15.863122+0000","last_undegraded":"2024-09-10T05:56:15.863122+0000","last_fullsized":"2024-09-10T05:56:15.863122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:43.066619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434338+0000","last_change":"2024-09-10T05:55:43.766695+0000","last_active":"2024-09-10T05:56:19.434338+0000","last_peered":"2024-09-10T05:56:19.434338+0000","last_clean":"2024-09-10T05:56:19.434338+0000","last_became_active":"2024-09-10T05:55:43.763989+0000","last_became_peered":"2024-09-10T05:55:43.763989+0000","last_unstale":"2024-09-10T05:56:19.434338+0000","last_undegraded":"2024-09-10T05:56:19.434338+0000","last_fullsized":"2024-09-10T05:56:19.434338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.827034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432626+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:56:19.432626+0000","last_peered":"2024-09-10T05:56:19.432626+0000","last_clean":"2024-09-10T05:56:19.432626+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:56:19.432626+0000","last_undegraded":"2024-09-10T05:56:19.432626+0000","last_fullsized":"2024-09-10T05:56:19.432626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962687+0000","last_change":"2024-09-10T05:55:43.776313+0000","last_active":"2024-09-10T05:56:18.962687+0000","last_peered":"2024-09-10T05:56:18.962687+0000","last_clean":"2024-09-10T05:56:18.962687+0000","last_became_active":"2024-09-10T05:55:43.776035+0000","last_became_peered":"2024-09-10T05:55:43.776035+0000","last_unstale":"2024-09-10T05:56:18.962687+0000","last_undegraded":"2024-09-10T05:56:18.962687+0000","last_fullsized":"2024-09-10T05:56:18.962687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.285992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965313+0000","last_change":"2024-09-10T05:55:43.765257+0000","last_active":"2024-09-10T05:56:18.965313+0000","last_peered":"2024-09-10T05:56:18.965313+0000","last_clean":"2024-09-10T05:56:18.965313+0000","last_became_active":"2024-09-10T05:55:43.764783+0000","last_became_peered":"2024-09-10T05:55:43.764783+0000","last_unstale":"2024-09-10T05:56:18.965313+0000","last_undegraded":"2024-09-10T05:56:18.965313+0000","last_fullsized":"2024-09-10T05:56:18.965313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:49.908421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148336+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:56:14.148336+0000","last_peered":"2024-09-10T05:56:14.148336+0000","last_clean":"2024-09-10T05:56:14.148336+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:56:14.148336+0000","last_undegraded":"2024-09-10T05:56:14.148336+0000","last_fullsized":"2024-09-10T05:56:14.148336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144366+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:56:14.144366+0000","last_peered":"2024-09-10T05:56:14.144366+0000","last_clean":"2024-09-10T05:56:14.144366+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:56:14.144366+0000","last_undegraded":"2024-09-10T05:56:14.144366+0000","last_fullsized":"2024-09-10T05:56:14.144366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963299+0000","last_change":"2024-09-10T05:55:58.838079+0000","last_active":"2024-09-10T05:56:18.963299+0000","last_peered":"2024-09-10T05:56:18.963299+0000","last_clean":"2024-09-10T05:56:18.963299+0000","last_became_active":"2024-09-10T05:55:58.837309+0000","last_became_peered":"2024-09-10T05:55:58.837309+0000","last_unstale":"2024-09-10T05:56:18.963299+0000","last_undegraded":"2024-09-10T05:56:18.963299+0000","last_fullsized":"2024-09-10T05:56:18.963299+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.683071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433370+0000","last_change":"2024-09-10T05:55:43.781858+0000","last_active":"2024-09-10T05:56:19.433370+0000","last_peered":"2024-09-10T05:56:19.433370+0000","last_clean":"2024-09-10T05:56:19.433370+0000","last_became_active":"2024-09-10T05:55:43.780794+0000","last_became_peered":"2024-09-10T05:55:43.780794+0000","last_unstale":"2024-09-10T05:56:19.433370+0000","last_undegraded":"2024-09-10T05:56:19.433370+0000","last_fullsized":"2024-09-10T05:56:19.433370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:10.858206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150195+0000","last_change":"2024-09-10T05:55:43.797162+0000","last_active":"2024-09-10T05:56:14.150195+0000","last_peered":"2024-09-10T05:56:14.150195+0000","last_clean":"2024-09-10T05:56:14.150195+0000","last_became_active":"2024-09-10T05:55:43.796633+0000","last_became_peered":"2024-09-10T05:55:43.796633+0000","last_unstale":"2024-09-10T05:56:14.150195+0000","last_undegraded":"2024-09-10T05:56:14.150195+0000","last_fullsized":"2024-09-10T05:56:14.150195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:30.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434502+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:56:19.434502+0000","last_peered":"2024-09-10T05:56:19.434502+0000","last_clean":"2024-09-10T05:56:19.434502+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:56:19.434502+0000","last_undegraded":"2024-09-10T05:56:19.434502+0000","last_fullsized":"2024-09-10T05:56:19.434502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433250+0000","last_change":"2024-09-10T05:55:43.766914+0000","last_active":"2024-09-10T05:56:19.433250+0000","last_peered":"2024-09-10T05:56:19.433250+0000","last_clean":"2024-09-10T05:56:19.433250+0000","last_became_active":"2024-09-10T05:55:43.766080+0000","last_became_peered":"2024-09-10T05:55:43.766080+0000","last_unstale":"2024-09-10T05:56:19.433250+0000","last_undegraded":"2024-09-10T05:56:19.433250+0000","last_fullsized":"2024-09-10T05:56:19.433250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:45.995974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433730+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:56:19.433730+0000","last_peered":"2024-09-10T05:56:19.433730+0000","last_clean":"2024-09-10T05:56:19.433730+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:56:19.433730+0000","last_undegraded":"2024-09-10T05:56:19.433730+0000","last_fullsized":"2024-09-10T05:56:19.433730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148500+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:56:14.148500+0000","last_peered":"2024-09-10T05:56:14.148500+0000","last_clean":"2024-09-10T05:56:14.148500+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:56:14.148500+0000","last_undegraded":"2024-09-10T05:56:14.148500+0000","last_fullsized":"2024-09-10T05:56:14.148500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434482+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:56:19.434482+0000","last_peered":"2024-09-10T05:56:19.434482+0000","last_clean":"2024-09-10T05:56:19.434482+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:56:19.434482+0000","last_undegraded":"2024-09-10T05:56:19.434482+0000","last_fullsized":"2024-09-10T05:56:19.434482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435418+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:56:19.435418+0000","last_peered":"2024-09-10T05:56:19.435418+0000","last_clean":"2024-09-10T05:56:19.435418+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:56:19.435418+0000","last_undegraded":"2024-09-10T05:56:19.435418+0000","last_fullsized":"2024-09-10T05:56:19.435418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864255+0000","last_change":"2024-09-10T05:55:43.801339+0000","last_active":"2024-09-10T05:56:15.864255+0000","last_peered":"2024-09-10T05:56:15.864255+0000","last_clean":"2024-09-10T05:56:15.864255+0000","last_became_active":"2024-09-10T05:55:43.801032+0000","last_became_peered":"2024-09-10T05:55:43.801032+0000","last_unstale":"2024-09-10T05:56:15.864255+0000","last_undegraded":"2024-09-10T05:56:15.864255+0000","last_fullsized":"2024-09-10T05:56:15.864255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:02.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148021+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:56:14.148021+0000","last_peered":"2024-09-10T05:56:14.148021+0000","last_clean":"2024-09-10T05:56:14.148021+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:56:14.148021+0000","last_undegraded":"2024-09-10T05:56:14.148021+0000","last_fullsized":"2024-09-10T05:56:14.148021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431293+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:56:19.431293+0000","last_peered":"2024-09-10T05:56:19.431293+0000","last_clean":"2024-09-10T05:56:19.431293+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:56:19.431293+0000","last_undegraded":"2024-09-10T05:56:19.431293+0000","last_fullsized":"2024-09-10T05:56:19.431293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865901+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:56:15.865901+0000","last_peered":"2024-09-10T05:56:15.865901+0000","last_clean":"2024-09-10T05:56:15.865901+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:56:15.865901+0000","last_undegraded":"2024-09-10T05:56:15.865901+0000","last_fullsized":"2024-09-10T05:56:15.865901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437485+0000","last_change":"2024-09-10T05:55:43.766044+0000","last_active":"2024-09-10T05:56:19.437485+0000","last_peered":"2024-09-10T05:56:19.437485+0000","last_clean":"2024-09-10T05:56:19.437485+0000","last_became_active":"2024-09-10T05:55:43.762145+0000","last_became_peered":"2024-09-10T05:55:43.762145+0000","last_unstale":"2024-09-10T05:56:19.437485+0000","last_undegraded":"2024-09-10T05:56:19.437485+0000","last_fullsized":"2024-09-10T05:56:19.437485+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:47.864026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434336+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:56:19.434336+0000","last_peered":"2024-09-10T05:56:19.434336+0000","last_clean":"2024-09-10T05:56:19.434336+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:56:19.434336+0000","last_undegraded":"2024-09-10T05:56:19.434336+0000","last_fullsized":"2024-09-10T05:56:19.434336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863891+0000","last_change":"2024-09-10T05:55:43.774256+0000","last_active":"2024-09-10T05:56:15.863891+0000","last_peered":"2024-09-10T05:56:15.863891+0000","last_clean":"2024-09-10T05:56:15.863891+0000","last_became_active":"2024-09-10T05:55:43.772225+0000","last_became_peered":"2024-09-10T05:55:43.772225+0000","last_unstale":"2024-09-10T05:56:15.863891+0000","last_undegraded":"2024-09-10T05:56:15.863891+0000","last_fullsized":"2024-09-10T05:56:15.863891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:38.745146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151924+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:56:14.151924+0000","last_peered":"2024-09-10T05:56:14.151924+0000","last_clean":"2024-09-10T05:56:14.151924+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:56:14.151924+0000","last_undegraded":"2024-09-10T05:56:14.151924+0000","last_fullsized":"2024-09-10T05:56:14.151924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150098+0000","last_change":"2024-09-10T05:55:22.567056+0000","last_active":"2024-09-10T05:56:14.150098+0000","last_peered":"2024-09-10T05:56:14.150098+0000","last_clean":"2024-09-10T05:56:14.150098+0000","last_became_active":"2024-09-10T05:55:22.563015+0000","last_became_peered":"2024-09-10T05:55:22.563015+0000","last_unstale":"2024-09-10T05:56:14.150098+0000","last_undegraded":"2024-09-10T05:56:14.150098+0000","last_fullsized":"2024-09-10T05:56:14.150098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:09.009494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433250+0000","last_change":"2024-09-10T05:55:59.086336+0000","last_active":"2024-09-10T05:56:19.433250+0000","last_peered":"2024-09-10T05:56:19.433250+0000","last_clean":"2024-09-10T05:56:19.433250+0000","last_became_active":"2024-09-10T05:55:59.085881+0000","last_became_peered":"2024-09-10T05:55:59.085881+0000","last_unstale":"2024-09-10T05:56:19.433250+0000","last_undegraded":"2024-09-10T05:56:19.433250+0000","last_fullsized":"2024-09-10T05:56:19.433250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:12.761810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965390+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:56:18.965390+0000","last_peered":"2024-09-10T05:56:18.965390+0000","last_clean":"2024-09-10T05:56:18.965390+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:56:18.965390+0000","last_undegraded":"2024-09-10T05:56:18.965390+0000","last_fullsized":"2024-09-10T05:56:18.965390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151270+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:56:14.151270+0000","last_peered":"2024-09-10T05:56:14.151270+0000","last_clean":"2024-09-10T05:56:14.151270+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:56:14.151270+0000","last_undegraded":"2024-09-10T05:56:14.151270+0000","last_fullsized":"2024-09-10T05:56:14.151270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":970,"num_read_kb":697,"num_write":611,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":1210,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":8614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":583,"ondisk_log_size":583,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":877525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":287153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":651264,"data_stored":287564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":651264,"data_stored":318576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":60129542162,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":655360,"data_stored":326207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":325811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36572,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335268,"statfs":{"total":96636764160,"available":96599314432,"internally_reserved":0,"allocated":1245184,"data_stored":908515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:56:20.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:56:20.575 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:20.573+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:20.634 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:20.633+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:20.656 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:20.656 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:20.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:20.737 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:20.734+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:20.838 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:20.834+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:20.838 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:20.838 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:20.852 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:20.939 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:20.938+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:20.971 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:20.971 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:20.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:21.002 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:56:21.046 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:21.046+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:21.101 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:56:21.107 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:56:21.108 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:21.108 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:21.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:21.125 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-10T05:56:19.959497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":1040,"num_read_kb":756,"num_write":724,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":68,"num_bytes_recovered":2203,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":682,"ondisk_log_size":682,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":228060,"kb_used_data":5568,"kb_used_omap":10,"kb_used_meta":222325,"kb_avail":660374820,"statfs":{"total":676457349120,"available":676223815680,"internally_reserved":0,"allocated":5701632,"data_stored":3331351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11159,"internal_metadata":227660905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031580"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865300+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:56:15.865300+0000","last_peered":"2024-09-10T05:56:15.865300+0000","last_clean":"2024-09-10T05:56:15.865300+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:56:15.865300+0000","last_undegraded":"2024-09-10T05:56:15.865300+0000","last_fullsized":"2024-09-10T05:56:15.865300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149738+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:56:14.149738+0000","last_peered":"2024-09-10T05:56:14.149738+0000","last_clean":"2024-09-10T05:56:14.149738+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:56:14.149738+0000","last_undegraded":"2024-09-10T05:56:14.149738+0000","last_fullsized":"2024-09-10T05:56:14.149738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963139+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:56:18.963139+0000","last_peered":"2024-09-10T05:56:18.963139+0000","last_clean":"2024-09-10T05:56:18.963139+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:56:18.963139+0000","last_undegraded":"2024-09-10T05:56:18.963139+0000","last_fullsized":"2024-09-10T05:56:18.963139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864179+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:56:15.864179+0000","last_peered":"2024-09-10T05:56:15.864179+0000","last_clean":"2024-09-10T05:56:15.864179+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:56:15.864179+0000","last_undegraded":"2024-09-10T05:56:15.864179+0000","last_fullsized":"2024-09-10T05:56:15.864179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434852+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:56:19.434852+0000","last_peered":"2024-09-10T05:56:19.434852+0000","last_clean":"2024-09-10T05:56:19.434852+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:56:19.434852+0000","last_undegraded":"2024-09-10T05:56:19.434852+0000","last_fullsized":"2024-09-10T05:56:19.434852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432371+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:56:19.432371+0000","last_peered":"2024-09-10T05:56:19.432371+0000","last_clean":"2024-09-10T05:56:19.432371+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:56:19.432371+0000","last_undegraded":"2024-09-10T05:56:19.432371+0000","last_fullsized":"2024-09-10T05:56:19.432371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147520+0000","last_change":"2024-09-10T05:55:43.804731+0000","last_active":"2024-09-10T05:56:14.147520+0000","last_peered":"2024-09-10T05:56:14.147520+0000","last_clean":"2024-09-10T05:56:14.147520+0000","last_became_active":"2024-09-10T05:55:43.803747+0000","last_became_peered":"2024-09-10T05:55:43.803747+0000","last_unstale":"2024-09-10T05:56:14.147520+0000","last_undegraded":"2024-09-10T05:56:14.147520+0000","last_fullsized":"2024-09-10T05:56:14.147520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:30.829033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435178+0000","last_change":"2024-09-10T05:55:43.788656+0000","last_active":"2024-09-10T05:56:19.435178+0000","last_peered":"2024-09-10T05:56:19.435178+0000","last_clean":"2024-09-10T05:56:19.435178+0000","last_became_active":"2024-09-10T05:55:43.788140+0000","last_became_peered":"2024-09-10T05:55:43.788140+0000","last_unstale":"2024-09-10T05:56:19.435178+0000","last_undegraded":"2024-09-10T05:56:19.435178+0000","last_fullsized":"2024-09-10T05:56:19.435178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:48.182521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864452+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:56:15.864452+0000","last_peered":"2024-09-10T05:56:15.864452+0000","last_clean":"2024-09-10T05:56:15.864452+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:56:15.864452+0000","last_undegraded":"2024-09-10T05:56:15.864452+0000","last_fullsized":"2024-09-10T05:56:15.864452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147690+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:56:14.147690+0000","last_peered":"2024-09-10T05:56:14.147690+0000","last_clean":"2024-09-10T05:56:14.147690+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:56:14.147690+0000","last_undegraded":"2024-09-10T05:56:14.147690+0000","last_fullsized":"2024-09-10T05:56:14.147690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146860+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:56:14.146860+0000","last_peered":"2024-09-10T05:56:14.146860+0000","last_clean":"2024-09-10T05:56:14.146860+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:56:14.146860+0000","last_undegraded":"2024-09-10T05:56:14.146860+0000","last_fullsized":"2024-09-10T05:56:14.146860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434365+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:56:19.434365+0000","last_peered":"2024-09-10T05:56:19.434365+0000","last_clean":"2024-09-10T05:56:19.434365+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:56:19.434365+0000","last_undegraded":"2024-09-10T05:56:19.434365+0000","last_fullsized":"2024-09-10T05:56:19.434365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864311+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:56:15.864311+0000","last_peered":"2024-09-10T05:56:15.864311+0000","last_clean":"2024-09-10T05:56:15.864311+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:56:15.864311+0000","last_undegraded":"2024-09-10T05:56:15.864311+0000","last_fullsized":"2024-09-10T05:56:15.864311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150979+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:56:14.150979+0000","last_peered":"2024-09-10T05:56:14.150979+0000","last_clean":"2024-09-10T05:56:14.150979+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:56:14.150979+0000","last_undegraded":"2024-09-10T05:56:14.150979+0000","last_fullsized":"2024-09-10T05:56:14.150979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149972+0000","last_change":"2024-09-10T05:55:43.790799+0000","last_active":"2024-09-10T05:56:14.149972+0000","last_peered":"2024-09-10T05:56:14.149972+0000","last_clean":"2024-09-10T05:56:14.149972+0000","last_became_active":"2024-09-10T05:55:43.789586+0000","last_became_peered":"2024-09-10T05:55:43.789586+0000","last_unstale":"2024-09-10T05:56:14.149972+0000","last_undegraded":"2024-09-10T05:56:14.149972+0000","last_fullsized":"2024-09-10T05:56:14.149972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:40.561423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434804+0000","last_change":"2024-09-10T05:55:43.775788+0000","last_active":"2024-09-10T05:56:19.434804+0000","last_peered":"2024-09-10T05:56:19.434804+0000","last_clean":"2024-09-10T05:56:19.434804+0000","last_became_active":"2024-09-10T05:55:43.775401+0000","last_became_peered":"2024-09-10T05:55:43.775401+0000","last_unstale":"2024-09-10T05:56:19.434804+0000","last_undegraded":"2024-09-10T05:56:19.434804+0000","last_fullsized":"2024-09-10T05:56:19.434804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:53:15.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428519+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:56:19.428519+0000","last_peered":"2024-09-10T05:56:19.428519+0000","last_clean":"2024-09-10T05:56:19.428519+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:56:19.428519+0000","last_undegraded":"2024-09-10T05:56:19.428519+0000","last_fullsized":"2024-09-10T05:56:19.428519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865365+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:56:15.865365+0000","last_peered":"2024-09-10T05:56:15.865365+0000","last_clean":"2024-09-10T05:56:15.865365+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:56:15.865365+0000","last_undegraded":"2024-09-10T05:56:15.865365+0000","last_fullsized":"2024-09-10T05:56:15.865365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864250+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:56:15.864250+0000","last_peered":"2024-09-10T05:56:15.864250+0000","last_clean":"2024-09-10T05:56:15.864250+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:56:15.864250+0000","last_undegraded":"2024-09-10T05:56:15.864250+0000","last_fullsized":"2024-09-10T05:56:15.864250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148088+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:56:14.148088+0000","last_peered":"2024-09-10T05:56:14.148088+0000","last_clean":"2024-09-10T05:56:14.148088+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:56:14.148088+0000","last_undegraded":"2024-09-10T05:56:14.148088+0000","last_fullsized":"2024-09-10T05:56:14.148088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149762+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:56:14.149762+0000","last_peered":"2024-09-10T05:56:14.149762+0000","last_clean":"2024-09-10T05:56:14.149762+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:56:14.149762+0000","last_undegraded":"2024-09-10T05:56:14.149762+0000","last_fullsized":"2024-09-10T05:56:14.149762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148185+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:56:14.148185+0000","last_peered":"2024-09-10T05:56:14.148185+0000","last_clean":"2024-09-10T05:56:14.148185+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:56:14.148185+0000","last_undegraded":"2024-09-10T05:56:14.148185+0000","last_fullsized":"2024-09-10T05:56:14.148185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432481+0000","last_change":"2024-09-10T05:55:43.773318+0000","last_active":"2024-09-10T05:56:19.432481+0000","last_peered":"2024-09-10T05:56:19.432481+0000","last_clean":"2024-09-10T05:56:19.432481+0000","last_became_active":"2024-09-10T05:55:43.771765+0000","last_became_peered":"2024-09-10T05:55:43.771765+0000","last_unstale":"2024-09-10T05:56:19.432481+0000","last_undegraded":"2024-09-10T05:56:19.432481+0000","last_fullsized":"2024-09-10T05:56:19.432481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:55.396963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434052+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:56:19.434052+0000","last_peered":"2024-09-10T05:56:19.434052+0000","last_clean":"2024-09-10T05:56:19.434052+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:56:19.434052+0000","last_undegraded":"2024-09-10T05:56:19.434052+0000","last_fullsized":"2024-09-10T05:56:19.434052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433265+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:56:19.433265+0000","last_peered":"2024-09-10T05:56:19.433265+0000","last_clean":"2024-09-10T05:56:19.433265+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:56:19.433265+0000","last_undegraded":"2024-09-10T05:56:19.433265+0000","last_fullsized":"2024-09-10T05:56:19.433265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146865+0000","last_change":"2024-09-10T05:55:43.786424+0000","last_active":"2024-09-10T05:56:14.146865+0000","last_peered":"2024-09-10T05:56:14.146865+0000","last_clean":"2024-09-10T05:56:14.146865+0000","last_became_active":"2024-09-10T05:55:43.785736+0000","last_became_peered":"2024-09-10T05:55:43.785736+0000","last_unstale":"2024-09-10T05:56:14.146865+0000","last_undegraded":"2024-09-10T05:56:14.146865+0000","last_fullsized":"2024-09-10T05:56:14.146865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:42.745694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434498+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:56:19.434498+0000","last_peered":"2024-09-10T05:56:19.434498+0000","last_clean":"2024-09-10T05:56:19.434498+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:56:19.434498+0000","last_undegraded":"2024-09-10T05:56:19.434498+0000","last_fullsized":"2024-09-10T05:56:19.434498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435089+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:56:19.435089+0000","last_peered":"2024-09-10T05:56:19.435089+0000","last_clean":"2024-09-10T05:56:19.435089+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:56:19.435089+0000","last_undegraded":"2024-09-10T05:56:19.435089+0000","last_fullsized":"2024-09-10T05:56:19.435089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428252+0000","last_change":"2024-09-10T05:55:43.798168+0000","last_active":"2024-09-10T05:56:19.428252+0000","last_peered":"2024-09-10T05:56:19.428252+0000","last_clean":"2024-09-10T05:56:19.428252+0000","last_became_active":"2024-09-10T05:55:43.797637+0000","last_became_peered":"2024-09-10T05:55:43.797637+0000","last_unstale":"2024-09-10T05:56:19.428252+0000","last_undegraded":"2024-09-10T05:56:19.428252+0000","last_fullsized":"2024-09-10T05:56:19.428252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:56.326108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964920+0000","last_change":"2024-09-10T05:55:43.788530+0000","last_active":"2024-09-10T05:56:18.964920+0000","last_peered":"2024-09-10T05:56:18.964920+0000","last_clean":"2024-09-10T05:56:18.964920+0000","last_became_active":"2024-09-10T05:55:43.788081+0000","last_became_peered":"2024-09-10T05:55:43.788081+0000","last_unstale":"2024-09-10T05:56:18.964920+0000","last_undegraded":"2024-09-10T05:56:18.964920+0000","last_fullsized":"2024-09-10T05:56:18.964920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:23.116687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864607+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:56:15.864607+0000","last_peered":"2024-09-10T05:56:15.864607+0000","last_clean":"2024-09-10T05:56:15.864607+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:56:15.864607+0000","last_undegraded":"2024-09-10T05:56:15.864607+0000","last_fullsized":"2024-09-10T05:56:15.864607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146172+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:56:14.146172+0000","last_peered":"2024-09-10T05:56:14.146172+0000","last_clean":"2024-09-10T05:56:14.146172+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:56:14.146172+0000","last_undegraded":"2024-09-10T05:56:14.146172+0000","last_fullsized":"2024-09-10T05:56:14.146172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"36'21","reported_seq":98,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433985+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:56:19.433985+0000","last_peered":"2024-09-10T05:56:19.433985+0000","last_clean":"2024-09-10T05:56:19.433985+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:56:19.433985+0000","last_undegraded":"2024-09-10T05:56:19.433985+0000","last_fullsized":"2024-09-10T05:56:19.433985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865077+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:56:15.865077+0000","last_peered":"2024-09-10T05:56:15.865077+0000","last_clean":"2024-09-10T05:56:15.865077+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:56:15.865077+0000","last_undegraded":"2024-09-10T05:56:15.865077+0000","last_fullsized":"2024-09-10T05:56:15.865077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145187+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:56:14.145187+0000","last_peered":"2024-09-10T05:56:14.145187+0000","last_clean":"2024-09-10T05:56:14.145187+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:56:14.145187+0000","last_undegraded":"2024-09-10T05:56:14.145187+0000","last_fullsized":"2024-09-10T05:56:14.145187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147092+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:56:14.147092+0000","last_peered":"2024-09-10T05:56:14.147092+0000","last_clean":"2024-09-10T05:56:14.147092+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:56:14.147092+0000","last_undegraded":"2024-09-10T05:56:14.147092+0000","last_fullsized":"2024-09-10T05:56:14.147092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435225+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:56:19.435225+0000","last_peered":"2024-09-10T05:56:19.435225+0000","last_clean":"2024-09-10T05:56:19.435225+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:56:19.435225+0000","last_undegraded":"2024-09-10T05:56:19.435225+0000","last_fullsized":"2024-09-10T05:56:19.435225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863085+0000","last_change":"2024-09-10T05:55:43.781137+0000","last_active":"2024-09-10T05:56:15.863085+0000","last_peered":"2024-09-10T05:56:15.863085+0000","last_clean":"2024-09-10T05:56:15.863085+0000","last_became_active":"2024-09-10T05:55:43.780355+0000","last_became_peered":"2024-09-10T05:55:43.780355+0000","last_unstale":"2024-09-10T05:56:15.863085+0000","last_undegraded":"2024-09-10T05:56:15.863085+0000","last_fullsized":"2024-09-10T05:56:15.863085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:06.200157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.436650+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:56:19.436650+0000","last_peered":"2024-09-10T05:56:19.436650+0000","last_clean":"2024-09-10T05:56:19.436650+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:56:19.436650+0000","last_undegraded":"2024-09-10T05:56:19.436650+0000","last_fullsized":"2024-09-10T05:56:19.436650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434259+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:56:19.434259+0000","last_peered":"2024-09-10T05:56:19.434259+0000","last_clean":"2024-09-10T05:56:19.434259+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:56:19.434259+0000","last_undegraded":"2024-09-10T05:56:19.434259+0000","last_fullsized":"2024-09-10T05:56:19.434259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431377+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:56:19.431377+0000","last_peered":"2024-09-10T05:56:19.431377+0000","last_clean":"2024-09-10T05:56:19.431377+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:56:19.431377+0000","last_undegraded":"2024-09-10T05:56:19.431377+0000","last_fullsized":"2024-09-10T05:56:19.431377+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434504+0000","last_change":"2024-09-10T05:55:43.795909+0000","last_active":"2024-09-10T05:56:19.434504+0000","last_peered":"2024-09-10T05:56:19.434504+0000","last_clean":"2024-09-10T05:56:19.434504+0000","last_became_active":"2024-09-10T05:55:43.795415+0000","last_became_peered":"2024-09-10T05:55:43.795415+0000","last_unstale":"2024-09-10T05:56:19.434504+0000","last_undegraded":"2024-09-10T05:56:19.434504+0000","last_fullsized":"2024-09-10T05:56:19.434504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:03.765583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864362+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:56:15.864362+0000","last_peered":"2024-09-10T05:56:15.864362+0000","last_clean":"2024-09-10T05:56:15.864362+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:56:15.864362+0000","last_undegraded":"2024-09-10T05:56:15.864362+0000","last_fullsized":"2024-09-10T05:56:15.864362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963578+0000","last_change":"2024-09-10T05:55:43.795794+0000","last_active":"2024-09-10T05:56:18.963578+0000","last_peered":"2024-09-10T05:56:18.963578+0000","last_clean":"2024-09-10T05:56:18.963578+0000","last_became_active":"2024-09-10T05:55:43.795416+0000","last_became_peered":"2024-09-10T05:55:43.795416+0000","last_unstale":"2024-09-10T05:56:18.963578+0000","last_undegraded":"2024-09-10T05:56:18.963578+0000","last_fullsized":"2024-09-10T05:56:18.963578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:42.056013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"36'22","reported_seq":97,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433084+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:56:19.433084+0000","last_peered":"2024-09-10T05:56:19.433084+0000","last_clean":"2024-09-10T05:56:19.433084+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:56:19.433084+0000","last_undegraded":"2024-09-10T05:56:19.433084+0000","last_fullsized":"2024-09-10T05:56:19.433084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864699+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:56:15.864699+0000","last_peered":"2024-09-10T05:56:15.864699+0000","last_clean":"2024-09-10T05:56:15.864699+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:56:15.864699+0000","last_undegraded":"2024-09-10T05:56:15.864699+0000","last_fullsized":"2024-09-10T05:56:15.864699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433709+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:56:19.433709+0000","last_peered":"2024-09-10T05:56:19.433709+0000","last_clean":"2024-09-10T05:56:19.433709+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:56:19.433709+0000","last_undegraded":"2024-09-10T05:56:19.433709+0000","last_fullsized":"2024-09-10T05:56:19.433709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865158+0000","last_change":"2024-09-10T05:55:43.784661+0000","last_active":"2024-09-10T05:56:15.865158+0000","last_peered":"2024-09-10T05:56:15.865158+0000","last_clean":"2024-09-10T05:56:15.865158+0000","last_became_active":"2024-09-10T05:55:43.784277+0000","last_became_peered":"2024-09-10T05:55:43.784277+0000","last_unstale":"2024-09-10T05:56:15.865158+0000","last_undegraded":"2024-09-10T05:56:15.865158+0000","last_fullsized":"2024-09-10T05:56:15.865158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:28.154316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144842+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:56:14.144842+0000","last_peered":"2024-09-10T05:56:14.144842+0000","last_clean":"2024-09-10T05:56:14.144842+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:56:14.144842+0000","last_undegraded":"2024-09-10T05:56:14.144842+0000","last_fullsized":"2024-09-10T05:56:14.144842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":59,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150855+0000","last_change":"2024-09-10T05:55:43.761821+0000","last_active":"2024-09-10T05:56:14.150855+0000","last_peered":"2024-09-10T05:56:14.150855+0000","last_clean":"2024-09-10T05:56:14.150855+0000","last_became_active":"2024-09-10T05:55:43.761009+0000","last_became_peered":"2024-09-10T05:55:43.761009+0000","last_unstale":"2024-09-10T05:56:14.150855+0000","last_undegraded":"2024-09-10T05:56:14.150855+0000","last_fullsized":"2024-09-10T05:56:14.150855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:18.510650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'15","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865091+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:56:15.865091+0000","last_peered":"2024-09-10T05:56:15.865091+0000","last_clean":"2024-09-10T05:56:15.865091+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:56:15.865091+0000","last_undegraded":"2024-09-10T05:56:15.865091+0000","last_fullsized":"2024-09-10T05:56:15.865091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"38'3","reported_seq":67,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433000+0000","last_change":"2024-09-10T05:55:43.818014+0000","last_active":"2024-09-10T05:56:19.433000+0000","last_peered":"2024-09-10T05:56:19.433000+0000","last_clean":"2024-09-10T05:56:19.433000+0000","last_became_active":"2024-09-10T05:55:43.775963+0000","last_became_peered":"2024-09-10T05:55:43.775963+0000","last_unstale":"2024-09-10T05:56:19.433000+0000","last_undegraded":"2024-09-10T05:56:19.433000+0000","last_fullsized":"2024-09-10T05:56:19.433000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:00.783230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149973+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:56:14.149973+0000","last_peered":"2024-09-10T05:56:14.149973+0000","last_clean":"2024-09-10T05:56:14.149973+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:56:14.149973+0000","last_undegraded":"2024-09-10T05:56:14.149973+0000","last_fullsized":"2024-09-10T05:56:14.149973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865415+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:56:15.865415+0000","last_peered":"2024-09-10T05:56:15.865415+0000","last_clean":"2024-09-10T05:56:15.865415+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:56:15.865415+0000","last_undegraded":"2024-09-10T05:56:15.865415+0000","last_fullsized":"2024-09-10T05:56:15.865415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863846+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:56:15.863846+0000","last_peered":"2024-09-10T05:56:15.863846+0000","last_clean":"2024-09-10T05:56:15.863846+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:56:15.863846+0000","last_undegraded":"2024-09-10T05:56:15.863846+0000","last_fullsized":"2024-09-10T05:56:15.863846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"36'25","reported_seq":92,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146126+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:56:14.146126+0000","last_peered":"2024-09-10T05:56:14.146126+0000","last_clean":"2024-09-10T05:56:14.146126+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:56:14.146126+0000","last_undegraded":"2024-09-10T05:56:14.146126+0000","last_fullsized":"2024-09-10T05:56:14.146126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964338+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:56:18.964338+0000","last_peered":"2024-09-10T05:56:18.964338+0000","last_clean":"2024-09-10T05:56:18.964338+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:56:18.964338+0000","last_undegraded":"2024-09-10T05:56:18.964338+0000","last_fullsized":"2024-09-10T05:56:18.964338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146866+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:56:14.146866+0000","last_peered":"2024-09-10T05:56:14.146866+0000","last_clean":"2024-09-10T05:56:14.146866+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:56:14.146866+0000","last_undegraded":"2024-09-10T05:56:14.146866+0000","last_fullsized":"2024-09-10T05:56:14.146866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432700+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:56:19.432700+0000","last_peered":"2024-09-10T05:56:19.432700+0000","last_clean":"2024-09-10T05:56:19.432700+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:56:19.432700+0000","last_undegraded":"2024-09-10T05:56:19.432700+0000","last_fullsized":"2024-09-10T05:56:19.432700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865079+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:56:15.865079+0000","last_peered":"2024-09-10T05:56:15.865079+0000","last_clean":"2024-09-10T05:56:15.865079+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:56:15.865079+0000","last_undegraded":"2024-09-10T05:56:15.865079+0000","last_fullsized":"2024-09-10T05:56:15.865079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430865+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:56:19.430865+0000","last_peered":"2024-09-10T05:56:19.430865+0000","last_clean":"2024-09-10T05:56:19.430865+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:56:19.430865+0000","last_undegraded":"2024-09-10T05:56:19.430865+0000","last_fullsized":"2024-09-10T05:56:19.430865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'15","reported_seq":97,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863948+0000","last_change":"2024-09-10T05:55:43.802630+0000","last_active":"2024-09-10T05:56:15.863948+0000","last_peered":"2024-09-10T05:56:15.863948+0000","last_clean":"2024-09-10T05:56:15.863948+0000","last_became_active":"2024-09-10T05:55:43.773806+0000","last_became_peered":"2024-09-10T05:55:43.773806+0000","last_unstale":"2024-09-10T05:56:15.863948+0000","last_undegraded":"2024-09-10T05:56:15.863948+0000","last_fullsized":"2024-09-10T05:56:15.863948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:59.565736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432016+0000","last_change":"2024-09-10T05:55:43.778724+0000","last_active":"2024-09-10T05:56:19.432016+0000","last_peered":"2024-09-10T05:56:19.432016+0000","last_clean":"2024-09-10T05:56:19.432016+0000","last_became_active":"2024-09-10T05:55:43.777710+0000","last_became_peered":"2024-09-10T05:55:43.777710+0000","last_unstale":"2024-09-10T05:56:19.432016+0000","last_undegraded":"2024-09-10T05:56:19.432016+0000","last_fullsized":"2024-09-10T05:56:19.432016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:20.180853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147038+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:56:14.147038+0000","last_peered":"2024-09-10T05:56:14.147038+0000","last_clean":"2024-09-10T05:56:14.147038+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:56:14.147038+0000","last_undegraded":"2024-09-10T05:56:14.147038+0000","last_fullsized":"2024-09-10T05:56:14.147038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148285+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:56:14.148285+0000","last_peered":"2024-09-10T05:56:14.148285+0000","last_clean":"2024-09-10T05:56:14.148285+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:56:14.148285+0000","last_undegraded":"2024-09-10T05:56:14.148285+0000","last_fullsized":"2024-09-10T05:56:14.148285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865779+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:56:15.865779+0000","last_peered":"2024-09-10T05:56:15.865779+0000","last_clean":"2024-09-10T05:56:15.865779+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:56:15.865779+0000","last_undegraded":"2024-09-10T05:56:15.865779+0000","last_fullsized":"2024-09-10T05:56:15.865779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432760+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:56:19.432760+0000","last_peered":"2024-09-10T05:56:19.432760+0000","last_clean":"2024-09-10T05:56:19.432760+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:56:19.432760+0000","last_undegraded":"2024-09-10T05:56:19.432760+0000","last_fullsized":"2024-09-10T05:56:19.432760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'27","reported_seq":100,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864153+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:56:15.864153+0000","last_peered":"2024-09-10T05:56:15.864153+0000","last_clean":"2024-09-10T05:56:15.864153+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:56:15.864153+0000","last_undegraded":"2024-09-10T05:56:15.864153+0000","last_fullsized":"2024-09-10T05:56:15.864153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435452+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:56:19.435452+0000","last_peered":"2024-09-10T05:56:19.435452+0000","last_clean":"2024-09-10T05:56:19.435452+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:56:19.435452+0000","last_undegraded":"2024-09-10T05:56:19.435452+0000","last_fullsized":"2024-09-10T05:56:19.435452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434065+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:56:19.434065+0000","last_peered":"2024-09-10T05:56:19.434065+0000","last_clean":"2024-09-10T05:56:19.434065+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:56:19.434065+0000","last_undegraded":"2024-09-10T05:56:19.434065+0000","last_fullsized":"2024-09-10T05:56:19.434065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435871+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:56:19.435871+0000","last_peered":"2024-09-10T05:56:19.435871+0000","last_clean":"2024-09-10T05:56:19.435871+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:56:19.435871+0000","last_undegraded":"2024-09-10T05:56:19.435871+0000","last_fullsized":"2024-09-10T05:56:19.435871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148119+0000","last_change":"2024-09-10T05:55:43.782175+0000","last_active":"2024-09-10T05:56:14.148119+0000","last_peered":"2024-09-10T05:56:14.148119+0000","last_clean":"2024-09-10T05:56:14.148119+0000","last_became_active":"2024-09-10T05:55:43.781529+0000","last_became_peered":"2024-09-10T05:55:43.781529+0000","last_unstale":"2024-09-10T05:56:14.148119+0000","last_undegraded":"2024-09-10T05:56:14.148119+0000","last_fullsized":"2024-09-10T05:56:14.148119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:51.726984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432192+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:56:19.432192+0000","last_peered":"2024-09-10T05:56:19.432192+0000","last_clean":"2024-09-10T05:56:19.432192+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:56:19.432192+0000","last_undegraded":"2024-09-10T05:56:19.432192+0000","last_fullsized":"2024-09-10T05:56:19.432192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'24","reported_seq":105,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437613+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:56:19.437613+0000","last_peered":"2024-09-10T05:56:19.437613+0000","last_clean":"2024-09-10T05:56:19.437613+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:56:19.437613+0000","last_undegraded":"2024-09-10T05:56:19.437613+0000","last_fullsized":"2024-09-10T05:56:19.437613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430726+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:56:19.430726+0000","last_peered":"2024-09-10T05:56:19.430726+0000","last_clean":"2024-09-10T05:56:19.430726+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:56:19.430726+0000","last_undegraded":"2024-09-10T05:56:19.430726+0000","last_fullsized":"2024-09-10T05:56:19.430726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963463+0000","last_change":"2024-09-10T05:55:43.791193+0000","last_active":"2024-09-10T05:56:18.963463+0000","last_peered":"2024-09-10T05:56:18.963463+0000","last_clean":"2024-09-10T05:56:18.963463+0000","last_became_active":"2024-09-10T05:55:43.790472+0000","last_became_peered":"2024-09-10T05:55:43.790472+0000","last_unstale":"2024-09-10T05:56:18.963463+0000","last_undegraded":"2024-09-10T05:56:18.963463+0000","last_fullsized":"2024-09-10T05:56:18.963463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434165+0000","last_change":"2024-09-10T05:55:43.760288+0000","last_active":"2024-09-10T05:56:19.434165+0000","last_peered":"2024-09-10T05:56:19.434165+0000","last_clean":"2024-09-10T05:56:19.434165+0000","last_became_active":"2024-09-10T05:55:43.747995+0000","last_became_peered":"2024-09-10T05:55:43.747995+0000","last_unstale":"2024-09-10T05:56:19.434165+0000","last_undegraded":"2024-09-10T05:56:19.434165+0000","last_fullsized":"2024-09-10T05:56:19.434165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:43.892408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435644+0000","last_change":"2024-09-10T05:55:43.782540+0000","last_active":"2024-09-10T05:56:19.435644+0000","last_peered":"2024-09-10T05:56:19.435644+0000","last_clean":"2024-09-10T05:56:19.435644+0000","last_became_active":"2024-09-10T05:55:43.782267+0000","last_became_peered":"2024-09-10T05:55:43.782267+0000","last_unstale":"2024-09-10T05:56:19.435644+0000","last_undegraded":"2024-09-10T05:56:19.435644+0000","last_fullsized":"2024-09-10T05:56:19.435644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:07.747698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433570+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:56:19.433570+0000","last_peered":"2024-09-10T05:56:19.433570+0000","last_clean":"2024-09-10T05:56:19.433570+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:56:19.433570+0000","last_undegraded":"2024-09-10T05:56:19.433570+0000","last_fullsized":"2024-09-10T05:56:19.433570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'19","reported_seq":91,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434346+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:56:19.434346+0000","last_peered":"2024-09-10T05:56:19.434346+0000","last_clean":"2024-09-10T05:56:19.434346+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:56:19.434346+0000","last_undegraded":"2024-09-10T05:56:19.434346+0000","last_fullsized":"2024-09-10T05:56:19.434346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433178+0000","last_change":"2024-09-10T05:55:43.795947+0000","last_active":"2024-09-10T05:56:19.433178+0000","last_peered":"2024-09-10T05:56:19.433178+0000","last_clean":"2024-09-10T05:56:19.433178+0000","last_became_active":"2024-09-10T05:55:43.795420+0000","last_became_peered":"2024-09-10T05:55:43.795420+0000","last_unstale":"2024-09-10T05:56:19.433178+0000","last_undegraded":"2024-09-10T05:56:19.433178+0000","last_fullsized":"2024-09-10T05:56:19.433178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:54.709923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149679+0000","last_change":"2024-09-10T05:55:43.790125+0000","last_active":"2024-09-10T05:56:14.149679+0000","last_peered":"2024-09-10T05:56:14.149679+0000","last_clean":"2024-09-10T05:56:14.149679+0000","last_became_active":"2024-09-10T05:55:43.789048+0000","last_became_peered":"2024-09-10T05:55:43.789048+0000","last_unstale":"2024-09-10T05:56:14.149679+0000","last_undegraded":"2024-09-10T05:56:14.149679+0000","last_fullsized":"2024-09-10T05:56:14.149679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:16.637837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434642+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:56:19.434642+0000","last_peered":"2024-09-10T05:56:19.434642+0000","last_clean":"2024-09-10T05:56:19.434642+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:56:19.434642+0000","last_undegraded":"2024-09-10T05:56:19.434642+0000","last_fullsized":"2024-09-10T05:56:19.434642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148667+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:56:14.148667+0000","last_peered":"2024-09-10T05:56:14.148667+0000","last_clean":"2024-09-10T05:56:14.148667+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:56:14.148667+0000","last_undegraded":"2024-09-10T05:56:14.148667+0000","last_fullsized":"2024-09-10T05:56:14.148667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964831+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:56:18.964831+0000","last_peered":"2024-09-10T05:56:18.964831+0000","last_clean":"2024-09-10T05:56:18.964831+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:56:18.964831+0000","last_undegraded":"2024-09-10T05:56:18.964831+0000","last_fullsized":"2024-09-10T05:56:18.964831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":105,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434641+0000","last_change":"2024-09-10T05:55:43.844826+0000","last_active":"2024-09-10T05:56:19.434641+0000","last_peered":"2024-09-10T05:56:19.434641+0000","last_clean":"2024-09-10T05:56:19.434641+0000","last_became_active":"2024-09-10T05:55:43.784802+0000","last_became_peered":"2024-09-10T05:55:43.784802+0000","last_unstale":"2024-09-10T05:56:19.434641+0000","last_undegraded":"2024-09-10T05:56:19.434641+0000","last_fullsized":"2024-09-10T05:56:19.434641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433996+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:56:19.433996+0000","last_peered":"2024-09-10T05:56:19.433996+0000","last_clean":"2024-09-10T05:56:19.433996+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:56:19.433996+0000","last_undegraded":"2024-09-10T05:56:19.433996+0000","last_fullsized":"2024-09-10T05:56:19.433996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965180+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:56:18.965180+0000","last_peered":"2024-09-10T05:56:18.965180+0000","last_clean":"2024-09-10T05:56:18.965180+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:56:18.965180+0000","last_undegraded":"2024-09-10T05:56:18.965180+0000","last_fullsized":"2024-09-10T05:56:18.965180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434614+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:56:19.434614+0000","last_peered":"2024-09-10T05:56:19.434614+0000","last_clean":"2024-09-10T05:56:19.434614+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:56:19.434614+0000","last_undegraded":"2024-09-10T05:56:19.434614+0000","last_fullsized":"2024-09-10T05:56:19.434614+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433738+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:56:19.433738+0000","last_peered":"2024-09-10T05:56:19.433738+0000","last_clean":"2024-09-10T05:56:19.433738+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:56:19.433738+0000","last_undegraded":"2024-09-10T05:56:19.433738+0000","last_fullsized":"2024-09-10T05:56:19.433738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151264+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:56:14.151264+0000","last_peered":"2024-09-10T05:56:14.151264+0000","last_clean":"2024-09-10T05:56:14.151264+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:56:14.151264+0000","last_undegraded":"2024-09-10T05:56:14.151264+0000","last_fullsized":"2024-09-10T05:56:14.151264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":82,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147291+0000","last_change":"2024-09-10T05:55:43.813877+0000","last_active":"2024-09-10T05:56:14.147291+0000","last_peered":"2024-09-10T05:56:14.147291+0000","last_clean":"2024-09-10T05:56:14.147291+0000","last_became_active":"2024-09-10T05:55:43.783681+0000","last_became_peered":"2024-09-10T05:55:43.783681+0000","last_unstale":"2024-09-10T05:56:14.147291+0000","last_undegraded":"2024-09-10T05:56:14.147291+0000","last_fullsized":"2024-09-10T05:56:14.147291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:26.548640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147449+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:56:14.147449+0000","last_peered":"2024-09-10T05:56:14.147449+0000","last_clean":"2024-09-10T05:56:14.147449+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:56:14.147449+0000","last_undegraded":"2024-09-10T05:56:14.147449+0000","last_fullsized":"2024-09-10T05:56:14.147449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432366+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:56:19.432366+0000","last_peered":"2024-09-10T05:56:19.432366+0000","last_clean":"2024-09-10T05:56:19.432366+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:56:19.432366+0000","last_undegraded":"2024-09-10T05:56:19.432366+0000","last_fullsized":"2024-09-10T05:56:19.432366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963718+0000","last_change":"2024-09-10T05:55:43.787138+0000","last_active":"2024-09-10T05:56:18.963718+0000","last_peered":"2024-09-10T05:56:18.963718+0000","last_clean":"2024-09-10T05:56:18.963718+0000","last_became_active":"2024-09-10T05:55:43.786492+0000","last_became_peered":"2024-09-10T05:55:43.786492+0000","last_unstale":"2024-09-10T05:56:18.963718+0000","last_undegraded":"2024-09-10T05:56:18.963718+0000","last_fullsized":"2024-09-10T05:56:18.963718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:45.863027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961604+0000","last_change":"2024-09-10T05:55:43.790575+0000","last_active":"2024-09-10T05:56:18.961604+0000","last_peered":"2024-09-10T05:56:18.961604+0000","last_clean":"2024-09-10T05:56:18.961604+0000","last_became_active":"2024-09-10T05:55:43.790048+0000","last_became_peered":"2024-09-10T05:55:43.790048+0000","last_unstale":"2024-09-10T05:56:18.961604+0000","last_undegraded":"2024-09-10T05:56:18.961604+0000","last_fullsized":"2024-09-10T05:56:18.961604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:56.946415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434471+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:56:19.434471+0000","last_peered":"2024-09-10T05:56:19.434471+0000","last_clean":"2024-09-10T05:56:19.434471+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:56:19.434471+0000","last_undegraded":"2024-09-10T05:56:19.434471+0000","last_fullsized":"2024-09-10T05:56:19.434471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144842+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:56:14.144842+0000","last_peered":"2024-09-10T05:56:14.144842+0000","last_clean":"2024-09-10T05:56:14.144842+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:56:14.144842+0000","last_undegraded":"2024-09-10T05:56:14.144842+0000","last_fullsized":"2024-09-10T05:56:14.144842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147015+0000","last_change":"2024-09-10T05:55:43.805379+0000","last_active":"2024-09-10T05:56:14.147015+0000","last_peered":"2024-09-10T05:56:14.147015+0000","last_clean":"2024-09-10T05:56:14.147015+0000","last_became_active":"2024-09-10T05:55:43.804869+0000","last_became_peered":"2024-09-10T05:55:43.804869+0000","last_unstale":"2024-09-10T05:56:14.147015+0000","last_undegraded":"2024-09-10T05:56:14.147015+0000","last_fullsized":"2024-09-10T05:56:14.147015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:50.109759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961932+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:56:18.961932+0000","last_peered":"2024-09-10T05:56:18.961932+0000","last_clean":"2024-09-10T05:56:18.961932+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:56:18.961932+0000","last_undegraded":"2024-09-10T05:56:18.961932+0000","last_fullsized":"2024-09-10T05:56:18.961932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148001+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:56:14.148001+0000","last_peered":"2024-09-10T05:56:14.148001+0000","last_clean":"2024-09-10T05:56:14.148001+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:56:14.148001+0000","last_undegraded":"2024-09-10T05:56:14.148001+0000","last_fullsized":"2024-09-10T05:56:14.148001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":168,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864183+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:56:15.864183+0000","last_peered":"2024-09-10T05:56:15.864183+0000","last_clean":"2024-09-10T05:56:15.864183+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:56:15.864183+0000","last_undegraded":"2024-09-10T05:56:15.864183+0000","last_fullsized":"2024-09-10T05:56:15.864183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":75,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145844+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:56:14.145844+0000","last_peered":"2024-09-10T05:56:14.145844+0000","last_clean":"2024-09-10T05:56:14.145844+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:56:14.145844+0000","last_undegraded":"2024-09-10T05:56:14.145844+0000","last_fullsized":"2024-09-10T05:56:14.145844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146634+0000","last_change":"2024-09-10T05:55:43.771383+0000","last_active":"2024-09-10T05:56:14.146634+0000","last_peered":"2024-09-10T05:56:14.146634+0000","last_clean":"2024-09-10T05:56:14.146634+0000","last_became_active":"2024-09-10T05:55:43.770582+0000","last_became_peered":"2024-09-10T05:55:43.770582+0000","last_unstale":"2024-09-10T05:56:14.146634+0000","last_undegraded":"2024-09-10T05:56:14.146634+0000","last_fullsized":"2024-09-10T05:56:14.146634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:01.378507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864882+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:56:15.864882+0000","last_peered":"2024-09-10T05:56:15.864882+0000","last_clean":"2024-09-10T05:56:15.864882+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:56:15.864882+0000","last_undegraded":"2024-09-10T05:56:15.864882+0000","last_fullsized":"2024-09-10T05:56:15.864882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"36'19","reported_seq":108,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151408+0000","last_change":"2024-09-10T05:55:43.817149+0000","last_active":"2024-09-10T05:56:14.151408+0000","last_peered":"2024-09-10T05:56:14.151408+0000","last_clean":"2024-09-10T05:56:14.151408+0000","last_became_active":"2024-09-10T05:55:43.795185+0000","last_became_peered":"2024-09-10T05:55:43.795185+0000","last_unstale":"2024-09-10T05:56:14.151408+0000","last_undegraded":"2024-09-10T05:56:14.151408+0000","last_fullsized":"2024-09-10T05:56:14.151408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:51.132750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434138+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:56:19.434138+0000","last_peered":"2024-09-10T05:56:19.434138+0000","last_clean":"2024-09-10T05:56:19.434138+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:56:19.434138+0000","last_undegraded":"2024-09-10T05:56:19.434138+0000","last_fullsized":"2024-09-10T05:56:19.434138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145007+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:56:14.145007+0000","last_peered":"2024-09-10T05:56:14.145007+0000","last_clean":"2024-09-10T05:56:14.145007+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:56:14.145007+0000","last_undegraded":"2024-09-10T05:56:14.145007+0000","last_fullsized":"2024-09-10T05:56:14.145007+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434391+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:56:19.434391+0000","last_peered":"2024-09-10T05:56:19.434391+0000","last_clean":"2024-09-10T05:56:19.434391+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:56:19.434391+0000","last_undegraded":"2024-09-10T05:56:19.434391+0000","last_fullsized":"2024-09-10T05:56:19.434391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864038+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:56:15.864038+0000","last_peered":"2024-09-10T05:56:15.864038+0000","last_clean":"2024-09-10T05:56:15.864038+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:56:15.864038+0000","last_undegraded":"2024-09-10T05:56:15.864038+0000","last_fullsized":"2024-09-10T05:56:15.864038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437699+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:56:19.437699+0000","last_peered":"2024-09-10T05:56:19.437699+0000","last_clean":"2024-09-10T05:56:19.437699+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:56:19.437699+0000","last_undegraded":"2024-09-10T05:56:19.437699+0000","last_fullsized":"2024-09-10T05:56:19.437699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151721+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:56:14.151721+0000","last_peered":"2024-09-10T05:56:14.151721+0000","last_clean":"2024-09-10T05:56:14.151721+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:56:14.151721+0000","last_undegraded":"2024-09-10T05:56:14.151721+0000","last_fullsized":"2024-09-10T05:56:14.151721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"36'29","reported_seq":121,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964809+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:56:18.964809+0000","last_peered":"2024-09-10T05:56:18.964809+0000","last_clean":"2024-09-10T05:56:18.964809+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:56:18.964809+0000","last_undegraded":"2024-09-10T05:56:18.964809+0000","last_fullsized":"2024-09-10T05:56:18.964809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865076+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:56:15.865076+0000","last_peered":"2024-09-10T05:56:15.865076+0000","last_clean":"2024-09-10T05:56:15.865076+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:56:15.865076+0000","last_undegraded":"2024-09-10T05:56:15.865076+0000","last_fullsized":"2024-09-10T05:56:15.865076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961173+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:56:18.961173+0000","last_peered":"2024-09-10T05:56:18.961173+0000","last_clean":"2024-09-10T05:56:18.961173+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:56:18.961173+0000","last_undegraded":"2024-09-10T05:56:18.961173+0000","last_fullsized":"2024-09-10T05:56:18.961173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963786+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:56:18.963786+0000","last_peered":"2024-09-10T05:56:18.963786+0000","last_clean":"2024-09-10T05:56:18.963786+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:56:18.963786+0000","last_undegraded":"2024-09-10T05:56:18.963786+0000","last_fullsized":"2024-09-10T05:56:18.963786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431750+0000","last_change":"2024-09-10T05:55:43.773232+0000","last_active":"2024-09-10T05:56:19.431750+0000","last_peered":"2024-09-10T05:56:19.431750+0000","last_clean":"2024-09-10T05:56:19.431750+0000","last_became_active":"2024-09-10T05:55:43.772584+0000","last_became_peered":"2024-09-10T05:55:43.772584+0000","last_unstale":"2024-09-10T05:56:19.431750+0000","last_undegraded":"2024-09-10T05:56:19.431750+0000","last_fullsized":"2024-09-10T05:56:19.431750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:58.886050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961679+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:56:18.961679+0000","last_peered":"2024-09-10T05:56:18.961679+0000","last_clean":"2024-09-10T05:56:18.961679+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:56:18.961679+0000","last_undegraded":"2024-09-10T05:56:18.961679+0000","last_fullsized":"2024-09-10T05:56:18.961679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":63,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434166+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:56:19.434166+0000","last_peered":"2024-09-10T05:56:19.434166+0000","last_clean":"2024-09-10T05:56:19.434166+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:56:19.434166+0000","last_undegraded":"2024-09-10T05:56:19.434166+0000","last_fullsized":"2024-09-10T05:56:19.434166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":81,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865408+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:56:15.865408+0000","last_peered":"2024-09-10T05:56:15.865408+0000","last_clean":"2024-09-10T05:56:15.865408+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:56:15.865408+0000","last_undegraded":"2024-09-10T05:56:15.865408+0000","last_fullsized":"2024-09-10T05:56:15.865408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433617+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:56:19.433617+0000","last_peered":"2024-09-10T05:56:19.433617+0000","last_clean":"2024-09-10T05:56:19.433617+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:56:19.433617+0000","last_undegraded":"2024-09-10T05:56:19.433617+0000","last_fullsized":"2024-09-10T05:56:19.433617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433932+0000","last_change":"2024-09-10T05:55:43.767421+0000","last_active":"2024-09-10T05:56:19.433932+0000","last_peered":"2024-09-10T05:56:19.433932+0000","last_clean":"2024-09-10T05:56:19.433932+0000","last_became_active":"2024-09-10T05:55:43.765601+0000","last_became_peered":"2024-09-10T05:55:43.765601+0000","last_unstale":"2024-09-10T05:56:19.433932+0000","last_undegraded":"2024-09-10T05:56:19.433932+0000","last_fullsized":"2024-09-10T05:56:19.433932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:31.389291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964997+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:56:18.964997+0000","last_peered":"2024-09-10T05:56:18.964997+0000","last_clean":"2024-09-10T05:56:18.964997+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:56:18.964997+0000","last_undegraded":"2024-09-10T05:56:18.964997+0000","last_fullsized":"2024-09-10T05:56:18.964997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149073+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:56:14.149073+0000","last_peered":"2024-09-10T05:56:14.149073+0000","last_clean":"2024-09-10T05:56:14.149073+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:56:14.149073+0000","last_undegraded":"2024-09-10T05:56:14.149073+0000","last_fullsized":"2024-09-10T05:56:14.149073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434063+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:56:19.434063+0000","last_peered":"2024-09-10T05:56:19.434063+0000","last_clean":"2024-09-10T05:56:19.434063+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:56:19.434063+0000","last_undegraded":"2024-09-10T05:56:19.434063+0000","last_fullsized":"2024-09-10T05:56:19.434063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434736+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:56:19.434736+0000","last_peered":"2024-09-10T05:56:19.434736+0000","last_clean":"2024-09-10T05:56:19.434736+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:56:19.434736+0000","last_undegraded":"2024-09-10T05:56:19.434736+0000","last_fullsized":"2024-09-10T05:56:19.434736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":96,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434628+0000","last_change":"2024-09-10T05:55:43.822091+0000","last_active":"2024-09-10T05:56:19.434628+0000","last_peered":"2024-09-10T05:56:19.434628+0000","last_clean":"2024-09-10T05:56:19.434628+0000","last_became_active":"2024-09-10T05:55:43.775690+0000","last_became_peered":"2024-09-10T05:55:43.775690+0000","last_unstale":"2024-09-10T05:56:19.434628+0000","last_undegraded":"2024-09-10T05:56:19.434628+0000","last_fullsized":"2024-09-10T05:56:19.434628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:14.882799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":45,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148453+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:56:14.148453+0000","last_peered":"2024-09-10T05:56:14.148453+0000","last_clean":"2024-09-10T05:56:14.148453+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:56:14.148453+0000","last_undegraded":"2024-09-10T05:56:14.148453+0000","last_fullsized":"2024-09-10T05:56:14.148453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149502+0000","last_change":"2024-09-10T05:55:43.804799+0000","last_active":"2024-09-10T05:56:14.149502+0000","last_peered":"2024-09-10T05:56:14.149502+0000","last_clean":"2024-09-10T05:56:14.149502+0000","last_became_active":"2024-09-10T05:55:43.804353+0000","last_became_peered":"2024-09-10T05:55:43.804353+0000","last_unstale":"2024-09-10T05:56:14.149502+0000","last_undegraded":"2024-09-10T05:56:14.149502+0000","last_fullsized":"2024-09-10T05:56:14.149502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:01.726995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431845+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:56:19.431845+0000","last_peered":"2024-09-10T05:56:19.431845+0000","last_clean":"2024-09-10T05:56:19.431845+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:56:19.431845+0000","last_undegraded":"2024-09-10T05:56:19.431845+0000","last_fullsized":"2024-09-10T05:56:19.431845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147565+0000","last_change":"2024-09-10T05:55:43.764072+0000","last_active":"2024-09-10T05:56:14.147565+0000","last_peered":"2024-09-10T05:56:14.147565+0000","last_clean":"2024-09-10T05:56:14.147565+0000","last_became_active":"2024-09-10T05:55:43.763265+0000","last_became_peered":"2024-09-10T05:55:43.763265+0000","last_unstale":"2024-09-10T05:56:14.147565+0000","last_undegraded":"2024-09-10T05:56:14.147565+0000","last_fullsized":"2024-09-10T05:56:14.147565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:04.381491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965212+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:56:18.965212+0000","last_peered":"2024-09-10T05:56:18.965212+0000","last_clean":"2024-09-10T05:56:18.965212+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:56:18.965212+0000","last_undegraded":"2024-09-10T05:56:18.965212+0000","last_fullsized":"2024-09-10T05:56:18.965212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":64,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435333+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:56:19.435333+0000","last_peered":"2024-09-10T05:56:19.435333+0000","last_clean":"2024-09-10T05:56:19.435333+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:56:19.435333+0000","last_undegraded":"2024-09-10T05:56:19.435333+0000","last_fullsized":"2024-09-10T05:56:19.435333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'30","reported_seq":142,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431150+0000","last_change":"2024-09-10T05:55:43.824206+0000","last_active":"2024-09-10T05:56:19.431150+0000","last_peered":"2024-09-10T05:56:19.431150+0000","last_clean":"2024-09-10T05:56:19.431150+0000","last_became_active":"2024-09-10T05:55:43.777118+0000","last_became_peered":"2024-09-10T05:55:43.777118+0000","last_unstale":"2024-09-10T05:56:19.431150+0000","last_undegraded":"2024-09-10T05:56:19.431150+0000","last_fullsized":"2024-09-10T05:56:19.431150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:46.264806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428351+0000","last_change":"2024-09-10T05:55:43.765816+0000","last_active":"2024-09-10T05:56:19.428351+0000","last_peered":"2024-09-10T05:56:19.428351+0000","last_clean":"2024-09-10T05:56:19.428351+0000","last_became_active":"2024-09-10T05:55:43.761773+0000","last_became_peered":"2024-09-10T05:55:43.761773+0000","last_unstale":"2024-09-10T05:56:19.428351+0000","last_undegraded":"2024-09-10T05:56:19.428351+0000","last_fullsized":"2024-09-10T05:56:19.428351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:13.756785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433864+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:56:19.433864+0000","last_peered":"2024-09-10T05:56:19.433864+0000","last_clean":"2024-09-10T05:56:19.433864+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:56:19.433864+0000","last_undegraded":"2024-09-10T05:56:19.433864+0000","last_fullsized":"2024-09-10T05:56:19.433864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435801+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:56:19.435801+0000","last_peered":"2024-09-10T05:56:19.435801+0000","last_clean":"2024-09-10T05:56:19.435801+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:56:19.435801+0000","last_undegraded":"2024-09-10T05:56:19.435801+0000","last_fullsized":"2024-09-10T05:56:19.435801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965069+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:56:18.965069+0000","last_peered":"2024-09-10T05:56:18.965069+0000","last_clean":"2024-09-10T05:56:18.965069+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:56:18.965069+0000","last_undegraded":"2024-09-10T05:56:18.965069+0000","last_fullsized":"2024-09-10T05:56:18.965069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865986+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:56:15.865986+0000","last_peered":"2024-09-10T05:56:15.865986+0000","last_clean":"2024-09-10T05:56:15.865986+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:56:15.865986+0000","last_undegraded":"2024-09-10T05:56:15.865986+0000","last_fullsized":"2024-09-10T05:56:15.865986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146391+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:56:14.146391+0000","last_peered":"2024-09-10T05:56:14.146391+0000","last_clean":"2024-09-10T05:56:14.146391+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:56:14.146391+0000","last_undegraded":"2024-09-10T05:56:14.146391+0000","last_fullsized":"2024-09-10T05:56:14.146391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":91,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964917+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:56:18.964917+0000","last_peered":"2024-09-10T05:56:18.964917+0000","last_clean":"2024-09-10T05:56:18.964917+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:56:18.964917+0000","last_undegraded":"2024-09-10T05:56:18.964917+0000","last_fullsized":"2024-09-10T05:56:18.964917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149818+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:56:14.149818+0000","last_peered":"2024-09-10T05:56:14.149818+0000","last_clean":"2024-09-10T05:56:14.149818+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:56:14.149818+0000","last_undegraded":"2024-09-10T05:56:14.149818+0000","last_fullsized":"2024-09-10T05:56:14.149818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434727+0000","last_change":"2024-09-10T05:55:43.753889+0000","last_active":"2024-09-10T05:56:19.434727+0000","last_peered":"2024-09-10T05:56:19.434727+0000","last_clean":"2024-09-10T05:56:19.434727+0000","last_became_active":"2024-09-10T05:55:43.753106+0000","last_became_peered":"2024-09-10T05:55:43.753106+0000","last_unstale":"2024-09-10T05:56:19.434727+0000","last_undegraded":"2024-09-10T05:56:19.434727+0000","last_fullsized":"2024-09-10T05:56:19.434727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:07.383551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863784+0000","last_change":"2024-09-10T05:55:43.770735+0000","last_active":"2024-09-10T05:56:15.863784+0000","last_peered":"2024-09-10T05:56:15.863784+0000","last_clean":"2024-09-10T05:56:15.863784+0000","last_became_active":"2024-09-10T05:55:43.768802+0000","last_became_peered":"2024-09-10T05:55:43.768802+0000","last_unstale":"2024-09-10T05:56:15.863784+0000","last_undegraded":"2024-09-10T05:56:15.863784+0000","last_fullsized":"2024-09-10T05:56:15.863784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:21:01.360943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865192+0000","last_change":"2024-09-10T05:55:43.788377+0000","last_active":"2024-09-10T05:56:15.865192+0000","last_peered":"2024-09-10T05:56:15.865192+0000","last_clean":"2024-09-10T05:56:15.865192+0000","last_became_active":"2024-09-10T05:55:43.784426+0000","last_became_peered":"2024-09-10T05:55:43.784426+0000","last_unstale":"2024-09-10T05:56:15.865192+0000","last_undegraded":"2024-09-10T05:56:15.865192+0000","last_fullsized":"2024-09-10T05:56:15.865192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:14.968924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963210+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:56:18.963210+0000","last_peered":"2024-09-10T05:56:18.963210+0000","last_clean":"2024-09-10T05:56:18.963210+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:56:18.963210+0000","last_undegraded":"2024-09-10T05:56:18.963210+0000","last_fullsized":"2024-09-10T05:56:18.963210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":68,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432307+0000","last_change":"2024-09-10T05:55:43.775857+0000","last_active":"2024-09-10T05:56:19.432307+0000","last_peered":"2024-09-10T05:56:19.432307+0000","last_clean":"2024-09-10T05:56:19.432307+0000","last_became_active":"2024-09-10T05:55:43.775153+0000","last_became_peered":"2024-09-10T05:55:43.775153+0000","last_unstale":"2024-09-10T05:56:19.432307+0000","last_undegraded":"2024-09-10T05:56:19.432307+0000","last_fullsized":"2024-09-10T05:56:19.432307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:31:39.307376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":105,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432487+0000","last_change":"2024-09-10T05:55:43.802259+0000","last_active":"2024-09-10T05:56:19.432487+0000","last_peered":"2024-09-10T05:56:19.432487+0000","last_clean":"2024-09-10T05:56:19.432487+0000","last_became_active":"2024-09-10T05:55:43.760217+0000","last_became_peered":"2024-09-10T05:55:43.760217+0000","last_unstale":"2024-09-10T05:56:19.432487+0000","last_undegraded":"2024-09-10T05:56:19.432487+0000","last_fullsized":"2024-09-10T05:56:19.432487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:13.640343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"38'3","reported_seq":67,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432558+0000","last_change":"2024-09-10T05:55:43.794753+0000","last_active":"2024-09-10T05:56:19.432558+0000","last_peered":"2024-09-10T05:56:19.432558+0000","last_clean":"2024-09-10T05:56:19.432558+0000","last_became_active":"2024-09-10T05:55:43.773136+0000","last_became_peered":"2024-09-10T05:55:43.773136+0000","last_unstale":"2024-09-10T05:56:19.432558+0000","last_undegraded":"2024-09-10T05:56:19.432558+0000","last_fullsized":"2024-09-10T05:56:19.432558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:04.463784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433690+0000","last_change":"2024-09-10T05:55:43.774119+0000","last_active":"2024-09-10T05:56:19.433690+0000","last_peered":"2024-09-10T05:56:19.433690+0000","last_clean":"2024-09-10T05:56:19.433690+0000","last_became_active":"2024-09-10T05:55:43.773414+0000","last_became_peered":"2024-09-10T05:55:43.773414+0000","last_unstale":"2024-09-10T05:56:19.433690+0000","last_undegraded":"2024-09-10T05:56:19.433690+0000","last_fullsized":"2024-09-10T05:56:19.433690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:41.853625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432914+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:56:19.432914+0000","last_peered":"2024-09-10T05:56:19.432914+0000","last_clean":"2024-09-10T05:56:19.432914+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:56:19.432914+0000","last_undegraded":"2024-09-10T05:56:19.432914+0000","last_fullsized":"2024-09-10T05:56:19.432914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434575+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:56:19.434575+0000","last_peered":"2024-09-10T05:56:19.434575+0000","last_clean":"2024-09-10T05:56:19.434575+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:56:19.434575+0000","last_undegraded":"2024-09-10T05:56:19.434575+0000","last_fullsized":"2024-09-10T05:56:19.434575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149343+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:56:14.149343+0000","last_peered":"2024-09-10T05:56:14.149343+0000","last_clean":"2024-09-10T05:56:14.149343+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:56:14.149343+0000","last_undegraded":"2024-09-10T05:56:14.149343+0000","last_fullsized":"2024-09-10T05:56:14.149343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961386+0000","last_change":"2024-09-10T05:55:43.781726+0000","last_active":"2024-09-10T05:56:18.961386+0000","last_peered":"2024-09-10T05:56:18.961386+0000","last_clean":"2024-09-10T05:56:18.961386+0000","last_became_active":"2024-09-10T05:55:43.781265+0000","last_became_peered":"2024-09-10T05:55:43.781265+0000","last_unstale":"2024-09-10T05:56:18.961386+0000","last_undegraded":"2024-09-10T05:56:18.961386+0000","last_fullsized":"2024-09-10T05:56:18.961386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:04.442711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"36'26","reported_seq":100,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864239+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:56:15.864239+0000","last_peered":"2024-09-10T05:56:15.864239+0000","last_clean":"2024-09-10T05:56:15.864239+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:56:15.864239+0000","last_undegraded":"2024-09-10T05:56:15.864239+0000","last_fullsized":"2024-09-10T05:56:15.864239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963879+0000","last_change":"2024-09-10T05:55:43.780991+0000","last_active":"2024-09-10T05:56:18.963879+0000","last_peered":"2024-09-10T05:56:18.963879+0000","last_clean":"2024-09-10T05:56:18.963879+0000","last_became_active":"2024-09-10T05:55:43.780336+0000","last_became_peered":"2024-09-10T05:55:43.780336+0000","last_unstale":"2024-09-10T05:56:18.963879+0000","last_undegraded":"2024-09-10T05:56:18.963879+0000","last_fullsized":"2024-09-10T05:56:18.963879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:17.301652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144548+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:56:14.144548+0000","last_peered":"2024-09-10T05:56:14.144548+0000","last_clean":"2024-09-10T05:56:14.144548+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:56:14.144548+0000","last_undegraded":"2024-09-10T05:56:14.144548+0000","last_fullsized":"2024-09-10T05:56:14.144548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433040+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:56:19.433040+0000","last_peered":"2024-09-10T05:56:19.433040+0000","last_clean":"2024-09-10T05:56:19.433040+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:56:19.433040+0000","last_undegraded":"2024-09-10T05:56:19.433040+0000","last_fullsized":"2024-09-10T05:56:19.433040+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433863+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:56:19.433863+0000","last_peered":"2024-09-10T05:56:19.433863+0000","last_clean":"2024-09-10T05:56:19.433863+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:56:19.433863+0000","last_undegraded":"2024-09-10T05:56:19.433863+0000","last_fullsized":"2024-09-10T05:56:19.433863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434011+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:56:19.434011+0000","last_peered":"2024-09-10T05:56:19.434011+0000","last_clean":"2024-09-10T05:56:19.434011+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:56:19.434011+0000","last_undegraded":"2024-09-10T05:56:19.434011+0000","last_fullsized":"2024-09-10T05:56:19.434011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964117+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:56:18.964117+0000","last_peered":"2024-09-10T05:56:18.964117+0000","last_clean":"2024-09-10T05:56:18.964117+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:56:18.964117+0000","last_undegraded":"2024-09-10T05:56:18.964117+0000","last_fullsized":"2024-09-10T05:56:18.964117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'17","reported_seq":109,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437761+0000","last_change":"2024-09-10T05:55:43.854105+0000","last_active":"2024-09-10T05:56:19.437761+0000","last_peered":"2024-09-10T05:56:19.437761+0000","last_clean":"2024-09-10T05:56:19.437761+0000","last_became_active":"2024-09-10T05:55:43.786593+0000","last_became_peered":"2024-09-10T05:55:43.786593+0000","last_unstale":"2024-09-10T05:56:19.437761+0000","last_undegraded":"2024-09-10T05:56:19.437761+0000","last_fullsized":"2024-09-10T05:56:19.437761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:48.284583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430940+0000","last_change":"2024-09-10T05:55:43.759028+0000","last_active":"2024-09-10T05:56:19.430940+0000","last_peered":"2024-09-10T05:56:19.430940+0000","last_clean":"2024-09-10T05:56:19.430940+0000","last_became_active":"2024-09-10T05:55:43.758269+0000","last_became_peered":"2024-09-10T05:55:43.758269+0000","last_unstale":"2024-09-10T05:56:19.430940+0000","last_undegraded":"2024-09-10T05:56:19.430940+0000","last_fullsized":"2024-09-10T05:56:19.430940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:03:02.554061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863154+0000","last_change":"2024-09-10T05:55:43.789530+0000","last_active":"2024-09-10T05:56:15.863154+0000","last_peered":"2024-09-10T05:56:15.863154+0000","last_clean":"2024-09-10T05:56:15.863154+0000","last_became_active":"2024-09-10T05:55:43.788888+0000","last_became_peered":"2024-09-10T05:55:43.788888+0000","last_unstale":"2024-09-10T05:56:15.863154+0000","last_undegraded":"2024-09-10T05:56:15.863154+0000","last_fullsized":"2024-09-10T05:56:15.863154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:01:09.541294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.964046+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:56:18.964046+0000","last_peered":"2024-09-10T05:56:18.964046+0000","last_clean":"2024-09-10T05:56:18.964046+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:56:18.964046+0000","last_undegraded":"2024-09-10T05:56:18.964046+0000","last_fullsized":"2024-09-10T05:56:18.964046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863155+0000","last_change":"2024-09-10T05:55:43.788595+0000","last_active":"2024-09-10T05:56:15.863155+0000","last_peered":"2024-09-10T05:56:15.863155+0000","last_clean":"2024-09-10T05:56:15.863155+0000","last_became_active":"2024-09-10T05:55:43.788184+0000","last_became_peered":"2024-09-10T05:55:43.788184+0000","last_unstale":"2024-09-10T05:56:15.863155+0000","last_undegraded":"2024-09-10T05:56:15.863155+0000","last_fullsized":"2024-09-10T05:56:15.863155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:15.977679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435943+0000","last_change":"2024-09-10T05:55:43.768329+0000","last_active":"2024-09-10T05:56:19.435943+0000","last_peered":"2024-09-10T05:56:19.435943+0000","last_clean":"2024-09-10T05:56:19.435943+0000","last_became_active":"2024-09-10T05:55:43.768047+0000","last_became_peered":"2024-09-10T05:55:43.768047+0000","last_unstale":"2024-09-10T05:56:19.435943+0000","last_undegraded":"2024-09-10T05:56:19.435943+0000","last_fullsized":"2024-09-10T05:56:19.435943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:32.381418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":65,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430977+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:56:19.430977+0000","last_peered":"2024-09-10T05:56:19.430977+0000","last_clean":"2024-09-10T05:56:19.430977+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:56:19.430977+0000","last_undegraded":"2024-09-10T05:56:19.430977+0000","last_fullsized":"2024-09-10T05:56:19.430977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864085+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:56:15.864085+0000","last_peered":"2024-09-10T05:56:15.864085+0000","last_clean":"2024-09-10T05:56:15.864085+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:56:15.864085+0000","last_undegraded":"2024-09-10T05:56:15.864085+0000","last_fullsized":"2024-09-10T05:56:15.864085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434661+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:56:19.434661+0000","last_peered":"2024-09-10T05:56:19.434661+0000","last_clean":"2024-09-10T05:56:19.434661+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:56:19.434661+0000","last_undegraded":"2024-09-10T05:56:19.434661+0000","last_fullsized":"2024-09-10T05:56:19.434661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864009+0000","last_change":"2024-09-10T05:55:43.807390+0000","last_active":"2024-09-10T05:56:15.864009+0000","last_peered":"2024-09-10T05:56:15.864009+0000","last_clean":"2024-09-10T05:56:15.864009+0000","last_became_active":"2024-09-10T05:55:43.806936+0000","last_became_peered":"2024-09-10T05:55:43.806936+0000","last_unstale":"2024-09-10T05:56:15.864009+0000","last_undegraded":"2024-09-10T05:56:15.864009+0000","last_fullsized":"2024-09-10T05:56:15.864009+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:33.727161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151433+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:56:14.151433+0000","last_peered":"2024-09-10T05:56:14.151433+0000","last_clean":"2024-09-10T05:56:14.151433+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:56:14.151433+0000","last_undegraded":"2024-09-10T05:56:14.151433+0000","last_fullsized":"2024-09-10T05:56:14.151433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863611+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:56:15.863611+0000","last_peered":"2024-09-10T05:56:15.863611+0000","last_clean":"2024-09-10T05:56:15.863611+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:56:15.863611+0000","last_undegraded":"2024-09-10T05:56:15.863611+0000","last_fullsized":"2024-09-10T05:56:15.863611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":95,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435720+0000","last_change":"2024-09-10T05:55:43.811328+0000","last_active":"2024-09-10T05:56:19.435720+0000","last_peered":"2024-09-10T05:56:19.435720+0000","last_clean":"2024-09-10T05:56:19.435720+0000","last_became_active":"2024-09-10T05:55:43.779853+0000","last_became_peered":"2024-09-10T05:55:43.779853+0000","last_unstale":"2024-09-10T05:56:19.435720+0000","last_undegraded":"2024-09-10T05:56:19.435720+0000","last_fullsized":"2024-09-10T05:56:19.435720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:47.370502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":45,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146168+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:56:14.146168+0000","last_peered":"2024-09-10T05:56:14.146168+0000","last_clean":"2024-09-10T05:56:14.146168+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:56:14.146168+0000","last_undegraded":"2024-09-10T05:56:14.146168+0000","last_fullsized":"2024-09-10T05:56:14.146168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146616+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:56:14.146616+0000","last_peered":"2024-09-10T05:56:14.146616+0000","last_clean":"2024-09-10T05:56:14.146616+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:56:14.146616+0000","last_undegraded":"2024-09-10T05:56:14.146616+0000","last_fullsized":"2024-09-10T05:56:14.146616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.961526+0000","last_change":"2024-09-10T05:55:43.788719+0000","last_active":"2024-09-10T05:56:18.961526+0000","last_peered":"2024-09-10T05:56:18.961526+0000","last_clean":"2024-09-10T05:56:18.961526+0000","last_became_active":"2024-09-10T05:55:43.788432+0000","last_became_peered":"2024-09-10T05:55:43.788432+0000","last_unstale":"2024-09-10T05:56:18.961526+0000","last_undegraded":"2024-09-10T05:56:18.961526+0000","last_fullsized":"2024-09-10T05:56:18.961526+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:18.891041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433441+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:56:19.433441+0000","last_peered":"2024-09-10T05:56:19.433441+0000","last_clean":"2024-09-10T05:56:19.433441+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:56:19.433441+0000","last_undegraded":"2024-09-10T05:56:19.433441+0000","last_fullsized":"2024-09-10T05:56:19.433441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145931+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:56:14.145931+0000","last_peered":"2024-09-10T05:56:14.145931+0000","last_clean":"2024-09-10T05:56:14.145931+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:56:14.145931+0000","last_undegraded":"2024-09-10T05:56:14.145931+0000","last_fullsized":"2024-09-10T05:56:14.145931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863653+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:56:15.863653+0000","last_peered":"2024-09-10T05:56:15.863653+0000","last_clean":"2024-09-10T05:56:15.863653+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:56:15.863653+0000","last_undegraded":"2024-09-10T05:56:15.863653+0000","last_fullsized":"2024-09-10T05:56:15.863653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435010+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:56:19.435010+0000","last_peered":"2024-09-10T05:56:19.435010+0000","last_clean":"2024-09-10T05:56:19.435010+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:56:19.435010+0000","last_undegraded":"2024-09-10T05:56:19.435010+0000","last_fullsized":"2024-09-10T05:56:19.435010+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.149014+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:56:14.149014+0000","last_peered":"2024-09-10T05:56:14.149014+0000","last_clean":"2024-09-10T05:56:14.149014+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:56:14.149014+0000","last_undegraded":"2024-09-10T05:56:14.149014+0000","last_fullsized":"2024-09-10T05:56:14.149014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431281+0000","last_change":"2024-09-10T05:55:43.769761+0000","last_active":"2024-09-10T05:56:19.431281+0000","last_peered":"2024-09-10T05:56:19.431281+0000","last_clean":"2024-09-10T05:56:19.431281+0000","last_became_active":"2024-09-10T05:55:43.768948+0000","last_became_peered":"2024-09-10T05:55:43.768948+0000","last_unstale":"2024-09-10T05:56:19.431281+0000","last_undegraded":"2024-09-10T05:56:19.431281+0000","last_fullsized":"2024-09-10T05:56:19.431281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:31:35.426596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434208+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:56:19.434208+0000","last_peered":"2024-09-10T05:56:19.434208+0000","last_clean":"2024-09-10T05:56:19.434208+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:56:19.434208+0000","last_undegraded":"2024-09-10T05:56:19.434208+0000","last_fullsized":"2024-09-10T05:56:19.434208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'18","reported_seq":93,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962114+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:56:18.962114+0000","last_peered":"2024-09-10T05:56:18.962114+0000","last_clean":"2024-09-10T05:56:18.962114+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:56:18.962114+0000","last_undegraded":"2024-09-10T05:56:18.962114+0000","last_fullsized":"2024-09-10T05:56:18.962114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147107+0000","last_change":"2024-09-10T05:55:43.782026+0000","last_active":"2024-09-10T05:56:14.147107+0000","last_peered":"2024-09-10T05:56:14.147107+0000","last_clean":"2024-09-10T05:56:14.147107+0000","last_became_active":"2024-09-10T05:55:43.781220+0000","last_became_peered":"2024-09-10T05:55:43.781220+0000","last_unstale":"2024-09-10T05:56:14.147107+0000","last_undegraded":"2024-09-10T05:56:14.147107+0000","last_fullsized":"2024-09-10T05:56:14.147107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:40:16.898159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432685+0000","last_change":"2024-09-10T05:55:43.772257+0000","last_active":"2024-09-10T05:56:19.432685+0000","last_peered":"2024-09-10T05:56:19.432685+0000","last_clean":"2024-09-10T05:56:19.432685+0000","last_became_active":"2024-09-10T05:55:43.761220+0000","last_became_peered":"2024-09-10T05:55:43.761220+0000","last_unstale":"2024-09-10T05:56:19.432685+0000","last_undegraded":"2024-09-10T05:56:19.432685+0000","last_fullsized":"2024-09-10T05:56:19.432685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:25.252163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434320+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:56:19.434320+0000","last_peered":"2024-09-10T05:56:19.434320+0000","last_clean":"2024-09-10T05:56:19.434320+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:56:19.434320+0000","last_undegraded":"2024-09-10T05:56:19.434320+0000","last_fullsized":"2024-09-10T05:56:19.434320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965513+0000","last_change":"2024-09-10T05:55:43.782454+0000","last_active":"2024-09-10T05:56:18.965513+0000","last_peered":"2024-09-10T05:56:18.965513+0000","last_clean":"2024-09-10T05:56:18.965513+0000","last_became_active":"2024-09-10T05:55:43.781992+0000","last_became_peered":"2024-09-10T05:55:43.781992+0000","last_unstale":"2024-09-10T05:56:18.965513+0000","last_undegraded":"2024-09-10T05:56:18.965513+0000","last_fullsized":"2024-09-10T05:56:18.965513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148680+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:56:14.148680+0000","last_peered":"2024-09-10T05:56:14.148680+0000","last_clean":"2024-09-10T05:56:14.148680+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:56:14.148680+0000","last_undegraded":"2024-09-10T05:56:14.148680+0000","last_fullsized":"2024-09-10T05:56:14.148680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864659+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:56:15.864659+0000","last_peered":"2024-09-10T05:56:15.864659+0000","last_clean":"2024-09-10T05:56:15.864659+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:56:15.864659+0000","last_undegraded":"2024-09-10T05:56:15.864659+0000","last_fullsized":"2024-09-10T05:56:15.864659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962285+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:56:18.962285+0000","last_peered":"2024-09-10T05:56:18.962285+0000","last_clean":"2024-09-10T05:56:18.962285+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:56:18.962285+0000","last_undegraded":"2024-09-10T05:56:18.962285+0000","last_fullsized":"2024-09-10T05:56:18.962285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.143084+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:56:14.143084+0000","last_peered":"2024-09-10T05:56:14.143084+0000","last_clean":"2024-09-10T05:56:14.143084+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:56:14.143084+0000","last_undegraded":"2024-09-10T05:56:14.143084+0000","last_fullsized":"2024-09-10T05:56:14.143084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962614+0000","last_change":"2024-09-10T05:55:43.786564+0000","last_active":"2024-09-10T05:56:18.962614+0000","last_peered":"2024-09-10T05:56:18.962614+0000","last_clean":"2024-09-10T05:56:18.962614+0000","last_became_active":"2024-09-10T05:55:43.782508+0000","last_became_peered":"2024-09-10T05:55:43.782508+0000","last_unstale":"2024-09-10T05:56:18.962614+0000","last_undegraded":"2024-09-10T05:56:18.962614+0000","last_fullsized":"2024-09-10T05:56:18.962614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:39.385386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432683+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:56:19.432683+0000","last_peered":"2024-09-10T05:56:19.432683+0000","last_clean":"2024-09-10T05:56:19.432683+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:56:19.432683+0000","last_undegraded":"2024-09-10T05:56:19.432683+0000","last_fullsized":"2024-09-10T05:56:19.432683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":74,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.436541+0000","last_change":"2024-09-10T05:55:43.824309+0000","last_active":"2024-09-10T05:56:19.436541+0000","last_peered":"2024-09-10T05:56:19.436541+0000","last_clean":"2024-09-10T05:56:19.436541+0000","last_became_active":"2024-09-10T05:55:43.775292+0000","last_became_peered":"2024-09-10T05:55:43.775292+0000","last_unstale":"2024-09-10T05:56:19.436541+0000","last_undegraded":"2024-09-10T05:56:19.436541+0000","last_fullsized":"2024-09-10T05:56:19.436541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:50.195249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"36'17","reported_seq":100,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147668+0000","last_change":"2024-09-10T05:55:43.835023+0000","last_active":"2024-09-10T05:56:14.147668+0000","last_peered":"2024-09-10T05:56:14.147668+0000","last_clean":"2024-09-10T05:56:14.147668+0000","last_became_active":"2024-09-10T05:55:43.796829+0000","last_became_peered":"2024-09-10T05:55:43.796829+0000","last_unstale":"2024-09-10T05:56:14.147668+0000","last_undegraded":"2024-09-10T05:56:14.147668+0000","last_fullsized":"2024-09-10T05:56:14.147668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:03.508040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962775+0000","last_change":"2024-09-10T05:55:43.793413+0000","last_active":"2024-09-10T05:56:18.962775+0000","last_peered":"2024-09-10T05:56:18.962775+0000","last_clean":"2024-09-10T05:56:18.962775+0000","last_became_active":"2024-09-10T05:55:43.792912+0000","last_became_peered":"2024-09-10T05:55:43.792912+0000","last_unstale":"2024-09-10T05:56:18.962775+0000","last_undegraded":"2024-09-10T05:56:18.962775+0000","last_fullsized":"2024-09-10T05:56:18.962775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:49.940275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":41,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145386+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:56:14.145386+0000","last_peered":"2024-09-10T05:56:14.145386+0000","last_clean":"2024-09-10T05:56:14.145386+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:56:14.145386+0000","last_undegraded":"2024-09-10T05:56:14.145386+0000","last_fullsized":"2024-09-10T05:56:14.145386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433343+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:56:19.433343+0000","last_peered":"2024-09-10T05:56:19.433343+0000","last_clean":"2024-09-10T05:56:19.433343+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:56:19.433343+0000","last_undegraded":"2024-09-10T05:56:19.433343+0000","last_fullsized":"2024-09-10T05:56:19.433343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435099+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:56:19.435099+0000","last_peered":"2024-09-10T05:56:19.435099+0000","last_clean":"2024-09-10T05:56:19.435099+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:56:19.435099+0000","last_undegraded":"2024-09-10T05:56:19.435099+0000","last_fullsized":"2024-09-10T05:56:19.435099+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962448+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:56:18.962448+0000","last_peered":"2024-09-10T05:56:18.962448+0000","last_clean":"2024-09-10T05:56:18.962448+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:56:18.962448+0000","last_undegraded":"2024-09-10T05:56:18.962448+0000","last_fullsized":"2024-09-10T05:56:18.962448+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":85,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434378+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:56:19.434378+0000","last_peered":"2024-09-10T05:56:19.434378+0000","last_clean":"2024-09-10T05:56:19.434378+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:56:19.434378+0000","last_undegraded":"2024-09-10T05:56:19.434378+0000","last_fullsized":"2024-09-10T05:56:19.434378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147398+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:56:14.147398+0000","last_peered":"2024-09-10T05:56:14.147398+0000","last_clean":"2024-09-10T05:56:14.147398+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:56:14.147398+0000","last_undegraded":"2024-09-10T05:56:14.147398+0000","last_fullsized":"2024-09-10T05:56:14.147398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863540+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:56:15.863540+0000","last_peered":"2024-09-10T05:56:15.863540+0000","last_clean":"2024-09-10T05:56:15.863540+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:56:15.863540+0000","last_undegraded":"2024-09-10T05:56:15.863540+0000","last_fullsized":"2024-09-10T05:56:15.863540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433714+0000","last_change":"2024-09-10T05:55:43.766589+0000","last_active":"2024-09-10T05:56:19.433714+0000","last_peered":"2024-09-10T05:56:19.433714+0000","last_clean":"2024-09-10T05:56:19.433714+0000","last_became_active":"2024-09-10T05:55:43.763644+0000","last_became_peered":"2024-09-10T05:55:43.763644+0000","last_unstale":"2024-09-10T05:56:19.433714+0000","last_undegraded":"2024-09-10T05:56:19.433714+0000","last_fullsized":"2024-09-10T05:56:19.433714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:52.163141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147747+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:56:14.147747+0000","last_peered":"2024-09-10T05:56:14.147747+0000","last_clean":"2024-09-10T05:56:14.147747+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:56:14.147747+0000","last_undegraded":"2024-09-10T05:56:14.147747+0000","last_fullsized":"2024-09-10T05:56:14.147747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":55,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863784+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:56:15.863784+0000","last_peered":"2024-09-10T05:56:15.863784+0000","last_clean":"2024-09-10T05:56:15.863784+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:56:15.863784+0000","last_undegraded":"2024-09-10T05:56:15.863784+0000","last_fullsized":"2024-09-10T05:56:15.863784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"36'39","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145655+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:56:14.145655+0000","last_peered":"2024-09-10T05:56:14.145655+0000","last_clean":"2024-09-10T05:56:14.145655+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:56:14.145655+0000","last_undegraded":"2024-09-10T05:56:14.145655+0000","last_fullsized":"2024-09-10T05:56:14.145655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430666+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:56:19.430666+0000","last_peered":"2024-09-10T05:56:19.430666+0000","last_clean":"2024-09-10T05:56:19.430666+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:56:19.430666+0000","last_undegraded":"2024-09-10T05:56:19.430666+0000","last_fullsized":"2024-09-10T05:56:19.430666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865543+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:56:15.865543+0000","last_peered":"2024-09-10T05:56:15.865543+0000","last_clean":"2024-09-10T05:56:15.865543+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:56:15.865543+0000","last_undegraded":"2024-09-10T05:56:15.865543+0000","last_fullsized":"2024-09-10T05:56:15.865543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432511+0000","last_change":"2024-09-10T05:55:43.777913+0000","last_active":"2024-09-10T05:56:19.432511+0000","last_peered":"2024-09-10T05:56:19.432511+0000","last_clean":"2024-09-10T05:56:19.432511+0000","last_became_active":"2024-09-10T05:55:43.775856+0000","last_became_peered":"2024-09-10T05:55:43.775856+0000","last_unstale":"2024-09-10T05:56:19.432511+0000","last_undegraded":"2024-09-10T05:56:19.432511+0000","last_fullsized":"2024-09-10T05:56:19.432511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:33.793026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147334+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:56:14.147334+0000","last_peered":"2024-09-10T05:56:14.147334+0000","last_clean":"2024-09-10T05:56:14.147334+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:56:14.147334+0000","last_undegraded":"2024-09-10T05:56:14.147334+0000","last_fullsized":"2024-09-10T05:56:14.147334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":53,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145445+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:56:14.145445+0000","last_peered":"2024-09-10T05:56:14.145445+0000","last_clean":"2024-09-10T05:56:14.145445+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:56:14.145445+0000","last_undegraded":"2024-09-10T05:56:14.145445+0000","last_fullsized":"2024-09-10T05:56:14.145445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"36'15","reported_seq":86,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.430798+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:56:19.430798+0000","last_peered":"2024-09-10T05:56:19.430798+0000","last_clean":"2024-09-10T05:56:19.430798+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:56:19.430798+0000","last_undegraded":"2024-09-10T05:56:19.430798+0000","last_fullsized":"2024-09-10T05:56:19.430798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":45,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.145420+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:56:14.145420+0000","last_peered":"2024-09-10T05:56:14.145420+0000","last_clean":"2024-09-10T05:56:14.145420+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:56:14.145420+0000","last_undegraded":"2024-09-10T05:56:14.145420+0000","last_fullsized":"2024-09-10T05:56:14.145420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433909+0000","last_change":"2024-09-10T05:55:43.775586+0000","last_active":"2024-09-10T05:56:19.433909+0000","last_peered":"2024-09-10T05:56:19.433909+0000","last_clean":"2024-09-10T05:56:19.433909+0000","last_became_active":"2024-09-10T05:55:43.775314+0000","last_became_peered":"2024-09-10T05:55:43.775314+0000","last_unstale":"2024-09-10T05:56:19.433909+0000","last_undegraded":"2024-09-10T05:56:19.433909+0000","last_fullsized":"2024-09-10T05:56:19.433909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:59.576863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431674+0000","last_change":"2024-09-10T05:55:43.774119+0000","last_active":"2024-09-10T05:56:19.431674+0000","last_peered":"2024-09-10T05:56:19.431674+0000","last_clean":"2024-09-10T05:56:19.431674+0000","last_became_active":"2024-09-10T05:55:43.773700+0000","last_became_peered":"2024-09-10T05:55:43.773700+0000","last_unstale":"2024-09-10T05:56:19.431674+0000","last_undegraded":"2024-09-10T05:56:19.431674+0000","last_fullsized":"2024-09-10T05:56:19.431674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:32.874692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.147562+0000","last_change":"2024-09-10T05:55:43.782020+0000","last_active":"2024-09-10T05:56:14.147562+0000","last_peered":"2024-09-10T05:56:14.147562+0000","last_clean":"2024-09-10T05:56:14.147562+0000","last_became_active":"2024-09-10T05:55:43.777139+0000","last_became_peered":"2024-09-10T05:55:43.777139+0000","last_unstale":"2024-09-10T05:56:14.147562+0000","last_undegraded":"2024-09-10T05:56:14.147562+0000","last_fullsized":"2024-09-10T05:56:14.147562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:40.913796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":62,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428288+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:56:19.428288+0000","last_peered":"2024-09-10T05:56:19.428288+0000","last_clean":"2024-09-10T05:56:19.428288+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:56:19.428288+0000","last_undegraded":"2024-09-10T05:56:19.428288+0000","last_fullsized":"2024-09-10T05:56:19.428288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"36'11","reported_seq":87,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864462+0000","last_change":"2024-09-10T05:55:43.817545+0000","last_active":"2024-09-10T05:56:15.864462+0000","last_peered":"2024-09-10T05:56:15.864462+0000","last_clean":"2024-09-10T05:56:15.864462+0000","last_became_active":"2024-09-10T05:55:43.805908+0000","last_became_peered":"2024-09-10T05:55:43.805908+0000","last_unstale":"2024-09-10T05:56:15.864462+0000","last_undegraded":"2024-09-10T05:56:15.864462+0000","last_fullsized":"2024-09-10T05:56:15.864462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:36:46.863921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432081+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:56:19.432081+0000","last_peered":"2024-09-10T05:56:19.432081+0000","last_clean":"2024-09-10T05:56:19.432081+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:56:19.432081+0000","last_undegraded":"2024-09-10T05:56:19.432081+0000","last_fullsized":"2024-09-10T05:56:19.432081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":43,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865364+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:56:15.865364+0000","last_peered":"2024-09-10T05:56:15.865364+0000","last_clean":"2024-09-10T05:56:15.865364+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:56:15.865364+0000","last_undegraded":"2024-09-10T05:56:15.865364+0000","last_fullsized":"2024-09-10T05:56:15.865364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.428577+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:56:19.428577+0000","last_peered":"2024-09-10T05:56:19.428577+0000","last_clean":"2024-09-10T05:56:19.428577+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:56:19.428577+0000","last_undegraded":"2024-09-10T05:56:19.428577+0000","last_fullsized":"2024-09-10T05:56:19.428577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434429+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:56:19.434429+0000","last_peered":"2024-09-10T05:56:19.434429+0000","last_clean":"2024-09-10T05:56:19.434429+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:56:19.434429+0000","last_undegraded":"2024-09-10T05:56:19.434429+0000","last_fullsized":"2024-09-10T05:56:19.434429+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":63,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965004+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:56:18.965004+0000","last_peered":"2024-09-10T05:56:18.965004+0000","last_clean":"2024-09-10T05:56:18.965004+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:56:18.965004+0000","last_undegraded":"2024-09-10T05:56:18.965004+0000","last_fullsized":"2024-09-10T05:56:18.965004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'21","reported_seq":98,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432225+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:56:19.432225+0000","last_peered":"2024-09-10T05:56:19.432225+0000","last_clean":"2024-09-10T05:56:19.432225+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:56:19.432225+0000","last_undegraded":"2024-09-10T05:56:19.432225+0000","last_fullsized":"2024-09-10T05:56:19.432225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":54,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435566+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:56:19.435566+0000","last_peered":"2024-09-10T05:56:19.435566+0000","last_clean":"2024-09-10T05:56:19.435566+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:56:19.435566+0000","last_undegraded":"2024-09-10T05:56:19.435566+0000","last_fullsized":"2024-09-10T05:56:19.435566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":50,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.436508+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:56:19.436508+0000","last_peered":"2024-09-10T05:56:19.436508+0000","last_clean":"2024-09-10T05:56:19.436508+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:56:19.436508+0000","last_undegraded":"2024-09-10T05:56:19.436508+0000","last_fullsized":"2024-09-10T05:56:19.436508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963648+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:56:18.963648+0000","last_peered":"2024-09-10T05:56:18.963648+0000","last_clean":"2024-09-10T05:56:18.963648+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:56:18.963648+0000","last_undegraded":"2024-09-10T05:56:18.963648+0000","last_fullsized":"2024-09-10T05:56:18.963648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144612+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:56:14.144612+0000","last_peered":"2024-09-10T05:56:14.144612+0000","last_clean":"2024-09-10T05:56:14.144612+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:56:14.144612+0000","last_undegraded":"2024-09-10T05:56:14.144612+0000","last_fullsized":"2024-09-10T05:56:14.144612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963023+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:56:18.963023+0000","last_peered":"2024-09-10T05:56:18.963023+0000","last_clean":"2024-09-10T05:56:18.963023+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:56:18.963023+0000","last_undegraded":"2024-09-10T05:56:18.963023+0000","last_fullsized":"2024-09-10T05:56:18.963023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431592+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:56:19.431592+0000","last_peered":"2024-09-10T05:56:19.431592+0000","last_clean":"2024-09-10T05:56:19.431592+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:56:19.431592+0000","last_undegraded":"2024-09-10T05:56:19.431592+0000","last_fullsized":"2024-09-10T05:56:19.431592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.146405+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:56:14.146405+0000","last_peered":"2024-09-10T05:56:14.146405+0000","last_clean":"2024-09-10T05:56:14.146405+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:56:14.146405+0000","last_undegraded":"2024-09-10T05:56:14.146405+0000","last_fullsized":"2024-09-10T05:56:14.146405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148719+0000","last_change":"2024-09-10T05:55:43.781632+0000","last_active":"2024-09-10T05:56:14.148719+0000","last_peered":"2024-09-10T05:56:14.148719+0000","last_clean":"2024-09-10T05:56:14.148719+0000","last_became_active":"2024-09-10T05:55:43.772006+0000","last_became_peered":"2024-09-10T05:55:43.772006+0000","last_unstale":"2024-09-10T05:56:14.148719+0000","last_undegraded":"2024-09-10T05:56:14.148719+0000","last_fullsized":"2024-09-10T05:56:14.148719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:33.947948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965140+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:56:18.965140+0000","last_peered":"2024-09-10T05:56:18.965140+0000","last_clean":"2024-09-10T05:56:18.965140+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:56:18.965140+0000","last_undegraded":"2024-09-10T05:56:18.965140+0000","last_fullsized":"2024-09-10T05:56:18.965140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435253+0000","last_change":"2024-09-10T05:55:43.794639+0000","last_active":"2024-09-10T05:56:19.435253+0000","last_peered":"2024-09-10T05:56:19.435253+0000","last_clean":"2024-09-10T05:56:19.435253+0000","last_became_active":"2024-09-10T05:55:43.794237+0000","last_became_peered":"2024-09-10T05:55:43.794237+0000","last_unstale":"2024-09-10T05:56:19.435253+0000","last_undegraded":"2024-09-10T05:56:19.435253+0000","last_fullsized":"2024-09-10T05:56:19.435253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:35:21.108256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863122+0000","last_change":"2024-09-10T05:55:43.782105+0000","last_active":"2024-09-10T05:56:15.863122+0000","last_peered":"2024-09-10T05:56:15.863122+0000","last_clean":"2024-09-10T05:56:15.863122+0000","last_became_active":"2024-09-10T05:55:43.781127+0000","last_became_peered":"2024-09-10T05:55:43.781127+0000","last_unstale":"2024-09-10T05:56:15.863122+0000","last_undegraded":"2024-09-10T05:56:15.863122+0000","last_fullsized":"2024-09-10T05:56:15.863122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:43.066619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434338+0000","last_change":"2024-09-10T05:55:43.766695+0000","last_active":"2024-09-10T05:56:19.434338+0000","last_peered":"2024-09-10T05:56:19.434338+0000","last_clean":"2024-09-10T05:56:19.434338+0000","last_became_active":"2024-09-10T05:55:43.763989+0000","last_became_peered":"2024-09-10T05:55:43.763989+0000","last_unstale":"2024-09-10T05:56:19.434338+0000","last_undegraded":"2024-09-10T05:56:19.434338+0000","last_fullsized":"2024-09-10T05:56:19.434338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.827034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.432626+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:56:19.432626+0000","last_peered":"2024-09-10T05:56:19.432626+0000","last_clean":"2024-09-10T05:56:19.432626+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:56:19.432626+0000","last_undegraded":"2024-09-10T05:56:19.432626+0000","last_fullsized":"2024-09-10T05:56:19.432626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.962687+0000","last_change":"2024-09-10T05:55:43.776313+0000","last_active":"2024-09-10T05:56:18.962687+0000","last_peered":"2024-09-10T05:56:18.962687+0000","last_clean":"2024-09-10T05:56:18.962687+0000","last_became_active":"2024-09-10T05:55:43.776035+0000","last_became_peered":"2024-09-10T05:55:43.776035+0000","last_unstale":"2024-09-10T05:56:18.962687+0000","last_undegraded":"2024-09-10T05:56:18.962687+0000","last_fullsized":"2024-09-10T05:56:18.962687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:41.285992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965313+0000","last_change":"2024-09-10T05:55:43.765257+0000","last_active":"2024-09-10T05:56:18.965313+0000","last_peered":"2024-09-10T05:56:18.965313+0000","last_clean":"2024-09-10T05:56:18.965313+0000","last_became_active":"2024-09-10T05:55:43.764783+0000","last_became_peered":"2024-09-10T05:55:43.764783+0000","last_unstale":"2024-09-10T05:56:18.965313+0000","last_undegraded":"2024-09-10T05:56:18.965313+0000","last_fullsized":"2024-09-10T05:56:18.965313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:49.908421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148336+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:56:14.148336+0000","last_peered":"2024-09-10T05:56:14.148336+0000","last_clean":"2024-09-10T05:56:14.148336+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:56:14.148336+0000","last_undegraded":"2024-09-10T05:56:14.148336+0000","last_fullsized":"2024-09-10T05:56:14.148336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.144366+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:56:14.144366+0000","last_peered":"2024-09-10T05:56:14.144366+0000","last_clean":"2024-09-10T05:56:14.144366+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:56:14.144366+0000","last_undegraded":"2024-09-10T05:56:14.144366+0000","last_fullsized":"2024-09-10T05:56:14.144366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.963299+0000","last_change":"2024-09-10T05:55:58.838079+0000","last_active":"2024-09-10T05:56:18.963299+0000","last_peered":"2024-09-10T05:56:18.963299+0000","last_clean":"2024-09-10T05:56:18.963299+0000","last_became_active":"2024-09-10T05:55:58.837309+0000","last_became_peered":"2024-09-10T05:55:58.837309+0000","last_unstale":"2024-09-10T05:56:18.963299+0000","last_undegraded":"2024-09-10T05:56:18.963299+0000","last_fullsized":"2024-09-10T05:56:18.963299+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.683071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433370+0000","last_change":"2024-09-10T05:55:43.781858+0000","last_active":"2024-09-10T05:56:19.433370+0000","last_peered":"2024-09-10T05:56:19.433370+0000","last_clean":"2024-09-10T05:56:19.433370+0000","last_became_active":"2024-09-10T05:55:43.780794+0000","last_became_peered":"2024-09-10T05:55:43.780794+0000","last_unstale":"2024-09-10T05:56:19.433370+0000","last_undegraded":"2024-09-10T05:56:19.433370+0000","last_fullsized":"2024-09-10T05:56:19.433370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:10.858206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150195+0000","last_change":"2024-09-10T05:55:43.797162+0000","last_active":"2024-09-10T05:56:14.150195+0000","last_peered":"2024-09-10T05:56:14.150195+0000","last_clean":"2024-09-10T05:56:14.150195+0000","last_became_active":"2024-09-10T05:55:43.796633+0000","last_became_peered":"2024-09-10T05:55:43.796633+0000","last_unstale":"2024-09-10T05:56:14.150195+0000","last_undegraded":"2024-09-10T05:56:14.150195+0000","last_fullsized":"2024-09-10T05:56:14.150195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:30.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434502+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:56:19.434502+0000","last_peered":"2024-09-10T05:56:19.434502+0000","last_clean":"2024-09-10T05:56:19.434502+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:56:19.434502+0000","last_undegraded":"2024-09-10T05:56:19.434502+0000","last_fullsized":"2024-09-10T05:56:19.434502+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433250+0000","last_change":"2024-09-10T05:55:43.766914+0000","last_active":"2024-09-10T05:56:19.433250+0000","last_peered":"2024-09-10T05:56:19.433250+0000","last_clean":"2024-09-10T05:56:19.433250+0000","last_became_active":"2024-09-10T05:55:43.766080+0000","last_became_peered":"2024-09-10T05:55:43.766080+0000","last_unstale":"2024-09-10T05:56:19.433250+0000","last_undegraded":"2024-09-10T05:56:19.433250+0000","last_fullsized":"2024-09-10T05:56:19.433250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:45.995974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433730+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:56:19.433730+0000","last_peered":"2024-09-10T05:56:19.433730+0000","last_clean":"2024-09-10T05:56:19.433730+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:56:19.433730+0000","last_undegraded":"2024-09-10T05:56:19.433730+0000","last_fullsized":"2024-09-10T05:56:19.433730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148500+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:56:14.148500+0000","last_peered":"2024-09-10T05:56:14.148500+0000","last_clean":"2024-09-10T05:56:14.148500+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:56:14.148500+0000","last_undegraded":"2024-09-10T05:56:14.148500+0000","last_fullsized":"2024-09-10T05:56:14.148500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434482+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:56:19.434482+0000","last_peered":"2024-09-10T05:56:19.434482+0000","last_clean":"2024-09-10T05:56:19.434482+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:56:19.434482+0000","last_undegraded":"2024-09-10T05:56:19.434482+0000","last_fullsized":"2024-09-10T05:56:19.434482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.435418+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:56:19.435418+0000","last_peered":"2024-09-10T05:56:19.435418+0000","last_clean":"2024-09-10T05:56:19.435418+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:56:19.435418+0000","last_undegraded":"2024-09-10T05:56:19.435418+0000","last_fullsized":"2024-09-10T05:56:19.435418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.864255+0000","last_change":"2024-09-10T05:55:43.801339+0000","last_active":"2024-09-10T05:56:15.864255+0000","last_peered":"2024-09-10T05:56:15.864255+0000","last_clean":"2024-09-10T05:56:15.864255+0000","last_became_active":"2024-09-10T05:55:43.801032+0000","last_became_peered":"2024-09-10T05:55:43.801032+0000","last_unstale":"2024-09-10T05:56:15.864255+0000","last_undegraded":"2024-09-10T05:56:15.864255+0000","last_fullsized":"2024-09-10T05:56:15.864255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:02.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.148021+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:56:14.148021+0000","last_peered":"2024-09-10T05:56:14.148021+0000","last_clean":"2024-09-10T05:56:14.148021+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:56:14.148021+0000","last_undegraded":"2024-09-10T05:56:14.148021+0000","last_fullsized":"2024-09-10T05:56:14.148021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":66,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.431293+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:56:19.431293+0000","last_peered":"2024-09-10T05:56:19.431293+0000","last_clean":"2024-09-10T05:56:19.431293+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:56:19.431293+0000","last_undegraded":"2024-09-10T05:56:19.431293+0000","last_fullsized":"2024-09-10T05:56:19.431293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.865901+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:56:15.865901+0000","last_peered":"2024-09-10T05:56:15.865901+0000","last_clean":"2024-09-10T05:56:15.865901+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:56:15.865901+0000","last_undegraded":"2024-09-10T05:56:15.865901+0000","last_fullsized":"2024-09-10T05:56:15.865901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":45,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.437485+0000","last_change":"2024-09-10T05:55:43.766044+0000","last_active":"2024-09-10T05:56:19.437485+0000","last_peered":"2024-09-10T05:56:19.437485+0000","last_clean":"2024-09-10T05:56:19.437485+0000","last_became_active":"2024-09-10T05:55:43.762145+0000","last_became_peered":"2024-09-10T05:55:43.762145+0000","last_unstale":"2024-09-10T05:56:19.437485+0000","last_undegraded":"2024-09-10T05:56:19.437485+0000","last_fullsized":"2024-09-10T05:56:19.437485+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:47.864026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.434336+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:56:19.434336+0000","last_peered":"2024-09-10T05:56:19.434336+0000","last_clean":"2024-09-10T05:56:19.434336+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:56:19.434336+0000","last_undegraded":"2024-09-10T05:56:19.434336+0000","last_fullsized":"2024-09-10T05:56:19.434336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T05:56:15.863891+0000","last_change":"2024-09-10T05:55:43.774256+0000","last_active":"2024-09-10T05:56:15.863891+0000","last_peered":"2024-09-10T05:56:15.863891+0000","last_clean":"2024-09-10T05:56:15.863891+0000","last_became_active":"2024-09-10T05:55:43.772225+0000","last_became_peered":"2024-09-10T05:55:43.772225+0000","last_unstale":"2024-09-10T05:56:15.863891+0000","last_undegraded":"2024-09-10T05:56:15.863891+0000","last_fullsized":"2024-09-10T05:56:15.863891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:38.745146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151924+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:56:14.151924+0000","last_peered":"2024-09-10T05:56:14.151924+0000","last_clean":"2024-09-10T05:56:14.151924+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:56:14.151924+0000","last_undegraded":"2024-09-10T05:56:14.151924+0000","last_fullsized":"2024-09-10T05:56:14.151924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.150098+0000","last_change":"2024-09-10T05:55:22.567056+0000","last_active":"2024-09-10T05:56:14.150098+0000","last_peered":"2024-09-10T05:56:14.150098+0000","last_clean":"2024-09-10T05:56:14.150098+0000","last_became_active":"2024-09-10T05:55:22.563015+0000","last_became_peered":"2024-09-10T05:55:22.563015+0000","last_unstale":"2024-09-10T05:56:14.150098+0000","last_undegraded":"2024-09-10T05:56:14.150098+0000","last_fullsized":"2024-09-10T05:56:14.150098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:09.009494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:19.433250+0000","last_change":"2024-09-10T05:55:59.086336+0000","last_active":"2024-09-10T05:56:19.433250+0000","last_peered":"2024-09-10T05:56:19.433250+0000","last_clean":"2024-09-10T05:56:19.433250+0000","last_became_active":"2024-09-10T05:55:59.085881+0000","last_became_peered":"2024-09-10T05:55:59.085881+0000","last_unstale":"2024-09-10T05:56:19.433250+0000","last_undegraded":"2024-09-10T05:56:19.433250+0000","last_fullsized":"2024-09-10T05:56:19.433250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:12.761810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T05:56:18.965390+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:56:18.965390+0000","last_peered":"2024-09-10T05:56:18.965390+0000","last_clean":"2024-09-10T05:56:18.965390+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:56:18.965390+0000","last_undegraded":"2024-09-10T05:56:18.965390+0000","last_fullsized":"2024-09-10T05:56:18.965390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T05:56:14.151270+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:56:14.151270+0000","last_peered":"2024-09-10T05:56:14.151270+0000","last_clean":"2024-09-10T05:56:14.151270+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:56:14.151270+0000","last_undegraded":"2024-09-10T05:56:14.151270+0000","last_fullsized":"2024-09-10T05:56:14.151270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":970,"num_read_kb":697,"num_write":611,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":1210,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":8614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":583,"ondisk_log_size":583,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":877525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":287153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":651264,"data_stored":287564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":651264,"data_stored":318576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":60129542162,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":62,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":655360,"data_stored":326207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":325811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36572,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335268,"statfs":{"total":96636764160,"available":96599314432,"internally_reserved":0,"allocated":1245184,"data_stored":908515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:56:21.136 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-10T05:56:21.136 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T05:56:21.136 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-10T05:56:21.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-10T05:56:21.166 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:21.166+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:21.242 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:21.237+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:21.260 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:21.261 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:21.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:21.343 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:21.341+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:21.444 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:21.441+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:21.448 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:21.448 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:21.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:21.545 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:21.541+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:21.637 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:21.637 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:21.646 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:21.641+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:21.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:21.697 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-10T05:56:21.694+0000 7fa00a078640 -1 mon.a@0(leader).osd e56 definitely_dead 0 2024-09-10T05:56:21.747 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:21.746+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:21.822 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:21.823 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:21.840 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:21.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:21.887 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:21.886+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:21.948 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:21.946+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:21.971 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:56:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.3. 2024-09-10T05:56:22.047 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-10T05:56:22.049 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:22.045+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:22.096 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:22.096 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:22.110 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:22.110 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:22.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:22.141 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:22.141 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:22.150 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:22.145+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:22.171 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:22.202 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:22.202 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:22.235 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:22.235 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:22.250 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:22.250+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:22.268 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:22.268 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:22.286 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:22.286 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:22.301 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:22.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:22.334 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:22.358 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:22.354+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:22.452 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:22.450+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.948625976000002, 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.866880311999999, 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.816990533000002, 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.798683664999999, 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.735960943999999, 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.730835296999999, 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.72567282, 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.725387654999999, 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.719735608999997, 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.717412205000002, 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.711313785999998, 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.71019982, 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.675011533999999, 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.668768088, 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.664496018000001, 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.657577222999997, 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.653452786999999, 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.592092903999998, 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.585654835, 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.578384124999999, 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:22.632 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:22.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:22.634 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:22.630+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:22.733 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:22.730+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:22.835 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:22.833+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:22.842 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:22.842 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:22.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:22.950 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:22.950+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:23.037 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:23.033+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:23.094 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:23.095 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:23.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:23.138 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:23.133+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:23.238 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:23.238+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:23.331 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.699439534, 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.694527966999999, 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.582034911999997, 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.577187623999997, 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.572670283999997, 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.564458963, 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.530075142999998, 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.524307143000001, 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.523715168000003, 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.520282672999997, 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.517346731000004, 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.366202997000002, 2024-09-10T05:56:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.105832143999997, 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.101811523999999, 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.092367256999999, 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.088446128000001, 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.047453384000001, 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.966564837999996, 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.876923996999999, 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.865457972000002, 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:23.457 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:23.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:23.459 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:23.458+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:23.560 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:23.557+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:23.661 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:23.658+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:23.671 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:23.671 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:23.671 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:23.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:23.762 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:23.757+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:23.863 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:23.861+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:23.901 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:23.901 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:23.901 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:23.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:23.964 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:23.962+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:24.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:56:24.065 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:24.061+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:24.091 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:24.091 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.462216578000003, 2024-09-10T05:56:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:24.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:24.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:24.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:24.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.105 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.413013769999999, 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:24.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:24.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.371955901, 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:24.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.358540359999999, 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:24.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:24.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.124 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.292951107999997, 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:24.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:24.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.288927248999997, 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:24.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.288359681999999, 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:24.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:24.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:24.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.271067096000003, 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:24.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:24.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.254741246999998, 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:24.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.155 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.177606535000002, 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.156 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:24.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:24.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.171605143000001, 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:24.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:24.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.142957918999997, 2024-09-10T05:56:24.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:24.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:24.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:24.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.134767699000001, 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:24.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:24.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.181 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.069130211000001, 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:24.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.062370397000002, 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:24.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:24.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.058541188, 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:24.195 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:24.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:24.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:24.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.945527624999997, 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:24.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.871877834000003, 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:24.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:24.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 49.751185337999999, 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:24.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:24.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:24.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.059913484, 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:24.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:24.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:24.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:24.224 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:24.226 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:24.226 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:24.222+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:24.327 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:24.326+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:24.358 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:24.358 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:24.358 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:24.358 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:24.358 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:24.372 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:24.428 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:24.426+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:24.494 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:24.494 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:24.494 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:24.495 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:24.495 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:24.508 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:24.529 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:24.526+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:24.558 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:24.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:24.589 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:24.589 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:24.619 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:24.620 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:24.630 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:24.626+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.074044217999997, 2024-09-10T05:56:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.014442547999998, 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.983774220999997, 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:278 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.874852212, 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042062799999999997, 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 278 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757174+0000", 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.01e-06 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757188+0000", 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3566e-05 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757220+0000", 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2366000000000001e-05 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757242+0000", 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2123000000000001e-05 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757475+0000", 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232933 2024-09-10T05:56:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757676+0000", 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201015 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.758046+0000", 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037016700000000002 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.759750+0000", 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001703743 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761239+0000", 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001489074 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761318+0000", 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9153000000000006e-05 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761377+0000", 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9129999999999998e-05 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.865826671999997, 2024-09-10T05:56:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.827667699000003, 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.824727623999998, 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.821427307999997, 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.821203406999999, 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.817972204999997, 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.813368740999998, 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.813040588, 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.810434915000002, 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:541 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.806730053999999, 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040888419999999997, 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 541 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825295+0000", 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2240000000000001e-06 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825299+0000", 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.78e-06 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825310+0000", 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0472000000000001e-05 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825318+0000", 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2470000000000008e-06 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825389+0000", 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0562000000000006e-05 2024-09-10T05:56:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825523+0000", 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013447700000000001 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825807+0000", 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028389799999999998 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826735+0000", 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000928399 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829214+0000", 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024790739999999999 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829310+0000", 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5409999999999996e-05 2024-09-10T05:56:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829382+0000", 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2298999999999993e-05 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:542 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.806546697999998, 2024-09-10T05:56:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043528350000000002, 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 542 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825478+0000", 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-06 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825483+0000", 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5999999999999997e-06 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825492+0000", 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7979999999999995e-06 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825498+0000", 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2024-09-10T05:56:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825542+0000", 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3473999999999997e-05 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825612+0000", 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9827999999999996e-05 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825887+0000", 2024-09-10T05:56:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027574400000000002 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829399+0000", 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035113480000000001 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829709+0000", 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030994399999999999 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829785+0000", 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6397999999999996e-05 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829830+0000", 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499000000000002e-05 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:549 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.803818272999997, 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037770590000000001, 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828206+0000", 2024-09-10T05:56:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.184e-06 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828213+0000", 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5339999999999996e-06 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828227+0000", 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4364e-05 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828235+0000", 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3140000000000004e-06 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828307+0000", 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1069999999999995e-05 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828381+0000", 2024-09-10T05:56:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3962999999999996e-05 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828634+0000", 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025348699999999999 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831434+0000", 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028002410000000002 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831802+0000", 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000367611 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831907+0000", 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831982+0000", 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5174999999999998e-05 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:572 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.794664986999997, 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042700999999999998, 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 572 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837360+0000", 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.852e-06 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837370+0000", 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4320000000000005e-06 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837395+0000", 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4913e-05 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837423+0000", 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.868e-05 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837521+0000", 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7781000000000005e-05 2024-09-10T05:56:24.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837663+0000", 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141879 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837942+0000", 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027889499999999998 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839924+0000", 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019820860000000001 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841150+0000", 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226502 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841232+0000", 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1862999999999999e-05 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841628+0000", 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039621699999999998 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:595 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.787988294999998, 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043611129999999998, 2024-09-10T05:56:24.739 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 595 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844037+0000", 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5880000000000001e-06 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844044+0000", 2024-09-10T05:56:24.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9999999999999999e-06 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844073+0000", 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9487000000000001e-05 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844085+0000", 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844199+0000", 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113949 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844345+0000", 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014550199999999999 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844724+0000", 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037932299999999999 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.846072+0000", 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001348199 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848244+0000", 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002171264 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848328+0000", 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4724999999999999e-05 2024-09-10T05:56:24.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848396+0000", 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7896000000000002e-05 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:24.745 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.687445459000003, 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:24.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.681791464, 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.752 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:24.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:24.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.757 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:24.758 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:24.758 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:24.759 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:24.759 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:24.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:24.760 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:24.760 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:24.761 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:24.757+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:24.761 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:24.762 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:24.762 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:24.777 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:24.777 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:24.860 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:24.858+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:24.935 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:24.935 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:24.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:24.961 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:24.958+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:56:25.062 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:25.057+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:25.069 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:25.070 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:25.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:25.171 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:25.169+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:25.250 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:25.250 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:25.263 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:25.262+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:25.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:25.364 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:25.361+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:25.427 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:25.427 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:25.441 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:25.483 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:25.481+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:25.566 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:25.561+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:25.605 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:25.606 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:25.621 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:25.707 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:25.705+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:25.768 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:25.765+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:25.785 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:25.786 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:25.800 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:25.868 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:25.866+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:25.969 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:25.966+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:25.969 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:25.970 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:25.984 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:26.069 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:26.065+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:26.107 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:26.108 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:26.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:26.170 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:26.166+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:26.271 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:26.270+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:26.285 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:26.285 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:26.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:26.372 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:26.369+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:26.468 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:26.468 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:26.473 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:26.473+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:26.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:26.574 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:26.573+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:26.656 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:26.656 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:26.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:26.675 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:26.673+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:26.776 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:26.773+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:26.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:26.845 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:26.845 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:26.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:26.907 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:26.906+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:26.977 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:26.974+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:27.001 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:27.001 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:27.031 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:27.031 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:27.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:56:27.062 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:27.062 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:27.078 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:27.074+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:27.129 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:27.129 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:27.129 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:27.129 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:27.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:27.131 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:27.131 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:27.159 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:27.159 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:27.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:27.193 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:27.194 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:27.190+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:27.223 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:27.224 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:27.279 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:27.277+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:27.329 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:27.329 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:27.329 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:27.329 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:27.329 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:27.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:27.380 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:27.377+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:27.459 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:27.459 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:27.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.90267566, 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:27.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:27.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.467 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.820929995999997, 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.468 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:27.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:27.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.771040216999999, 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:27.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:27.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:27.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.752733349000003, 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.481 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:27.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:27.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.690010628000003, 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:27.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:27.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:27.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:27.495 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.684884981000003, 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:27.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:27.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.502 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.679722503999997, 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:27.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:27.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:27.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.679437339000003, 2024-09-10T05:56:27.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:27.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:27.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:27.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.673785293000002, 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:27.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:27.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:27.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.671461889, 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:27.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:27.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:27.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.665363470000003, 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:27.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:27.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.664249503999997, 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:27.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.629061217999997, 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:27.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:27.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.622817771999998, 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:27.545 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:27.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:27.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.618545701999999, 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:27.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:27.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:27.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.611626907000002, 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:27.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.607502470999997, 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:27.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:27.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.546142588000002, 2024-09-10T05:56:27.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:27.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:27.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:27.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.539704518999997, 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:27.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:27.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.532433808999997, 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:27.583 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:27.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:27.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:27.589 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:27.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:27.591 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:27.589+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:27.692 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:27.690+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:27.761 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:27.761 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:27.761 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:27.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:27.793 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:27.789+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:27.894 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:27.890+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:27.989 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:27.989 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:27.989 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:27.989 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:27.989 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:27.995 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:27.993+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:28.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:28.019 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:56:28.096 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:28.094+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:28.191 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:28.191 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.558926866999997, 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:28.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 57.554015300000003, 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:28.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.441522245000002, 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:28.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:28.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.436674957000001, 2024-09-10T05:56:28.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:28.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:28.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:28.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:28.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.432157617000001, 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:28.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:28.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.423946295999997, 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:28.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.389562476000002, 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:28.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.383794475999998, 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:28.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:28.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:28.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.241 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.383202501, 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.242 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:28.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:28.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.379770006000001, 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:28.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.376834064000001, 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.225690329999999, 2024-09-10T05:56:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:28.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.266 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.965319477000001, 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:28.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.961298857000003, 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:28.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:28.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:28.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.278 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.951854589999996, 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:28.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:28.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.947933460999998, 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:28.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.293 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.906940716999998, 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.299 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.826052171000001, 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:28.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.736411330000003, 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.306 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:28.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:28.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 53.724945304999999, 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:28.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:28.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.318 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:28.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:28.320 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:28.317+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:28.421 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:28.417+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:28.522 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:28.517+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:28.528 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:28.528 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:28.529 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:28.529 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:28.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:28.623 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:28.621+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:28.714 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:28.714 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:28.714 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:28.724 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:28.722+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:28.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:28.825 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:28.822+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:28.926 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:28.926+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:28.945 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.317096524, 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.946 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:28.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:28.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:28.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.952 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.267893716000003, 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.953 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:28.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:28.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.226835846999997, 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:28.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:28.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:28.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.965 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.213420306000003, 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:28.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:28.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.147831054000001, 2024-09-10T05:56:28.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:28.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:28.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:28.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.143807195000001, 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:28.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:28.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.143239628000003, 2024-09-10T05:56:28.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:28.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.125947042, 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.990 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:28.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:28.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:28.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.109621193000002, 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:28.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:28.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:28.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:28.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.032486480999999, 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:29.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:29.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.026485088999998, 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:29.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:29.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:29.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.997837865000001, 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.015 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:29.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.989647644999998, 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:29.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.027 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.924010156999998, 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:29.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:29.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:29.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:29.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.917250342999999, 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:29.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.913421134000004, 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.040 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.045 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.800407571000001, 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:29.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.72675778, 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:29.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:29.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:29.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 54.606065284000003, 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.057 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:29.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:29.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.9147934299999996, 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:29.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:29.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:29.067 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:29.069 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:29.069 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:29.065+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:29.170 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:29.165+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:29.201 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:29.201 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:29.201 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:29.201 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:29.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:29.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:29.286 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:29.286+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:29.372 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:29.370+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:29.382 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:29.396 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:29.439 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:29.469 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:29.472 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:29.470+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:29.499 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:29.499 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:29.520 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.961282701000002, 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.521 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:29.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:29.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:29.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.901681031000003, 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:29.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.532 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.871012704000002, 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:29.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:29.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:29.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:29.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:29.540 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.540 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.541 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.541 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:278 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.541 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:29.542 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.762090694999998, 2024-09-10T05:56:29.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042062799999999997, 2024-09-10T05:56:29.542 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.542 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.542 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.542 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.542 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 278 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757174+0000", 2024-09-10T05:56:29.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.01e-06 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757188+0000", 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3566e-05 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757220+0000", 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2366000000000001e-05 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757242+0000", 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2123000000000001e-05 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757475+0000", 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232933 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757676+0000", 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201015 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.758046+0000", 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037016700000000002 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.759750+0000", 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001703743 2024-09-10T05:56:29.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761239+0000", 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001489074 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761318+0000", 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9153000000000006e-05 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761377+0000", 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9129999999999998e-05 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.753065155000002, 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:29.549 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:29.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:29.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:29.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.714906182, 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:29.560 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.711966107000002, 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:29.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:29.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:29.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:29.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:29.567 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.708665791000001, 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.708441890000003, 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:29.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:29.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:29.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.705210688000001, 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.579 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:29.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:29.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.700607224000002, 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.586 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:29.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.700279070999997, 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:29.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:29.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:29.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:29.599 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.697673397999999, 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:29.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:29.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:541 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.693968537000003, 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040888419999999997, 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 541 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:29.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825295+0000", 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2240000000000001e-06 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825299+0000", 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.78e-06 2024-09-10T05:56:29.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825310+0000", 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0472000000000001e-05 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825318+0000", 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2470000000000008e-06 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825389+0000", 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0562000000000006e-05 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825523+0000", 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013447700000000001 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825807+0000", 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028389799999999998 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826735+0000", 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000928399 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829214+0000", 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024790739999999999 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829310+0000", 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5409999999999996e-05 2024-09-10T05:56:29.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829382+0000", 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2298999999999993e-05 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:542 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.693785181000003, 2024-09-10T05:56:29.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043528350000000002, 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 542 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:29.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825478+0000", 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-06 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825483+0000", 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5999999999999997e-06 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825492+0000", 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7979999999999995e-06 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825498+0000", 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825542+0000", 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3473999999999997e-05 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825612+0000", 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9827999999999996e-05 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825887+0000", 2024-09-10T05:56:29.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027574400000000002 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829399+0000", 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035113480000000001 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829709+0000", 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030994399999999999 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829785+0000", 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6397999999999996e-05 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829830+0000", 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499000000000002e-05 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:549 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.691056756000002, 2024-09-10T05:56:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037770590000000001, 2024-09-10T05:56:29.619 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828206+0000", 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.184e-06 2024-09-10T05:56:29.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828213+0000", 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5339999999999996e-06 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828227+0000", 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4364e-05 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828235+0000", 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3140000000000004e-06 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828307+0000", 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1069999999999995e-05 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828381+0000", 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3962999999999996e-05 2024-09-10T05:56:29.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828634+0000", 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025348699999999999 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831434+0000", 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028002410000000002 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831802+0000", 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000367611 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831907+0000", 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831982+0000", 2024-09-10T05:56:29.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5174999999999998e-05 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:572 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.681903470000002, 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042700999999999998, 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.626 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 572 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837360+0000", 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.852e-06 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837370+0000", 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4320000000000005e-06 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837395+0000", 2024-09-10T05:56:29.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4913e-05 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837423+0000", 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.868e-05 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837521+0000", 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7781000000000005e-05 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837663+0000", 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141879 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837942+0000", 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027889499999999998 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839924+0000", 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019820860000000001 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841150+0000", 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226502 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841232+0000", 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1862999999999999e-05 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841628+0000", 2024-09-10T05:56:29.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039621699999999998 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:595 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.675226778000003, 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043611129999999998, 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 595 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844037+0000", 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5880000000000001e-06 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844044+0000", 2024-09-10T05:56:29.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9999999999999999e-06 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844073+0000", 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9487000000000001e-05 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844085+0000", 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844199+0000", 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113949 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844345+0000", 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014550199999999999 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844724+0000", 2024-09-10T05:56:29.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037932299999999999 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.846072+0000", 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001348199 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848244+0000", 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002171264 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848328+0000", 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4724999999999999e-05 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848396+0000", 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7896000000000002e-05 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.638 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.574683942, 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:29.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:29.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.569029946999997, 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:29.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:29.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:29.651 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:29.651 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:29.652 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:29.652 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:29.653 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:29.653 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:29.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:29.654 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:29.649+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:29.654 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:29.655 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:29.655 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:29.655 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:29.656 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:29.656 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:29.753 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:29.750+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:29.827 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:29.828 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:29.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:29.854 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:29.854+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:29.955 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:29.954+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:29.968 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:29.968 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:29.982 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:30.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:56:30.056 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:30.053+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:30.107 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:30.107 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:30.122 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:30.156 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:30.154+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:30.257 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:30.253+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:30.287 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:30.287 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:30.301 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:30.358 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:30.358+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:30.459 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:30.457+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:30.460 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:30.460 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:30.475 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:30.559 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:30.558+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:30.642 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:30.642 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:30.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:30.660 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:30.658+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:30.761 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:30.758+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:30.779 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:30.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:30.862 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:30.862+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:30.916 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:30.917 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:30.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:30.962 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:30.962+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:31.020 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:56:31.057 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:31.058 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:31.073 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:31.098 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:31.098+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:31.164 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:31.161+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:31.265 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:31.261+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:31.265 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:31.266 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:31.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:31.366 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:31.362+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:31.450 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:31.450 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:31.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:31.468 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:31.465+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:31.569 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:31.566+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:31.671 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:31.669+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:31.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:31.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:31.787 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:31.786+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:31.872 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:31.870+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:31.878 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:31.878 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:31.909 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:31.909 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:31.910 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:31.910 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:31.910 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:31.910 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:31.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:31.939 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:31.970 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:31.970 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:31.974 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:31.969+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:32.003 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:32.003 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:32.036 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:32.069 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:32.070 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:32.074 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:32.070+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:32.102 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:32.102 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:32.108 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:32.109 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:32.109 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:32.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:32.178 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:32.178+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:32.275 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:32.274+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:32.349 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.792237134999993, 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:32.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:32.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:32.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.710491470999997, 2024-09-10T05:56:32.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:32.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:32.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.660601692, 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.363 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:32.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:32.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.642294823999997, 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:32.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:32.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:32.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.579572102999997, 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:32.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:32.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.382 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.574446455999997, 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:32.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:32.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:32.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.569283978999998, 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:32.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:32.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.568998813999997, 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:32.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.563346768000002, 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:32.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:32.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.561023364, 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:32.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:32.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:32.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.554924945000003, 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:32.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:32.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.553810978999998, 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:32.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:32.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.518622692999998, 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:32.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:32.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.512379246999998, 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:32.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:32.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:32.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.508107176999999, 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:32.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:32.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.446 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.501188382000002, 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:32.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.497063945999997, 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:32.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.435704063000003, 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:32.459 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:32.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:32.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:32.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.429265993999998, 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:32.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.421995283999998, 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:32.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:32.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:32.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:32.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:32.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:32.477 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:32.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:32.479 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:32.477+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:32.579 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:32.578+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:32.679 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:32.678+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:32.695 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:32.695 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:32.695 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:32.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:32.781 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:32.777+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:32.881 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:32.878+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:32.922 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:32.923 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:32.923 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:32.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:32.982 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:32.982+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:33.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:56:33.098 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:33.098+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.521479607000003, 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:33.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:33.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:33.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:33.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 62.516568040000003, 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:33.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:33.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:33.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.404074985000001, 2024-09-10T05:56:33.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:33.169 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.169 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:33.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:33.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.175 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.399227697000001, 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:33.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:33.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.394710357000001, 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:33.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.386499036000004, 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:33.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:33.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.197 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.352115216000001, 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.198 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:33.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:33.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:33.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:33.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:33.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.346347215999998, 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:33.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:33.212 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.345755240999999, 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.213 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:33.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:33.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.219 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.342322746000001, 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.220 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:33.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:33.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.339386804, 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:33.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:33.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:33.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:33.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:33.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.188243069999999, 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:33.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:33.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:33.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.927872217000001, 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:33.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.923851597000002, 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:33.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.914407330000003, 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:33.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:33.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.910486200999998, 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:33.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:33.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.869493456999997, 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:33.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:33.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:33.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:33.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.788604911, 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.282 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.698964070000002, 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:33.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.289 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 58.687498044999998, 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.290 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:33.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:33.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.297 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:33.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:33.299 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:33.298+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:33.400 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:33.397+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:33.501 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:33.498+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:33.515 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:33.515 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:33.516 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:33.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:33.622 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:33.622+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:33.637 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:56:33.715 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:33.714+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:33.749 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:33.749 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:33.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:33.803 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:33.801+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:33.904 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:33.901+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:33.986 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.986 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.357393359, 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:33.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.308190551000003, 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:33.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:33.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:33.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:33.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:33.999 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.267132682000003, 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:34.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:34.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.005 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.253717141000003, 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:34.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:34.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:34.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.012 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.188127889, 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:34.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.18410403, 2024-09-10T05:56:34.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:34.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:34.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:34.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.183536463000003, 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.027 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:34.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:34.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.032 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.166243876999999, 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:34.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.149918028000002, 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:34.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:34.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:34.044 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.072783315999999, 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:34.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.066781923999997, 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:34.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:34.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.056 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.038134700000001, 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:34.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:34.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.062 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.029944479999997, 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:34.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.964306991999997, 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:34.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:34.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:34.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:34.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.957547177999999, 2024-09-10T05:56:34.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:34.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.953717969000003, 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:34.080 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:34.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.840704406, 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:34.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:34.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:34.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.767054614999999, 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:34.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:34.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 59.646362119000003, 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:34.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:34.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.955090265000001, 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:34.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:34.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:34.109 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:34.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:34.111 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:34.110+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:34.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:34.211 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:34.210+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:34.243 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:34.243 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:34.243 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:34.257 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:34.312 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:34.310+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:34.351 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:34.380 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:34.380 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:34.380 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:34.380 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:34.380 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:34.381 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:34.381 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:34.396 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:34.412 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:34.442 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:34.443 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:34.443 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:34.441+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:34.473 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:34.473 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:34.505 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:34.505 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:34.514 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:34.510+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:34.519 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:34.519 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:34.534 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:34.537 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:34.538 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:34.569 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:34.569 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:34.637 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:34.634+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:34.699 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:34.699 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:34.713 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:34.715 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:34.713+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:34.816 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:34.813+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:34.835 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:34.835 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:34.850 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:34.916 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:34.914+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:35.013 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:35.018 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:35.014+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:35.027 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:35.119 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:35.117+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:35.145 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:35.145 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:35.159 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:35.220 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:35.217+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:35.276 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:35.276 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:35.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:35.334 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:35.333+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:35.413 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:35.414 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:35.421 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:35.417+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:35.428 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:35.522 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:35.517+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:35.591 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:35.592 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:35.606 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:35.647 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:35.645+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:35.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:56:35.723 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:35.721+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:35.768 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:35.768 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:35.783 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:35.830 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:35.829+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:35.903 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:35.903 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:35.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:35.963 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:35.961+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:36.026 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:36.025+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:36.088 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:36.089 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:36.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:36.150 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:36.149+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:36.228 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:36.225+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:36.318 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:36.319 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:36.329 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:36.325+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:36.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:36.430 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:36.425+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:36.531 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:36.529+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:36.544 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:36.544 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:36.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:36.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:36.633 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:36.629+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:36.736 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:36.733+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:36.739 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:56:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:36.774 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:36.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:36.810 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:36.811 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:36.834 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:36.833+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:36.841 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:36.841 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:36.872 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:36.902 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:36.902 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:36.935 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:36.936 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:36.936 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:36.933+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:36.968 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:36.980 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:36.980 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:36.980 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:36.980 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:36.980 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:36.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:37.001 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:37.002 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:37.034 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:37.037 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:37.033+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:37.138 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:37.137+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:37.171 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 70.614477875000006, 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:37.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:37.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:37.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:37.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:37.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.532732211000003, 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:37.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:37.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.482842431999998, 2024-09-10T05:56:37.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:37.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:37.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:37.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.464535564000002, 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:37.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:37.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:37.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.401812843000002, 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:37.200 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:37.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:37.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:37.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:37.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.396687196000002, 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:37.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:37.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.391524719000003, 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:37.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:37.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:37.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.391239554000002, 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.385587508, 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.229 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:37.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:37.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:37.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.383264103999998, 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.236 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:37.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:37.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:37.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.377165685000001, 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.243 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:37.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:37.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.250 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.376051719000003, 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:37.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:37.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:37.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.340863433000003, 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:37.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:37.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.334619987000004, 2024-09-10T05:56:37.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.330347916999997, 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.273 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:37.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:37.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:37.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:37.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:37.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:37.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:37.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.323429122, 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:37.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:37.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.319304686000002, 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:37.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.257944803000001, 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:37.295 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:37.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:37.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:37.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:37.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.251506734000003, 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.305 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:37.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.244236024000003, 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:37.312 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:37.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:37.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.320 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.320 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:37.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:37.322 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:37.317+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:37.422 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:37.417+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:37.523 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:37.521+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:37.532 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:37.532 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:37.532 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:37.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:37.623 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:37.621+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:37.717 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:37.717 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:37.717 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:37.724 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:37.721+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:37.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:37.825 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:37.821+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 71.276904142000006, 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:37.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:37.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.271992574999999, 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:37.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:37.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.159499519999997, 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.923 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:37.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:37.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.154652232000004, 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.930 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:37.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:37.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.150134891999997, 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.936 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:37.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.141923571000007, 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:37.942 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:37.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:37.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.107539751000004, 2024-09-10T05:56:37.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:37.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.955 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.101771751000001, 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:37.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:37.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.101179775999995, 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:37.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.968 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.097747280999997, 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.969 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:37.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.094811339000003, 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:37.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.981 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.943667605000002, 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:37.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:37.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.987 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.683296751999997, 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:37.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:37.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.993 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.679276131999998, 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:37.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:37.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:37.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:37.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.669831864999999, 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:38.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:38.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:38.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:38.006 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.665910736000001, 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:38.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:38.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:38.012 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.624917992, 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:38.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:38.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.544029446000003, 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:38.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:38.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:38.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.454388604999998, 2024-09-10T05:56:38.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:38.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.031 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 63.442922580000001, 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.038 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:38.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:38.040 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:38.037+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:38.140 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:38.137+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:38.241 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:38.237+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:38.250 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:38.250 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:38.250 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:38.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:38.342 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:38.337+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:38.443 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:38.441+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:38.478 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:38.478 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:38.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:38.544 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:38.541+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:38.645 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:38.641+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:38.668 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:38.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.039695666, 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:38.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:38.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:38.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:38.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.990492857999996, 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:38.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.949434988999997, 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:38.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:38.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:38.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.936019447999996, 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:38.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:38.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:38.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.870430196000001, 2024-09-10T05:56:38.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:38.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:38.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.866406337000001, 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:38.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:38.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.865838769999996, 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:38.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:38.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.848546184, 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:38.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:38.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.832220335000002, 2024-09-10T05:56:38.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:38.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:38.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:38.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.755085622999999, 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:38.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:38.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.735 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.749084230999998, 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:38.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:38.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.742 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.720437007000001, 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:38.744 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:38.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:38.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.712246786999998, 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:38.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:38.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.646609299000005, 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:38.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.639849484999999, 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:38.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.636020275999996, 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:38.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:38.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.523006713000001, 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:38.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:38.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:38.781 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.449356922000007, 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.782 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:38.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:38.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:38.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:38.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.328664426000003, 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:38.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:38.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 15.637392572, 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:38.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:38.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:38.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:38.799 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:38.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:56:38.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:38.802 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:38.797+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:38.901 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:38.897+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:38.933 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:38.933 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:38.933 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:38.933 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:38.947 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:39.034 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:39.033+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:39.058 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:39.104 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:39.101+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:39.113 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:39.113 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:39.113 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:39.114 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:39.114 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:39.128 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:39.214 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:39.213+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:39.257 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:39.257 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:39.287 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:39.287 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:39.299 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:39.299 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:39.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:39.299 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:39.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.738418109999998, 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.300 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:39.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:39.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.304 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 68.678816440000006, 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.305 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:39.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.309 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.648148113000005, 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.310 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:39.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:39.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:278 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.539226103999994, 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042062799999999997, 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 278 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757174+0000", 2024-09-10T05:56:39.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.01e-06 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757188+0000", 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3566e-05 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757220+0000", 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2366000000000001e-05 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757242+0000", 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2123000000000001e-05 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757475+0000", 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232933 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757676+0000", 2024-09-10T05:56:39.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201015 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.758046+0000", 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037016700000000002 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.759750+0000", 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001703743 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761239+0000", 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001489074 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761318+0000", 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9153000000000006e-05 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761377+0000", 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9129999999999998e-05 2024-09-10T05:56:39.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.530200563999998, 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:39.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:39.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:39.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.492041591000003, 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:39.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.489101516000005, 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:39.336 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:39.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:39.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:39.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.342 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.485801199999997, 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.485577298999999, 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.348 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:39.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:39.354 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.482346097000004, 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.355 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:39.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.477742633000005, 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.361 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:39.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:39.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.366 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.477414479999993, 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.367 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:39.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.474808807000002, 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.373 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:39.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:39.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:541 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.379 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.471103945999999, 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040888419999999997, 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 541 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825295+0000", 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2240000000000001e-06 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825299+0000", 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.78e-06 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825310+0000", 2024-09-10T05:56:39.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0472000000000001e-05 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825318+0000", 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2470000000000008e-06 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825389+0000", 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0562000000000006e-05 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825523+0000", 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013447700000000001 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825807+0000", 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028389799999999998 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826735+0000", 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000928399 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829214+0000", 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024790739999999999 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829310+0000", 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5409999999999996e-05 2024-09-10T05:56:39.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829382+0000", 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2298999999999993e-05 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:542 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.470920590000006, 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043528350000000002, 2024-09-10T05:56:39.386 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 542 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825478+0000", 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-06 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825483+0000", 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5999999999999997e-06 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825492+0000", 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7979999999999995e-06 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825498+0000", 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2024-09-10T05:56:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825542+0000", 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3473999999999997e-05 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825612+0000", 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9827999999999996e-05 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825887+0000", 2024-09-10T05:56:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027574400000000002 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829399+0000", 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035113480000000001 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829709+0000", 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030994399999999999 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829785+0000", 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6397999999999996e-05 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829830+0000", 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499000000000002e-05 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:549 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.468192165000005, 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037770590000000001, 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828206+0000", 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.184e-06 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828213+0000", 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5339999999999996e-06 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828227+0000", 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4364e-05 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828235+0000", 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3140000000000004e-06 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828307+0000", 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1069999999999995e-05 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828381+0000", 2024-09-10T05:56:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3962999999999996e-05 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828634+0000", 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025348699999999999 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831434+0000", 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028002410000000002 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831802+0000", 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000367611 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831907+0000", 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831982+0000", 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5174999999999998e-05 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:572 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.459038879000005, 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042700999999999998, 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 572 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837360+0000", 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.852e-06 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837370+0000", 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4320000000000005e-06 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837395+0000", 2024-09-10T05:56:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4913e-05 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837423+0000", 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.868e-05 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837521+0000", 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7781000000000005e-05 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837663+0000", 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141879 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837942+0000", 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027889499999999998 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839924+0000", 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019820860000000001 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841150+0000", 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226502 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841232+0000", 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1862999999999999e-05 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841628+0000", 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039621699999999998 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:595 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.452362187000006, 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043611129999999998, 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 595 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844037+0000", 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5880000000000001e-06 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844044+0000", 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9999999999999999e-06 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844073+0000", 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9487000000000001e-05 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844085+0000", 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844199+0000", 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113949 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844345+0000", 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014550199999999999 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844724+0000", 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037932299999999999 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.846072+0000", 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001348199 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848244+0000", 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002171264 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848328+0000", 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4724999999999999e-05 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848396+0000", 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7896000000000002e-05 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.351819351000003, 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.346165356, 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:39.424 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:39.425 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:39.426 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:39.426 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:39.427 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:39.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:39.427 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:39.421+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:39.428 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:39.428 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:39.428 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:39.428 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:39.445 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:39.445 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:39.478 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:39.478 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:39.526 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:39.525+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:39.601 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:39.601 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:39.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:39.659 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:39.657+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:39.728 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:39.725+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:56:39.785 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:39.785 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:39.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:39.828 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:39.825+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:39.929 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:39.925+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:39.969 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:39.969 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:39.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:40.030 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:40.025+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:40.102 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:40.102 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:40.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:40.163 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:40.161+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:40.231 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:40.229+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:40.239 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:40.239 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:40.254 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:40.339 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:40.337+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:40.418 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:40.418 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:40.433 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:40.434 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:40.433+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:40.535 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:40.533+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:40.598 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:40.599 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:40.613 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:40.636 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:40.633+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:40.727 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:40.727 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:40.737 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:40.733+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:40.744 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:40.838 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:40.833+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:40.907 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:40.907 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:40.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:40.938 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:40.937+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:41.039 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:41.037+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:41.042 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:41.043 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:41.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:41.141 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:41.137+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:41.217 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:41.217 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:41.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:41.274 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:41.273+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:41.342 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:41.337+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:41.346 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:41.346 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:41.359 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:41.446 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:41.445+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:41.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:41.523 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:41.523 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:41.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:41.578 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:41.577+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:41.630 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:41.630 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:41.645 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:41.641+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:41.646 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:41.647 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:41.670 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:41.696 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:41.696 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:41.702 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:41.703 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:41.703 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:41.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:41.718 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:41.718 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:41.738 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:41.738 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:41.745 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:41.741+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:41.760 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:41.760 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:41.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:56:41.783 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:41.783 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:41.833 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:41.833 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:41.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:41.833 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:41.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:41.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.276710140000006, 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:41.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:41.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:41.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.194964475999996, 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:41.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:41.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.145074696999998, 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.847 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:41.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:41.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.126767829000002, 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:41.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:41.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:41.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.860 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.064045108000002, 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:41.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:41.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:41.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.867 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.058919461000002, 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.868 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:41.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:41.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.053756984000003, 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:41.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:41.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:41.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:41.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.053471818999995, 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:41.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:41.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:41.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.047819773000001, 2024-09-10T05:56:41.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:41.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:41.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:41.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.045496369000006, 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:41.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.902 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.039397949999994, 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:41.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.908 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.038283984000003, 2024-09-10T05:56:41.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:41.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:41.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:41.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.003095697999996, 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.916 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.917 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:41.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:41.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.996852251999996, 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:41.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.930 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.992580181999998, 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.931 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:41.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:41.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:41.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.937 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.985661386999993, 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:41.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:41.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:41.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.981536950999995, 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:41.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:41.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:41.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.920177068000001, 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:41.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:41.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:41.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.913738999000003, 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:41.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:41.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:41.962 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 67.906468289000003, 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:41.963 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:41.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:41.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:41.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:41.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:41.969 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:41.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:41.971 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:41.969+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:42.071 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:42.069+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:42.135 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:42.135 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:42.135 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:42.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:42.172 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:42.169+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:42.272 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:42.269+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:42.311 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:42.311 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:42.312 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:42.312 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:42.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:42.373 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:42.369+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:42.474 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:42.469+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:42.485 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:42.485 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:42.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 75.852339795999995, 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:42.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:42.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:42.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:42.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 71.847428229000002, 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:42.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:42.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.734935174, 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:42.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.730087886000007, 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:42.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:42.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:265 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.725570546, 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026197220000000001, 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 265 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757760+0000", 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757761+0000", 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9900000000000009e-07 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757766+0000", 2024-09-10T05:56:42.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.288e-06 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757779+0000", 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3190000000000001e-05 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757803+0000", 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4226000000000001e-05 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757875+0000", 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1400000000000001e-05 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.757942+0000", 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7556000000000002e-05 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758082+0000", 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014004800000000001 2024-09-10T05:56:42.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.758674+0000", 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000591582 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760254+0000", 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001580325 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760329+0000", 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5289000000000004e-05 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.760379+0000", 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9818999999999999e-05 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.717359224999996, 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:42.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:42.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.682975404999993, 2024-09-10T05:56:42.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:42.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.677207405000004, 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:42.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:42.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.676615429999998, 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:42.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:42.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.673182935, 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:42.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:42.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:42.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:42.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.670246993000006, 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:42.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:42.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.560 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.519103259000005, 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:42.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:42.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.258732406000007, 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:42.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:42.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:42.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.254711786000001, 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:42.573 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:42.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:42.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.245267518999995, 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.241346390000004, 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.200353645999996, 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.119465099999999, 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.029824258999994, 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.018358234000004, 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:42.618 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:42.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:42.620 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:42.617+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:42.721 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:42.717+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:42.760 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:56:42.778 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:42.779 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:42.779 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:42.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:42.821 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:42.817+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:42.923 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:42.921+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:42.944 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:42.944 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:42.945 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:42.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:43.024 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:43.021+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.446117371, 2024-09-10T05:56:43.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:43.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:43.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.083 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.396914562999996, 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:43.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:43.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.355856693999996, 2024-09-10T05:56:43.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030447669999999999, 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 227 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717803+0000", 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717806+0000", 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5399999999999998e-06 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717818+0000", 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717847+0000", 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9113000000000001e-05 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717862+0000", 2024-09-10T05:56:43.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5043e-05 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.717990+0000", 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012786899999999999 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718194+0000", 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020475499999999999 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.718617+0000", 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042231700000000002 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720117+0000", 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014998310000000001 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720657+0000", 2024-09-10T05:56:43.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054002300000000004 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720738+0000", 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1743000000000007e-05 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.720848+0000", 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109669 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.342441152999996, 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030461189999999999, 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 231 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731219+0000", 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731221+0000", 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4159999999999998e-06 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731233+0000", 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1379999999999999e-05 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731262+0000", 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9762999999999999e-05 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731278+0000", 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5146e-05 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731395+0000", 2024-09-10T05:56:43.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117249 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.731605+0000", 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00020976299999999999 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.732010+0000", 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040589000000000001 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.733617+0000", 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016062439999999999 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734127+0000", 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051022199999999995 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734201+0000", 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-05 2024-09-10T05:56:43.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.734265+0000", 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4215999999999996e-05 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.276851901000001, 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:43.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:43.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:43.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:43.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.272828042, 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:43.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:43.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.272260474999996, 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:43.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:43.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.254967889, 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:43.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:43.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:43.128 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.238642040000002, 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:43.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:43.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:43.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.161507327999999, 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.135 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:43.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:43.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.155505935999997, 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:43.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.126858712000001, 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:43.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.118668491999998, 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:43.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:43.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.053031004000005, 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.046271189999999, 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.042441980999996, 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.929428418000001, 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.855778627000007, 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 68.735086131000003, 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.043814276999999, 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:43.203 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:43.205 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:43.208 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:43.201+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:43.306 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:43.301+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:43.342 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:43.342 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:43.342 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:43.342 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:43.356 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:43.406 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:43.405+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:43.507 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:43.505+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:43.527 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:43.528 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:43.528 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:43.528 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:43.528 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:43.542 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'. 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T05:56:43.593 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-10T05:56:43.594 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 2024-09-10T05:56:43.600 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T05:56:43.627 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:43.625+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:43.648 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T05:56:43.652 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T05:56:43.652 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T05:56:43.709 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:43.709 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:43.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:43.709 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:43.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 75.147495675000002, 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.710 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:43.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 73.087894004999995, 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:43.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:43.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:43.719 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.057225677999995, 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:43.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:43.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:278 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:43.726 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.948303668999998, 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042062799999999997, 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 278 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757171+0000", 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757174+0000", 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.01e-06 2024-09-10T05:56:43.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757188+0000", 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3566e-05 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757220+0000", 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2366000000000001e-05 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757242+0000", 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2123000000000001e-05 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757475+0000", 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232933 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.757676+0000", 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201015 2024-09-10T05:56:43.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.758046+0000", 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037016700000000002 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.759750+0000", 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001703743 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761239+0000", 2024-09-10T05:56:43.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001489074 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761318+0000", 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9153000000000006e-05 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.761377+0000", 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9129999999999998e-05 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.939278129000002, 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:43.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:43.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.901119155999993, 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.739 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:43.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.898179080999995, 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.744 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:43.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:43.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:43.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:43.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.750 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.894878765000001, 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:43.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:43.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:43.755 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.894654864000003, 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:43.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.761 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.891423661999994, 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:43.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:43.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.886820197999995, 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:43.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:43.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:43.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.886492044999997, 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:43.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.883886372000006, 2024-09-10T05:56:43.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:43.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:43.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:541 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.880181511000004, 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040888419999999997, 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 541 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825293+0000", 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825295+0000", 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2240000000000001e-06 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825299+0000", 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.78e-06 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825310+0000", 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0472000000000001e-05 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825318+0000", 2024-09-10T05:56:43.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2470000000000008e-06 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825389+0000", 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0562000000000006e-05 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825523+0000", 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013447700000000001 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:43.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825807+0000", 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028389799999999998 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826735+0000", 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000928399 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829214+0000", 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024790739999999999 2024-09-10T05:56:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829310+0000", 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5409999999999996e-05 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829382+0000", 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2298999999999993e-05 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:542 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.879998154999996, 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043528350000000002, 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 542 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.793 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825478+0000", 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-06 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825483+0000", 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5999999999999997e-06 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825492+0000", 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7979999999999995e-06 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825498+0000", 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825542+0000", 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3473999999999997e-05 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825612+0000", 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9827999999999996e-05 2024-09-10T05:56:43.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825887+0000", 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027574400000000002 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829399+0000", 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035113480000000001 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829709+0000", 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030994399999999999 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829785+0000", 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6397999999999996e-05 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829830+0000", 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499000000000002e-05 2024-09-10T05:56:43.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:549 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.877269729999995, 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037770590000000001, 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.799 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828205+0000", 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828206+0000", 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.184e-06 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828213+0000", 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5339999999999996e-06 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828227+0000", 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4364e-05 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828235+0000", 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3140000000000004e-06 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828307+0000", 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1069999999999995e-05 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828381+0000", 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3962999999999996e-05 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.828634+0000", 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025348699999999999 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831434+0000", 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028002410000000002 2024-09-10T05:56:43.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831802+0000", 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000367611 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831907+0000", 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.831982+0000", 2024-09-10T05:56:43.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5174999999999998e-05 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:572 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.868116443999995, 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042700999999999998, 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 572 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837358+0000", 2024-09-10T05:56:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837360+0000", 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.852e-06 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837370+0000", 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4320000000000005e-06 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837395+0000", 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4913e-05 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837423+0000", 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.868e-05 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837521+0000", 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7781000000000005e-05 2024-09-10T05:56:43.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837663+0000", 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141879 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.837942+0000", 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027889499999999998 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839924+0000", 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019820860000000001 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841150+0000", 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226502 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841232+0000", 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1862999999999999e-05 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.841628+0000", 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039621699999999998 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:595 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.861439751999995, 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043611129999999998, 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.811 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 595 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844037+0000", 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5880000000000001e-06 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844044+0000", 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9999999999999999e-06 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844073+0000", 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9487000000000001e-05 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844085+0000", 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844199+0000", 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113949 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844345+0000", 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014550199999999999 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844724+0000", 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037932299999999999 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.846072+0000", 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001348199 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848244+0000", 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002171264 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848328+0000", 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4724999999999999e-05 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848396+0000", 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7896000000000002e-05 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.816 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.760896915999993, 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:43.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:43.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 69.755242921000004, 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:43.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:43.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:43.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:43.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:43.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:43.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:43.829 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:43.829 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:43.705+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:43.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:43.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:43.832 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:43.829+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:43.933 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:43.929+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:43.987 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:43.988 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:44.001 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:44.001 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:44.001 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:44.001 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:44.004 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:44.004 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:44.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:44.019 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:44.020 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:44.036 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:44.037 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:44.052 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:44.067 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:44.065+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:44.069 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:44.070 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:44.086 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:44.087 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:44.104 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:44.105 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:44.140 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:44.140 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:44.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:44.162 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:44.161+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:44.236 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:44.233+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:44.320 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:44.320 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:44.334 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:44.379 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:44.377+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:44.438 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:44.437+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:44.454 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T05:56:44.454 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:44.454 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:44.469 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:44.534 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T05:56:44.539 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:44.537+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T05:56:44.596 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T05:56:44.596 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T05:56:44.636 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:44.636 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T05:56:44.640 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:44.637+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:44.642 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-10T05:56:44.642 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T05:56:44.651 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:44.691 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-09-10T05:56:44.692 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-09-10T05:56:44.692 DEBUG:teuthology.orchestra.run.smithi070:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-09-10T05:56:44.778 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:44.777+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:44.781 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:56:44.816 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:44.816 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:44.831 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:44.874 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:44.873+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:44.943 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:44.941+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:44.949 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:44.964 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:45.041 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records in 2024-09-10T05:56:45.041 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records out 2024-09-10T05:56:45.041 INFO:tasks.workunit.client.0.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112174 s, 935 MB/s 2024-09-10T05:56:45.044 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:45.041+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:45.133 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:45.134 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:45.145 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:45.141+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:45.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:45.220 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_45 2024-09-10T05:56:45.246 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:45.245+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:45.321 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:45.321 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:45.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:45.339 INFO:tasks.workunit.client.0.smithi070.stdout:quota set for the bucket: buck_2024_08_10_05_56_45 2024-09-10T05:56:45.382 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:45.381+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:45.448 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:45.445+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:45.455 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:45.455 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:45.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:45.558 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:45.557+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:45.582 INFO:tasks.workunit.client.0.smithi070.stdout:quota enabled for the bucket: buck_2024_08_10_05_56_45 2024-09-10T05:56:45.582 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 10Mb. 2024-09-10T05:56:45.582 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:56:45.582 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:45.582 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - Test max objects passed 2024-09-10T05:56:45.583 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:45.623 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:45.623 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:45.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:45.650 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:45.645+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:45.750 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:45.749+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:45.766 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:56:45.801 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:45.801 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:45.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:45.858 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:45.857+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:56:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:45.902 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records in 2024-09-10T05:56:45.902 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records out 2024-09-10T05:56:45.903 INFO:tasks.workunit.client.0.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0238811 s, 439 MB/s 2024-09-10T05:56:45.952 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:45.949+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:45.968 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:45.969 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:45.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:46.069 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_46 2024-09-10T05:56:46.069 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:46.065+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:46.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:46.143 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:46.144 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:46.154 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:46.149+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:46.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:46.255 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:46.253+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:46.272 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:46.272 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:46.304 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:46.305 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:46.336 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:46.336 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:46.355 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:46.353+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.803337380000002, 2024-09-10T05:56:46.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:56:46.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:56:46.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:46.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:56:46.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:56:46.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.721591716000006, 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045985610000000001, 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.367 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 208 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637948+0000", 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637951+0000", 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8500000000000004e-06 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637965+0000", 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3526000000000001e-05 2024-09-10T05:56:46.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637997+0000", 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2193999999999997e-05 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638022+0000", 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4916e-05 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638190+0000", 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016764199999999999 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638421+0000", 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023145199999999999 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.638865+0000", 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044383600000000002 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.640169+0000", 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013043830000000001 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642393+0000", 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022233069999999999 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642482+0000", 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8999000000000006e-05 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.642546+0000", 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4455999999999994e-05 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.671701936999995, 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032808339999999998, 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 219 2024-09-10T05:56:46.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687837+0000", 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687840+0000", 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7860000000000001e-06 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687853+0000", 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2480000000000001e-05 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687883+0000", 2024-09-10T05:56:46.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0073000000000002e-05 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.687905+0000", 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1837000000000001e-05 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688059+0000", 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015461899999999999 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688320+0000", 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026062399999999999 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.688746+0000", 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042629400000000002 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690205+0000", 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014589379999999999 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.690959+0000", 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075414700000000004 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691054+0000", 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4352999999999996e-05 2024-09-10T05:56:46.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.691118+0000", 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4683000000000004e-05 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:46.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.653395068999998, 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003387447, 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 224 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706144+0000", 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706146+0000", 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1469999999999999e-06 2024-09-10T05:56:46.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706156+0000", 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706183+0000", 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6556000000000001e-05 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706204+0000", 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1420000000000002e-05 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706357+0000", 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015247200000000001 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706580+0000", 2024-09-10T05:56:46.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000223069 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.706992+0000", 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041166899999999998 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.708393+0000", 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014011659999999999 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709373+0000", 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00098047600000000009 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709469+0000", 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5376000000000003e-05 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.709532+0000", 2024-09-10T05:56:46.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3176000000000006e-05 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:327 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.590672347999998, 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036508349999999998, 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 327 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:46.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768867+0000", 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768868+0000", 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.361e-06 2024-09-10T05:56:46.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768875+0000", 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.528e-06 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768892+0000", 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6962000000000001e-05 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768902+0000", 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0084999999999999e-05 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768965+0000", 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3462999999999999e-05 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769048+0000", 2024-09-10T05:56:46.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2253e-05 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769188+0000", 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014083800000000001 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.769846+0000", 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065795800000000005 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772455+0000", 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026081149999999998 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772490+0000", 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5508e-05 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.772518+0000", 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7764e-05 2024-09-10T05:56:46.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:349 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.585546700999998, 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034772969999999999, 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 349 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773993+0000", 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773994+0000", 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.164e-06 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.773999+0000", 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5670000000000002e-06 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774013+0000", 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3910999999999999e-05 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774022+0000", 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8680000000000005e-06 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774165+0000", 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014292800000000001 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774253+0000", 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8208000000000007e-05 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.774440+0000", 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.775024+0000", 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058389900000000003 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777376+0000", 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023522310000000002 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777433+0000", 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6762000000000003e-05 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.777470+0000", 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6819000000000001e-05 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:379 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.580384223999999, 2024-09-10T05:56:46.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0051999999999999998, 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 379 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779155+0000", 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779156+0000", 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9399999999999993e-07 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779161+0000", 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779171+0000", 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0375e-05 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779177+0000", 2024-09-10T05:56:46.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6550000000000001e-06 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779234+0000", 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7302999999999997e-05 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779329+0000", 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4629000000000005e-05 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779522+0000", 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019345500000000001 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780074+0000", 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000551802 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784281+0000", 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00420697 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784317+0000", 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5816999999999999e-05 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784355+0000", 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8379e-05 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:380 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.580099059000005, 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047510570000000004, 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 380 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779440+0000", 2024-09-10T05:56:46.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779441+0000", 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4899999999999995e-07 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779445+0000", 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3390000000000003e-06 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779457+0000", 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1455e-05 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779461+0000", 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5920000000000002e-06 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779513+0000", 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1702000000000001e-05 2024-09-10T05:56:46.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779594+0000", 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0835999999999997e-05 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.779727+0000", 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133528 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.780439+0000", 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071181499999999997 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784117+0000", 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036781159999999999 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784149+0000", 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1968999999999998e-05 2024-09-10T05:56:46.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.784191+0000", 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2055999999999998e-05 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:392 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.574447012999997, 2024-09-10T05:56:46.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047552610000000002, 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 392 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:46.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785092+0000", 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785093+0000", 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9299999999999997e-07 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785096+0000", 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9610000000000001e-06 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785104+0000", 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3869999999999995e-06 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785111+0000", 2024-09-10T05:56:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2020000000000001e-06 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785158+0000", 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7719000000000002e-05 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785246+0000", 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8189999999999994e-05 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785419+0000", 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017294599999999999 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.785914+0000", 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049434399999999997 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789769+0000", 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038556010000000002 2024-09-10T05:56:46.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789803+0000", 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3132000000000001e-05 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.789848+0000", 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5086000000000002e-05 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:395 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.572123609000002, 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063749289999999997, 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 395 2024-09-10T05:56:46.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787416+0000", 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787417+0000", 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1500000000000003e-07 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787421+0000", 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6210000000000003e-06 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787433+0000", 2024-09-10T05:56:46.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787439+0000", 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0379999999999996e-06 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787486+0000", 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7552000000000001e-05 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787540+0000", 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4123999999999999e-05 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.787647+0000", 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000106164 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.788132+0000", 2024-09-10T05:56:46.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000485508 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793718+0000", 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055859209999999998 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793752+0000", 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4141999999999999e-05 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793791+0000", 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8577e-05 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:410 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.566025190000005, 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049482040000000003, 2024-09-10T05:56:46.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 410 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:46.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793514+0000", 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793515+0000", 2024-09-10T05:56:46.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160000000000001e-06 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793521+0000", 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7780000000000004e-06 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793535+0000", 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4116e-05 2024-09-10T05:56:46.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793541+0000", 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1569999999999997e-06 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793611+0000", 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9474000000000006e-05 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793745+0000", 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134031 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.793891+0000", 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014566399999999999 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794550+0000", 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00065912299999999996 2024-09-10T05:56:46.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798390+0000", 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398149999999999 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798438+0000", 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8529000000000002e-05 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.798462+0000", 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4301e-05 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:417 6.1 6:8386e9da:lc::lc.16:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.564911223999999, 2024-09-10T05:56:46.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054795900000000003, 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 417 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:46.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794628+0000", 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794629+0000", 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4e-07 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794634+0000", 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7230000000000004e-06 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794646+0000", 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2252000000000001e-05 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794654+0000", 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0649999999999999e-06 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794719+0000", 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5352999999999996e-05 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794799+0000", 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0049999999999994e-05 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.794955+0000", 2024-09-10T05:56:46.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015595499999999999 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.795550+0000", 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059455 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800008+0000", 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044580799999999997 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800070+0000", 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1910999999999997e-05 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800108+0000", 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7811000000000001e-05 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:543 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.529722938000006, 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047697690000000001, 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 543 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829816+0000", 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829818+0000", 2024-09-10T05:56:46.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9920000000000002e-06 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829824+0000", 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.733e-06 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829838+0000", 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3485e-05 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829846+0000", 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9610000000000005e-06 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829905+0000", 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9825999999999999e-05 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.829968+0000", 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2932e-05 2024-09-10T05:56:46.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830099+0000", 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013023200000000001 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.830569+0000", 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047052800000000001 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834521+0000", 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039522969999999996 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834555+0000", 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3872999999999999e-05 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.834586+0000", 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0910000000000001e-05 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:564 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.523479492000007, 2024-09-10T05:56:46.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069425290000000002, 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 564 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:46.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836060+0000", 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836061+0000", 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9699999999999995e-07 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836064+0000", 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.219e-06 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836073+0000", 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2979999999999997e-06 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836078+0000", 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8219999999999997e-06 2024-09-10T05:56:46.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836132+0000", 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3885000000000003e-05 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836188+0000", 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6345999999999999e-05 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836308+0000", 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119856 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.836759+0000", 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045116900000000002 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842915+0000", 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061560499999999997 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.842960+0000", 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5145000000000002e-05 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843002+0000", 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2042000000000002e-05 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:574 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.519207421999994, 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037756170000000002, 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 574 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.453 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840332+0000", 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840333+0000", 2024-09-10T05:56:46.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.393e-06 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840339+0000", 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6980000000000003e-06 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840353+0000", 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4039999999999999e-05 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840362+0000", 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7369999999999995e-06 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840422+0000", 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9729999999999999e-05 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840508+0000", 2024-09-10T05:56:46.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6260000000000004e-05 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.840634+0000", 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000126441 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.841195+0000", 2024-09-10T05:56:46.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056110100000000005 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.843987+0000", 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002791258 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844049+0000", 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1937e-05 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.844108+0000", 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9021999999999998e-05 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:598 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.512288627000004, 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037788269999999998, 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 598 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847251+0000", 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847252+0000", 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.173e-06 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847260+0000", 2024-09-10T05:56:46.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9079999999999995e-06 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847277+0000", 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6718000000000002e-05 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847283+0000", 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6939999999999998e-06 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847327+0000", 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4240000000000003e-05 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847374+0000", 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6622999999999997e-05 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:46.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.847498+0000", 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000123802 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.848083+0000", 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000585068 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.850970+0000", 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028867469999999998 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851002+0000", 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2465000000000002e-05 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851030+0000", 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7389000000000002e-05 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:608 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.508164191000006, 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050518630000000002, 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 608 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851375+0000", 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851376+0000", 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.95e-07 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851380+0000", 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2640000000000002e-06 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851392+0000", 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1337e-05 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851398+0000", 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1240000000000002e-06 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851440+0000", 2024-09-10T05:56:46.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2558000000000001e-05 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851492+0000", 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2068999999999999e-05 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.851602+0000", 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109975 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.852029+0000", 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00042616399999999998 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856352+0000", 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043231370000000003 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856383+0000", 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1173999999999997e-05 2024-09-10T05:56:46.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.856427+0000", 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4066000000000001e-05 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:826 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:46.472 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.446804307999997, 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049916429999999996, 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 826 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912735+0000", 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912736+0000", 2024-09-10T05:56:46.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.356e-06 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912743+0000", 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2700000000000001e-06 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912756+0000", 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2959000000000001e-05 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912762+0000", 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3749999999999999e-06 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912810+0000", 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8004999999999999e-05 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912867+0000", 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6895000000000003e-05 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912978+0000", 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111346 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913427+0000", 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00044875999999999998 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917648+0000", 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042208009999999997 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917682+0000", 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4403000000000002e-05 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917727+0000", 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4472999999999999e-05 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:835 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.440366238999999, 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044083760000000003, 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 835 2024-09-10T05:56:46.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919173+0000", 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919174+0000", 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.75e-07 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919177+0000", 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9040000000000001e-06 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919185+0000", 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4300000000000006e-06 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919190+0000", 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4619999999999998e-06 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919228+0000", 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7993e-05 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919273+0000", 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5306999999999998e-05 2024-09-10T05:56:46.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919371+0000", 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7775999999999994e-05 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.919803+0000", 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043195199999999999 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923524+0000", 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003721584 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923556+0000", 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2104000000000003e-05 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923581+0000", 2024-09-10T05:56:46.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:846 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.433095528999999, 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034359450000000001, 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 846 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926444+0000", 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926445+0000", 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5799999999999998e-07 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926448+0000", 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8120000000000001e-06 2024-09-10T05:56:46.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926460+0000", 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1864e-05 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926469+0000", 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3750000000000003e-06 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926531+0000", 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2390000000000004e-05 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926645+0000", 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114073 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.926778+0000", 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013298800000000001 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.927285+0000", 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050652100000000001 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929804+0000", 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025194520000000001 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929844+0000", 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9703999999999998e-05 2024-09-10T05:56:46.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.929880+0000", 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5908000000000002e-05 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:46.491 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:46.492 INFO:tasks.workunit.client.0.smithi070.stdout:bucket quota max_objs set for the given user: buck_2024_08_10_05_56_46 2024-09-10T05:56:46.493 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:46.493 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:46.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:46.494 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:46.494 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:46.495 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:46.495 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:46.495 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:46.496 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:46.496 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:46.497 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:46.489+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:46.593 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:46.589+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:46.612 INFO:tasks.workunit.client.0.smithi070.stdout:quota enabled for the bucket: buck_2024_08_10_05_56_46 2024-09-10T05:56:46.612 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 10Mb. 2024-09-10T05:56:46.612 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:56:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - Test max objects for the given user passed 2024-09-10T05:56:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:46.654 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:46.654 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:46.654 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:46.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:46.713 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:46.709+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:46.795 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:46.793+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:46.827 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:46.827 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:46.827 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:46.827 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:46.827 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:46.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:46.894 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:56:46.894 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:46.895 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:46.893+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:46.923 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records in 2024-09-10T05:56:46.923 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records out 2024-09-10T05:56:46.923 INFO:tasks.workunit.client.0.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0253317 s, 414 MB/s 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:46.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 80.364160487999996, 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:46.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:46.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:46.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:47.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.359248921000002, 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:47.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.246755866000001, 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.008 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:47.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:47.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.241908577999993, 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:47.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.229179916999996, 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:47.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:47.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.194796096999994, 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.027 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:47.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.189028097000005, 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:47.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.038 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.188436121999999, 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:47.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:47.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.185003627, 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:47.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.052 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.182067685000007, 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:47.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:47.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:47.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.030923951000005, 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:47.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:47.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.770553097999993, 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:47.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:47.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.766532478000002, 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:47.071 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:47.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.757088210999996, 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:47.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:47.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:47.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.753167082000004, 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:47.084 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:47.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:47.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.090 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.712174337999997, 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:47.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:47.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:47.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.631285792, 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:47.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:47.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.541644950999995, 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:47.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 72.530178926000005, 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:47.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:47.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.115 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4865.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.28100551200000001, 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054676530000000003, 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4865", 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/4085573642", 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 50 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.116 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714146+0000", 2024-09-10T05:56:47.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0999999999999997e-07 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714150+0000", 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714161+0000", 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714166+0000", 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4639999999999997e-06 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714219+0000", 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2574000000000002e-05 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714269+0000", 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0351e-05 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714347+0000", 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8499999999999997e-05 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714798+0000", 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045035000000000002 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719534+0000", 2024-09-10T05:56:47.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047363489999999999 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719565+0000", 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1087999999999998e-05 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719613+0000", 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.774e-05 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.121 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.122 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:47.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:47.123 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_47 2024-09-10T05:56:47.124 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:47.121+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:47.223 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:47.221+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:47.225 INFO:tasks.workunit.client.0.smithi070.stdout:quota set for the bucket: buck_2024_08_10_05_56_47 2024-09-10T05:56:47.285 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:47.285 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:47.285 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:47.285 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:47.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:47.324 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:47.321+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:47.425 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:47.421+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:47.460 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:47.460 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:47.461 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:47.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:47.483 INFO:tasks.workunit.client.0.smithi070.stdout:quota enabled for the bucket: buck_2024_08_10_05_56_47 2024-09-10T05:56:47.484 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 10Mb. 2024-09-10T05:56:47.484 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:56:47.493 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records in 2024-09-10T05:56:47.493 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records out 2024-09-10T05:56:47.494 INFO:tasks.workunit.client.0.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00867219 s, 1.2 GB/s 2024-09-10T05:56:47.529 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:47.525+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:47.544 INFO:tasks.workunit.client.0.smithi070.stdout:readding file to bucket: 10MBfile1 2024-09-10T05:56:47.544 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:47.545 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-09-10T05:56:47.545 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:47.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.966416788000004, 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:47.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:47.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:47.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:47.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.91721398, 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:47.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:47.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.797151318000004, 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:47.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:47.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:47.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:47.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:47.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:47.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:47.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.793127459000004, 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:47.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.792559892, 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:47.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.775267306000003, 2024-09-10T05:56:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:47.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.758941457000006, 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:47.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:47.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:47.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.681806745000003, 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:47.638 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:47.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:47.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:47.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.675805353000001, 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.647158129000005, 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.638967909000002, 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.573330420999994, 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.566570607000003, 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.562741398, 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.449727835000004, 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1225 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.376078043999996, 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030514399999999999, 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1225 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217881+0000", 2024-09-10T05:56:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217884+0000", 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217894+0000", 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0376e-05 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217923+0000", 2024-09-10T05:56:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9334000000000001e-05 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.217938+0000", 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4686e-05 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218083+0000", 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144936 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.218441+0000", 2024-09-10T05:56:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035843399999999998 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.219001+0000", 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055980199999999998 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220033+0000", 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010316489999999999 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220659+0000", 2024-09-10T05:56:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00062568499999999996 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220818+0000", 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015925499999999999 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.220933+0000", 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114936 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 73.255385548000007, 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.564113694, 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1783 4.11 4:8a160c10:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.52616223200000001, 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035774140000000001, 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1783 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067798+0000", 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4700000000000001e-07 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067801+0000", 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067816+0000", 2024-09-10T05:56:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4591e-05 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067821+0000", 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9309999999999999e-06 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067873+0000", 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2206999999999997e-05 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067983+0000", 2024-09-10T05:56:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110308 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.068132+0000", 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014854500000000001 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.069183+0000", 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010506879999999999 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071286+0000", 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021033850000000002 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071336+0000", 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9783000000000001e-05 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071375+0000", 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8736999999999999e-05 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.16089478600000001, 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:56:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:56:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:47.714 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:47.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:47.716 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:47.713+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:47.786 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:56:47.786 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:47.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:56:47.808 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records in 2024-09-10T05:56:47.808 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records out 2024-09-10T05:56:47.808 INFO:tasks.workunit.client.0.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0192638 s, 544 MB/s 2024-09-10T05:56:47.816 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:47.813+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:47.853 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:47.853 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:47.853 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:47.853 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:47.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:47.950 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_47 2024-09-10T05:56:47.954 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:47.953+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:48.016 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:48.013+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:48.036 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:48.037 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:48.037 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:48.037 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:48.037 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:48.053 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:48.138 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:48.137+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:48.202 INFO:tasks.workunit.client.0.smithi070.stdout:bucket quota max_objs set for the given user: buck_2024_08_10_05_56_47 2024-09-10T05:56:48.218 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:48.213+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:48.220 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.660704006000003, 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:48.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:48.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 77.601102335999997, 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.570434008999996, 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.230 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:48.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:48.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:48.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:48.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.452486460000003, 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:48.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.414327486999994, 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:48.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.411387411999996, 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.247 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:48.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:48.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.408087096000003, 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:48.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:48.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:48.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.407863195000004, 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:48.257 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:48.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:48.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.404631992999995, 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.264 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:48.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:48.269 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.400028528999997, 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.270 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:48.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:48.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.399700375999998, 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:48.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:48.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:48.282 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.397094702999993, 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:48.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:542 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.393206485999997, 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043528350000000002, 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 542 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825477+0000", 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825478+0000", 2024-09-10T05:56:48.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-06 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825483+0000", 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5999999999999997e-06 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825492+0000", 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7979999999999995e-06 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825498+0000", 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.066e-06 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825542+0000", 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3473999999999997e-05 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825612+0000", 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9827999999999996e-05 2024-09-10T05:56:48.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.825887+0000", 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027574400000000002 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829399+0000", 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035113480000000001 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829709+0000", 2024-09-10T05:56:48.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030994399999999999 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829785+0000", 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6397999999999996e-05 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.829830+0000", 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499000000000002e-05 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.294 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:595 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.374648082999997, 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043611129999999998, 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.295 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 595 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844035+0000", 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844037+0000", 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5880000000000001e-06 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844044+0000", 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9999999999999999e-06 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844073+0000", 2024-09-10T05:56:48.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9487000000000001e-05 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844085+0000", 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844199+0000", 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113949 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844345+0000", 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014550199999999999 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.844724+0000", 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037932299999999999 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.846072+0000", 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001348199 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848244+0000", 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002171264 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848328+0000", 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4724999999999999e-05 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.848396+0000", 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7896000000000002e-05 2024-09-10T05:56:48.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.274105246999994, 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:48.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:48.306 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.268451252000006, 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.307 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:48.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:48.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:48.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1782 4.22 4:4648cc62:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.151887018, 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046802019999999996, 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1782 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066798+0000", 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5400000000000001e-06 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066806+0000", 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-06 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066827+0000", 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0313e-05 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066837+0000", 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0686000000000001e-05 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066959+0000", 2024-09-10T05:56:48.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012163900000000001 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067192+0000", 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023248400000000001 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067679+0000", 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048718500000000001 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.070092+0000", 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002413709 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071332+0000", 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001239991 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071408+0000", 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5768999999999999e-05 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071476+0000", 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8085999999999998e-05 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1786 4.13 4:caec078d:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.1517413460000001, 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046975749999999998, 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.319 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1786 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066943+0000", 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.403e-06 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066950+0000", 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1729999999999998e-06 2024-09-10T05:56:48.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066969+0000", 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8287e-05 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066976+0000", 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7929999999999998e-06 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067162+0000", 2024-09-10T05:56:48.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000185448 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067526+0000", 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036409300000000001 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067944+0000", 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041810300000000002 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.070177+0000", 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022330470000000002 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071439+0000", 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001261727 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071558+0000", 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119602 2024-09-10T05:56:48.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071639+0000", 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0898999999999999e-05 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:48.325 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75715736, 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:56:48.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1917 4.22 4:45f13fff:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.27887062000000001, 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045099989999999998, 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:48.330 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1917 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939815+0000", 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5660000000000001e-06 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939824+0000", 2024-09-10T05:56:48.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1800000000000002e-06 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939844+0000", 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0092e-05 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939855+0000", 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0677e-05 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:48.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939940+0000", 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5173000000000006e-05 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.940128+0000", 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018807700000000001 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.940928+0000", 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079993900000000005 2024-09-10T05:56:48.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944069+0000", 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003140767 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944247+0000", 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177579 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:48.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944287+0000", 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0244000000000003e-05 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944323+0000", 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5704999999999998e-05 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:48.336 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:48.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:48.338 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:48.333+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:48.438 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:48.437+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:48.443 INFO:tasks.workunit.client.0.smithi070.stdout:quota enabled for the bucket: buck_2024_08_10_05_56_47 2024-09-10T05:56:48.443 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 10Mb. 2024-09-10T05:56:48.443 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:56:48.469 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records in 2024-09-10T05:56:48.469 INFO:tasks.workunit.client.0.smithi070.stderr:1+0 records out 2024-09-10T05:56:48.469 INFO:tasks.workunit.client.0.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0214715 s, 488 MB/s 2024-09-10T05:56:48.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:48.509 INFO:tasks.workunit.client.0.smithi070.stdout:readding file to bucket: 10MBfile1 2024-09-10T05:56:48.509 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:48.509 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-09-10T05:56:48.509 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:48.512 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:48.512 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:48.512 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:48.512 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:48.526 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:48.571 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:48.569+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:48.639 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:48.637+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:48.649 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:48.649 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:48.668 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:48.669 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:48.687 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:48.698 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:48.698 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:48.699 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:48.699 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:48.699 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:48.703 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:48.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:48.723 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:48.723 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:48.727 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:56:48.727 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:48.740 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:48.737+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:48.742 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:48.742 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:48.764 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:48.764 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:48.775 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:56:48.785 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:48.785 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:48.841 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:48.837+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:48.880 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_48 2024-09-10T05:56:48.898 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:48.899 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:48.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:48.955 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:48.953+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:49.042 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.042 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_10_05_56_48 with max size as zero 2024-09-10T05:56:49.042 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.042 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:49.043 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:49.041+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:49.081 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:49.081 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:49.096 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:49.143 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:49.141+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:49.175 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_49 2024-09-10T05:56:49.244 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:49.241+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:49.264 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:49.264 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:49.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:49.337 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.337 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_10_05_56_49 with max objects as zero 2024-09-10T05:56:49.337 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.337 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:49.345 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:49.341+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:49.409 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:49.409 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:49.425 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:49.467 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:49.465+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:49.474 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_49 2024-09-10T05:56:49.546 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:49.541+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:49.599 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:49.600 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:49.616 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:49.624 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.624 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_10_05_56_49 max objects -1 2024-09-10T05:56:49.624 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.624 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:49.647 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:49.645+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:49.741 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:49.741 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:49.748 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:49.745+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:49.754 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_49 2024-09-10T05:56:49.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:49.849 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:49.845+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:49.912 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.912 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - quota set for the bucket: buck_2024_08_10_05_56_49 with max size -1 2024-09-10T05:56:49.912 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:49.912 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:56:49.935 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:49.935 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:49.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:49.950 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:49.945+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:50.051 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:50.049+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:50.063 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:50.063 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:50.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:50.174 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:50.173+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:50.239 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:50.239 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:50.253 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:50.249+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:50.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:50.354 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:50.349+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:50.414 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:50.414 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:50.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:50.478 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:50.477+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:50.556 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:50.553+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:50.591 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:50.591 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:50.608 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:50.656 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:50.653+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:50.720 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:50.720 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:50.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:50.757 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:50.753+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:50.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:56:50.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:50.850 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:50.850 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:50.858 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:50.857+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:50.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:50.959 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:50.957+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:51.003 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:51.004 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:51.025 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:51.026 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:51.028 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:51.029 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:51.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:51.047 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:51.047 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:51.060 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:51.057+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:51.067 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:51.067 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:51.088 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:51.088 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:51.110 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:51.110 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:51.131 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:51.131 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:51.152 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:51.158 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:51.158 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:51.161 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:51.157+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:51.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records in 2024-09-10T05:56:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records out 2024-09-10T05:56:51.239 INFO:tasks.workunit.client.0.smithi070.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.32583 s, 1.6 GB/s 2024-09-10T05:56:51.262 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:51.257+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 84.703553822000003, 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:51.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:51.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:51.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:51.342 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 80.698642254999996, 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:51.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:51.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.349 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.586149199999994, 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:51.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:51.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.581301912000001, 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:51.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:51.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:51.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.568573251000004, 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:51.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:51.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:51.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:51.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:51.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:51.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:51.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.373 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:51.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.534189431000001, 2024-09-10T05:56:51.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:51.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:51.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:51.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:51.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:51.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:51.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:51.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:51.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:51.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.383 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.528421430999998, 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.384 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:51.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.527829456000006, 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:51.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:51.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:51.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.524396960999994, 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:51.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:51.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:51.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:51.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:51.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:51.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:51.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:51.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:51.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.521461019, 2024-09-10T05:56:51.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:51.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:51.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:51.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:51.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:51.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:51.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:51.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:51.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:51.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:51.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:51.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.370317284999999, 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:51.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:51.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:51.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.424 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.109946432000001, 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.425 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:51.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:51.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.430 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.105925811999995, 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:51.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:51.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:51.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.437 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.096481545000003, 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:51.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.443 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.092560415999998, 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:51.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:51.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:51.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.051567672000004, 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:51.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:51.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:51.457 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.970679125999993, 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026533619999999998, 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1294 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363865+0000", 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363868+0000", 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8899999999999999e-06 2024-09-10T05:56:51.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363882+0000", 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3923e-05 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363914+0000", 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2453000000000003e-05 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.363936+0000", 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2220000000000001e-05 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364059+0000", 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122626 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364331+0000", 2024-09-10T05:56:51.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027152099999999999 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.364641+0000", 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031003999999999998 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.365760+0000", 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011194480000000001 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366368+0000", 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00060776899999999997 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366454+0000", 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6509999999999997e-05 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.366518+0000", 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3961999999999995e-05 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:51.464 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.881038285000002, 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:51.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:51.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:51.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:51.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:51.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:51.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 76.869572259999998, 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:51.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:51.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4865.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6203988459999996, 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054676530000000003, 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.479 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4865", 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/4085573642", 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 50 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:51.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714146+0000", 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0999999999999997e-07 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714150+0000", 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714161+0000", 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714166+0000", 2024-09-10T05:56:51.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4639999999999997e-06 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714219+0000", 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2574000000000002e-05 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714269+0000", 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0351e-05 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714347+0000", 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8499999999999997e-05 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714798+0000", 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045035000000000002 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719534+0000", 2024-09-10T05:56:51.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047363489999999999 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719565+0000", 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1087999999999998e-05 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719613+0000", 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.774e-05 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.486 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.486 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.486 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:51.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:51.488 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_56_51 2024-09-10T05:56:51.488 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:51.485+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:51.540 INFO:tasks.workunit.client.0.smithi070.stdout:quota set for the bucket: buck_2024_08_10_05_56_51 2024-09-10T05:56:51.588 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:51.585+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:51.646 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:51.646 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:51.646 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:51.646 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:51.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:51.703 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:51.701+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:51.788 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:56:51.791 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:51.785+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:51.812 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:51.813 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:51.813 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:51.813 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:51.813 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:51.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:51.890 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:51.885+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:51.976 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:51.976 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:51.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:51.976 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:51.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.976 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.976 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.346196305000007, 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:51.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:51.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:51.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:51.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:51.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.296993497000003, 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:51.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:51.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.991 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.176930834999993, 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:51.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:51.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:51.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.172906975999993, 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:51.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:51.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:52.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:52.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:52.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:52.004 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.172339409000003, 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:52.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:52.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:52.010 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.155046823000006, 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.011 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:52.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:52.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:52.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.138720973999995, 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:52.017 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:52.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:52.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:52.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.023 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.061586262000006, 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:52.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:52.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.055584870000004, 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.026937645999993, 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:52.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.037 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:52.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:52.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 78.018747426000004, 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:52.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:52.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.052 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.953109937999997, 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:52.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:52.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:52.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.946350124000006, 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:52.059 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:52.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:52.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.942520915000003, 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:52.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:52.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:52.071 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.829507351999993, 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.072 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:52.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:52.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 77.635165064999995, 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.079 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:52.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:52.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.943893210999999, 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:52.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:52.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1783 4.11 4:8a160c10:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9059417490000001, 2024-09-10T05:56:52.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035774140000000001, 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1783 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067798+0000", 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4700000000000001e-07 2024-09-10T05:56:52.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067801+0000", 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067816+0000", 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4591e-05 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067821+0000", 2024-09-10T05:56:52.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9309999999999999e-06 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067873+0000", 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2206999999999997e-05 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067983+0000", 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110308 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.068132+0000", 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014854500000000001 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.069183+0000", 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010506879999999999 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071286+0000", 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021033850000000002 2024-09-10T05:56:52.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071336+0000", 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9783000000000001e-05 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071375+0000", 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8736999999999999e-05 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5406743030000003, 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:56:52.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1948 3.19 e66/57 3:9ae3dc4d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_2:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5615647799999999, 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079042509999999993, 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:56:52.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412177+0000", 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.729e-06 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414422+0000", 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022448400000000001 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414451+0000", 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9152000000000001e-05 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414470+0000", 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9487000000000002e-05 2024-09-10T05:56:52.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414592+0000", 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121329 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414626+0000", 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4696000000000001e-05 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:52.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.419964+0000", 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053377160000000002 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420078+0000", 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114302 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.106 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:52.107 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T05:56:52.107 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T05:56:52.107 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-10T05:56:52.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-10T05:56:52.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:52.109 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:52.105+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:52.209 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:52.205+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:52.241 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:52.241 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:52.242 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:52.255 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:52.347 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:52.345+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:52.410 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:52.409+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:52.421 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:52.421 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:52.421 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:52.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:52.500 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 68, 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "fsid": "64591990-2498-4479-bfa8-9a8cb8fcb29f", 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "created": "2024-09-10T05:54:52.845539+0000", 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "modified": "2024-09-10T05:56:51.778695+0000", 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "last_up_change": "2024-09-10T05:55:04.950402+0000", 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "last_in_change": "2024-09-10T05:56:21.961418+0000", 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_num": 5799936, 2024-09-10T05:56:52.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_set": [ 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "pglog_hardlimit", 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "purged_snapdirs", 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_deletes", 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "sortbitwise" 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_version": 5, 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "full_ratio": 0.94999998807907104, 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-10T05:56:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_snapshot": "", 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_max": 8, 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd": 8, 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "require_min_compat_client": "luminous", 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min_compat_client": "luminous", 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "require_osd_release": "squid", 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_crimson": false, 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "pools": [ 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 1, 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".mgr", 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:05.674567+0000", 2024-09-10T05:56:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.504 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 1, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 1, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 1, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 1, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 1, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.505 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "19", 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.508 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.509 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_max": 32, 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_min": 1 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr": {} 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 8, 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 8, 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.25, 2024-09-10T05:56:52.510 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 2, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "rbd", 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:11.127613+0000", 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 8193, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.511 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 8, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 8, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 8, 2024-09-10T05:56:52.512 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 8, 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 8, 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "23", 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.513 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 2, 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 23, 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.514 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.516 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-10T05:56:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd": {} 2024-09-10T05:56:52.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.9900000095367432, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.9900000095367432, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 0.87999999523162842, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 3, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "default.rgw.buckets.data", 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:21.036897+0000", 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.519 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.520 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "26", 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-10T05:56:52.521 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.522 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.523 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw": {} 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2024-09-10T05:56:52.524 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 4, 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "default.rgw.buckets.index", 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:22.887571+0000", 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.525 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 64, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 64, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 64, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 64, 2024-09-10T05:56:52.526 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 64, 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "28", 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.527 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-10T05:56:52.530 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw": {} 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 2, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 2, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 2, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 2, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 5, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": ".rgw.root", 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:25.018914+0000", 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.532 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.533 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "30", 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.534 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.535 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.536 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw": {} 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.25, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.25, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.25, 2024-09-10T05:56:52.537 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.25, 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 6, 2024-09-10T05:56:52.538 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "default.rgw.log", 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:26.694534+0000", 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.539 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.540 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "32", 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.541 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.542 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.543 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw": {} 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-10T05:56:52.544 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 7, 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "default.rgw.control", 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:28.604339+0000", 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.545 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-10T05:56:52.546 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "34", 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.547 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "options": {}, 2024-09-10T05:56:52.550 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw": {} 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.75, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.75, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.75, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.75, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "pool": 8, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": "default.rgw.meta", 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "create_time": "2024-09-10T05:55:30.741862+0000", 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags_names": "hashpspool", 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": 1, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 2, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": 1, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_rule": 0, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_count": 0, 2024-09-10T05:56:52.552 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_target": 0, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "is_stretch_pool": false, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "object_hash": 2, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_mode": "off", 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": 32, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num": 32, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_placement_num_target": 32, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_target": 32, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num_pending": 32, 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "last_pg_merge_meta": { 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "source_pgid": "0.0", 2024-09-10T05:56:52.553 INFO:teuthology.orchestra.run.smithi070.stdout: "ready_epoch": 0, 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_started": 0, 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "last_epoch_clean": 0, 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "source_version": "0'0", 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "target_version": "0'0" 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "last_change": "36", 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend": "0", 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "auid": 0, 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_mode": "selfmanaged", 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_seq": 0, 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_epoch": 0, 2024-09-10T05:56:52.554 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_snaps": [], 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps": "[]", 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_bytes": 0, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "quota_max_objects": 0, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tiers": [], 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tier_of": -1, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "read_tier": -1, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "write_tier": -1, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_mode": "none", 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_bytes": 0, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "target_max_objects": 0, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T05:56:52.555 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_flush_age": 0, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "cache_min_evict_age": 0, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profile": "", 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_params": { 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "none" 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_period": 0, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_count": 0, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "use_gmt_hitset": true, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min_read_recency_for_promote": 0, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min_write_recency_for_promote": 0, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T05:56:52.556 INFO:teuthology.orchestra.run.smithi070.stdout: "hit_set_search_last_n": 0, 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "grade_table": [], 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "stripe_width": 0, 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "expected_num_objects": 0, 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "fast_read": false, 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "options": { 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscale_bias": 4 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "application_metadata": { 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "rgw": {} 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "read_balance": { 2024-09-10T05:56:52.557 INFO:teuthology.orchestra.run.smithi070.stdout: "score_type": "Fair distribution", 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "score_acting": 1.5, 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "score_stable": 1.5, 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "optimal_score": 1, 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_acting": 1.5, 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "raw_score_stable": 1.5, 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity_weighted": 1, 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity": 1, 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "average_primary_affinity_weighted": 1 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: "osds": [ 2024-09-10T05:56:52.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "7de4b4d6-bddb-415b-ac33-62eda22b0fc5", 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.559 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6802", 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6803", 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6806", 2024-09-10T05:56:52.562 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6807", 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.563 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6804", 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6805", 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3378450542 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6801/3378450542", 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6803/3378450542", 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6807/3378450542", 2024-09-10T05:56:52.564 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6805/3378450542", 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "e1d81852-e81f-4738-bc5c-acf3a2a5b5de", 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.565 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6808", 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6809", 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6810", 2024-09-10T05:56:52.567 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6811", 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.568 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6814", 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6815", 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.569 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6812", 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6813", 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 841653474 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6809/841653474", 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6811/841653474", 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6815/841653474", 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6813/841653474", 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "405e0867-aba2-42fe-bdf6-4be0de0860d7", 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.571 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.572 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6816", 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6817", 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6818", 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6819", 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6822", 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6823", 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6820", 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6821", 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2429334233 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6817/2429334233", 2024-09-10T05:56:52.576 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6819/2429334233", 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6823/2429334233", 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6821/2429334233", 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "d57b60c0-744b-4d58-bb15-b3cffc9083bd", 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.577 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6824", 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6825", 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.579 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6826", 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6827", 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6830", 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.581 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6831", 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6828", 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6829", 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 128774917 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.70:6825/128774917", 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.70:6827/128774917", 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.70:6831/128774917", 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.70:6829/128774917", 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "b6988baa-4417-4899-9adf-7832c70b4eb4", 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 14, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.584 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6800", 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6801", 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6802", 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6803", 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6806", 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.587 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6807", 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6804", 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6805", 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2565298170 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6801/2565298170", 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6803/2565298170", 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6807/2565298170", 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6805/2565298170", 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.589 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "f215d032-5868-49d0-8238-19a0c9476b4e", 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.590 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6824", 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6825", 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6826", 2024-09-10T05:56:52.592 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6827", 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6830", 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6831", 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6828", 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6829", 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1681543764 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6825/1681543764", 2024-09-10T05:56:52.595 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6827/1681543764", 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6831/1681543764", 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6829/1681543764", 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "878c5865-fed4-48f5-8b7c-c4ca199a2737", 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.596 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.597 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6816", 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6817", 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6818", 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6819", 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6822", 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6823", 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6820", 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6821", 2024-09-10T05:56:52.601 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2743355861 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6817/2743355861", 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6819/2743355861", 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6823/2743355861", 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6821/2743355861", 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "uuid": "b98908e9-8169-41e3-8239-ea1d729d36af", 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "up": 1, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "in": 1, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "weight": 1, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_affinity": 1, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_begin": 0, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "last_clean_end": 0, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "up_from": 15, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "up_thru": 57, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "down_at": 0, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "lost_at": 0, 2024-09-10T05:56:52.603 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addrs": { 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6808", 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6809", 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addrs": { 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6810", 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6811", 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addrs": { 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6814", 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6815", 2024-09-10T05:56:52.606 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addrs": { 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6812", 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.98:6813", 2024-09-10T05:56:52.607 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 134608104 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "public_addr": "172.21.15.98:6809/134608104", 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_addr": "172.21.15.98:6811/134608104", 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_back_addr": "172.21.15.98:6815/134608104", 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "heartbeat_front_addr": "172.21.15.98:6813/134608104", 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "state": [ 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "exists", 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: "up" 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_xinfo": [ 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 0, 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:01.657166+0000", 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 1, 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:01.779551+0000", 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 2, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:01.757932+0000", 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 3, 2024-09-10T05:56:52.611 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:02.247018+0000", 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 4, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.612 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:01.648338+0000", 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 5, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:02.605178+0000", 2024-09-10T05:56:52.613 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 6, 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:01.839697+0000", 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.614 INFO:teuthology.orchestra.run.smithi070.stdout: "osd": 7, 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "down_stamp": "0.000000", 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_probability": 0, 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "laggy_interval": 0, 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "features": 4540719139924082687, 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "old_weight": 0, 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "last_purged_snaps_scrub": "2024-09-10T05:55:01.929351+0000", 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "dead_epoch": 0 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap": [], 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_items": [ 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.615 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.1f", 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 0, 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.27", 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 4, 2024-09-10T05:56:52.616 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 1 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "3.2c", 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 4, 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 1 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "pgid": "4.2", 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "mappings": [ 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "from": 1, 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "to": 2 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_upmap_primaries": [], 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_temp": [], 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "primary_temp": [], 2024-09-10T05:56:52.618 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklist": {}, 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "range_blocklist": {}, 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "erasure_code_profiles": { 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default": { 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-failure-domain": "osd", 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "k": "2", 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "m": "1", 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "plugin": "jerasure", 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "technique": "reed_sol_van" 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "removed_snaps_queue": [], 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "new_removed_snaps": [], 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "new_purged_snaps": [], 2024-09-10T05:56:52.619 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_node_flags": {}, 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "device_class_flags": {}, 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode": { 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_enabled": false, 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_bucket_count": 0, 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "degraded_stretch_mode": 0, 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "recovering_stretch_mode": 0, 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: "stretch_mode_bucket": 0 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:52.620 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:52.623 INFO:tasks.thrashosds.thrasher:j is {'epoch': 68, 'fsid': '64591990-2498-4479-bfa8-9a8cb8fcb29f', 'created': '2024-09-10T05:54:52.845539+0000', 'modified': '2024-09-10T05:56:51.778695+0000', 'last_up_change': '2024-09-10T05:55:04.950402+0000', 'last_in_change': '2024-09-10T05:56:21.961418+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T05:55:05.674567+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-10T05:55:11.127613+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 23, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-09-10T05:55:21.036897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-09-10T05:55:22.887571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-09-10T05:55:25.018914+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-09-10T05:55:26.694534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-09-10T05:55:28.604339+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-09-10T05:55:30.741862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '7de4b4d6-bddb-415b-ac33-62eda22b0fc5', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6800', 'nonce': 3378450542}, {'type': 'v1', 'addr': '172.21.15.70:6801', 'nonce': 3378450542}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6802', 'nonce': 3378450542}, {'type': 'v1', 'addr': '172.21.15.70:6803', 'nonce': 3378450542}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6806', 'nonce': 3378450542}, {'type': 'v1', 'addr': '172.21.15.70:6807', 'nonce': 3378450542}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6804', 'nonce': 3378450542}, {'type': 'v1', 'addr': '172.21.15.70:6805', 'nonce': 3378450542}]}, 'public_addr': '172.21.15.70:6801/3378450542', 'cluster_addr': '172.21.15.70:6803/3378450542', 'heartbeat_back_addr': '172.21.15.70:6807/3378450542', 'heartbeat_front_addr': '172.21.15.70:6805/3378450542', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'e1d81852-e81f-4738-bc5c-acf3a2a5b5de', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6808', 'nonce': 841653474}, {'type': 'v1', 'addr': '172.21.15.70:6809', 'nonce': 841653474}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6810', 'nonce': 841653474}, {'type': 'v1', 'addr': '172.21.15.70:6811', 'nonce': 841653474}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6814', 'nonce': 841653474}, {'type': 'v1', 'addr': '172.21.15.70:6815', 'nonce': 841653474}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6812', 'nonce': 841653474}, {'type': 'v1', 'addr': '172.21.15.70:6813', 'nonce': 841653474}]}, 'public_addr': '172.21.15.70:6809/841653474', 'cluster_addr': '172.21.15.70:6811/841653474', 'heartbeat_back_addr': '172.21.15.70:6815/841653474', 'heartbeat_front_addr': '172.21.15.70:6813/841653474', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '405e0867-aba2-42fe-bdf6-4be0de0860d7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6816', 'nonce': 2429334233}, {'type': 'v1', 'addr': '172.21.15.70:6817', 'nonce': 2429334233}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6818', 'nonce': 2429334233}, {'type': 'v1', 'addr': '172.21.15.70:6819', 'nonce': 2429334233}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6822', 'nonce': 2429334233}, {'type': 'v1', 'addr': '172.21.15.70:6823', 'nonce': 2429334233}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6820', 'nonce': 2429334233}, {'type': 'v1', 'addr': '172.21.15.70:6821', 'nonce': 2429334233}]}, 'public_addr': '172.21.15.70:6817/2429334233', 'cluster_addr': '172.21.15.70:6819/2429334233', 'heartbeat_back_addr': '172.21.15.70:6823/2429334233', 'heartbeat_front_addr': '172.21.15.70:6821/2429334233', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'd57b60c0-744b-4d58-bb15-b3cffc9083bd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6824', 'nonce': 128774917}, {'type': 'v1', 'addr': '172.21.15.70:6825', 'nonce': 128774917}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6826', 'nonce': 128774917}, {'type': 'v1', 'addr': '172.21.15.70:6827', 'nonce': 128774917}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6830', 'nonce': 128774917}, {'type': 'v1', 'addr': '172.21.15.70:6831', 'nonce': 128774917}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6828', 'nonce': 128774917}, {'type': 'v1', 'addr': '172.21.15.70:6829', 'nonce': 128774917}]}, 'public_addr': '172.21.15.70:6825/128774917', 'cluster_addr': '172.21.15.70:6827/128774917', 'heartbeat_back_addr': '172.21.15.70:6831/128774917', 'heartbeat_front_addr': '172.21.15.70:6829/128774917', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'b6988baa-4417-4899-9adf-7832c70b4eb4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 2565298170}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 2565298170}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 2565298170}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 2565298170}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 2565298170}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 2565298170}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 2565298170}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 2565298170}]}, 'public_addr': '172.21.15.98:6801/2565298170', 'cluster_addr': '172.21.15.98:6803/2565298170', 'heartbeat_back_addr': '172.21.15.98:6807/2565298170', 'heartbeat_front_addr': '172.21.15.98:6805/2565298170', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f215d032-5868-49d0-8238-19a0c9476b4e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6824', 'nonce': 1681543764}, {'type': 'v1', 'addr': '172.21.15.98:6825', 'nonce': 1681543764}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6826', 'nonce': 1681543764}, {'type': 'v1', 'addr': '172.21.15.98:6827', 'nonce': 1681543764}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6830', 'nonce': 1681543764}, {'type': 'v1', 'addr': '172.21.15.98:6831', 'nonce': 1681543764}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6828', 'nonce': 1681543764}, {'type': 'v1', 'addr': '172.21.15.98:6829', 'nonce': 1681543764}]}, 'public_addr': '172.21.15.98:6825/1681543764', 'cluster_addr': '172.21.15.98:6827/1681543764', 'heartbeat_back_addr': '172.21.15.98:6831/1681543764', 'heartbeat_front_addr': '172.21.15.98:6829/1681543764', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '878c5865-fed4-48f5-8b7c-c4ca199a2737', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6816', 'nonce': 2743355861}, {'type': 'v1', 'addr': '172.21.15.98:6817', 'nonce': 2743355861}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6818', 'nonce': 2743355861}, {'type': 'v1', 'addr': '172.21.15.98:6819', 'nonce': 2743355861}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6822', 'nonce': 2743355861}, {'type': 'v1', 'addr': '172.21.15.98:6823', 'nonce': 2743355861}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6820', 'nonce': 2743355861}, {'type': 'v1', 'addr': '172.21.15.98:6821', 'nonce': 2743355861}]}, 'public_addr': '172.21.15.98:6817/2743355861', 'cluster_addr': '172.21.15.98:6819/2743355861', 'heartbeat_back_addr': '172.21.15.98:6823/2743355861', 'heartbeat_front_addr': '172.21.15.98:6821/2743355861', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'b98908e9-8169-41e3-8239-ea1d729d36af', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6808', 'nonce': 134608104}, {'type': 'v1', 'addr': '172.21.15.98:6809', 'nonce': 134608104}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6810', 'nonce': 134608104}, {'type': 'v1', 'addr': '172.21.15.98:6811', 'nonce': 134608104}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6814', 'nonce': 134608104}, {'type': 'v1', 'addr': '172.21.15.98:6815', 'nonce': 134608104}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6812', 'nonce': 134608104}, {'type': 'v1', 'addr': '172.21.15.98:6813', 'nonce': 134608104}]}, 'public_addr': '172.21.15.98:6809/134608104', 'cluster_addr': '172.21.15.98:6811/134608104', 'heartbeat_back_addr': '172.21.15.98:6815/134608104', 'heartbeat_front_addr': '172.21.15.98:6813/134608104', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:01.657166+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:01.779551+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:01.757932+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:02.247018+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:01.648338+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:02.605178+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:01.839697+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T05:55:01.929351+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.1f', 'mappings': [{'from': 0, 'to': 2}]}, {'pgid': '3.27', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '3.2c', 'mappings': [{'from': 4, 'to': 1}]}, {'pgid': '4.2', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-10T05:56:52.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:56:52.624 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:52.624 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 84.043604070000001, 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:52.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:52.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.629 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.984002399999994, 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:52.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.634 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.953334072999994, 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:52.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.835386524, 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:52.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.797227551000006, 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.794287475999994, 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:52.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:52.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.79098716, 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:52.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:52.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.665 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.790763259000002, 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:52.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.787532056999993, 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:52.672 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:52.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:52.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.782928592999994, 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:52.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.782600439999996, 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:52.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:52.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.691 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.779994767000005, 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:52.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:52.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.657005311000006, 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.698 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:52.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:52.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:52.703 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 78.651351316000003, 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.704 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:52.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:52.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1782 4.22 4:4648cc62:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5347870820000002, 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046802019999999996, 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.710 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1782 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066798+0000", 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5400000000000001e-06 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066806+0000", 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-06 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066827+0000", 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0313e-05 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066837+0000", 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0686000000000001e-05 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066959+0000", 2024-09-10T05:56:52.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012163900000000001 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067192+0000", 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023248400000000001 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067679+0000", 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048718500000000001 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.070092+0000", 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002413709 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071332+0000", 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001239991 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071408+0000", 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5768999999999999e-05 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071476+0000", 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8085999999999998e-05 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1786 4.13 4:caec078d:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5346414099999999, 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046975749999999998, 2024-09-10T05:56:52.716 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1786 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066943+0000", 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.403e-06 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066950+0000", 2024-09-10T05:56:52.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1729999999999998e-06 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066969+0000", 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8287e-05 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066976+0000", 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7929999999999998e-06 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067162+0000", 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000185448 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067526+0000", 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036409300000000001 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067944+0000", 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041810300000000002 2024-09-10T05:56:52.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.070177+0000", 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022330470000000002 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071439+0000", 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001261727 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071558+0000", 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119602 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071639+0000", 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0898999999999999e-05 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:52.722 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1400574240000001, 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:56:52.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1917 4.22 4:45f13fff:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6617706840000004, 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045099989999999998, 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1917 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939815+0000", 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5660000000000001e-06 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939824+0000", 2024-09-10T05:56:52.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1800000000000002e-06 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939844+0000", 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0092e-05 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939855+0000", 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0677e-05 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939940+0000", 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5173000000000006e-05 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.940128+0000", 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018807700000000001 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.940928+0000", 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079993900000000005 2024-09-10T05:56:52.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944069+0000", 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003140767 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944247+0000", 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177579 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944287+0000", 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0244000000000003e-05 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944323+0000", 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5704999999999998e-05 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1947 3.3 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:52.733 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2036951849999999, 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018605588999999999, 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1947 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397906+0000", 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-10T05:56:52.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402321+0000", 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044157889999999998 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402355+0000", 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3744000000000001e-05 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402371+0000", 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6135999999999999e-05 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402469+0000", 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7844999999999996e-05 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402634+0000", 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000164644 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402772+0000", 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137768 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.412200+0000", 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094282930000000008 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416386+0000", 2024-09-10T05:56:52.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041860109999999999 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416443+0000", 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6884e-05 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416494+0000", 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0831000000000002e-05 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1950 3.11 e66/24 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.427508+0000", 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1740756369999996, 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014287441999999999, 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427508+0000", 2024-09-10T05:56:52.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427508+0000", 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427510+0000", 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.858e-06 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:52.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430383+0000", 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028730159999999999 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430414+0000", 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0985999999999998e-05 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430428+0000", 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3329000000000001e-05 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430522+0000", 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4456000000000005e-05 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430544+0000", 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1355000000000001e-05 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.441724+0000", 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01118043 2024-09-10T05:56:52.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.441795+0000", 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1012000000000004e-05 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:52.744 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:52.745 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:52.745 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:52.617+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:52.746 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:52.745+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:52.848 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:52.845+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:52.877 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:52.891 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:52.979 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:52.977+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:53.049 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:53.045+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:53.060 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:53.061 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:53.061 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:53.061 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:53.061 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:53.074 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:56:53.080 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:56:53.082 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:53.089 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-10T05:56:51.784700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25780099,"num_objects":240,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":2613,"num_read_kb":2297,"num_write":1173,"num_write_kb":42708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":4076,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":322872,"kb_used_data":56744,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754651848,"statfs":{"total":773094113280,"available":772763492352,"internally_reserved":0,"allocated":58105856,"data_stored":54884654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25184397,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1573,"num_read_kb":1541,"num_write":449,"num_write_kb":41036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.113214"},"pg_stats":[{"pgid":"3.3f","version":"66'1","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815862+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:56:48.815862+0000","last_peered":"2024-09-10T05:56:48.815862+0000","last_clean":"2024-09-10T05:56:48.815862+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:56:48.815862+0000","last_undegraded":"2024-09-10T05:56:48.815862+0000","last_fullsized":"2024-09-10T05:56:48.815862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.789752+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:56:48.789752+0000","last_peered":"2024-09-10T05:56:48.789752+0000","last_clean":"2024-09-10T05:56:48.789752+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:56:48.789752+0000","last_undegraded":"2024-09-10T05:56:48.789752+0000","last_fullsized":"2024-09-10T05:56:48.789752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787849+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:56:48.787849+0000","last_peered":"2024-09-10T05:56:48.787849+0000","last_clean":"2024-09-10T05:56:48.787849+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:56:48.787849+0000","last_undegraded":"2024-09-10T05:56:48.787849+0000","last_fullsized":"2024-09-10T05:56:48.787849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"67'6","reported_seq":117,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.611259+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:56:49.611259+0000","last_peered":"2024-09-10T05:56:49.611259+0000","last_clean":"2024-09-10T05:56:49.611259+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:56:49.611259+0000","last_undegraded":"2024-09-10T05:56:49.611259+0000","last_fullsized":"2024-09-10T05:56:49.611259+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779275+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:56:48.779275+0000","last_peered":"2024-09-10T05:56:48.779275+0000","last_clean":"2024-09-10T05:56:48.779275+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:56:48.779275+0000","last_undegraded":"2024-09-10T05:56:48.779275+0000","last_fullsized":"2024-09-10T05:56:48.779275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"67'4","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.027510+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:56:49.027510+0000","last_peered":"2024-09-10T05:56:49.027510+0000","last_clean":"2024-09-10T05:56:49.027510+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:56:49.027510+0000","last_undegraded":"2024-09-10T05:56:49.027510+0000","last_fullsized":"2024-09-10T05:56:49.027510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790440+0000","last_change":"2024-09-10T05:56:23.067941+0000","last_active":"2024-09-10T05:56:48.790440+0000","last_peered":"2024-09-10T05:56:48.790440+0000","last_clean":"2024-09-10T05:56:48.790440+0000","last_became_active":"2024-09-10T05:56:23.066964+0000","last_became_peered":"2024-09-10T05:56:23.066964+0000","last_unstale":"2024-09-10T05:56:48.790440+0000","last_undegraded":"2024-09-10T05:56:48.790440+0000","last_fullsized":"2024-09-10T05:56:48.790440+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:07.840191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"67'8","reported_seq":135,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.612031+0000","last_change":"2024-09-10T05:56:23.046850+0000","last_active":"2024-09-10T05:56:49.612031+0000","last_peered":"2024-09-10T05:56:49.612031+0000","last_clean":"2024-09-10T05:56:49.612031+0000","last_became_active":"2024-09-10T05:56:23.046172+0000","last_became_peered":"2024-09-10T05:56:23.046172+0000","last_unstale":"2024-09-10T05:56:49.612031+0000","last_undegraded":"2024-09-10T05:56:49.612031+0000","last_fullsized":"2024-09-10T05:56:49.612031+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:02.543439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815162+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:56:48.815162+0000","last_peered":"2024-09-10T05:56:48.815162+0000","last_clean":"2024-09-10T05:56:48.815162+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:56:48.815162+0000","last_undegraded":"2024-09-10T05:56:48.815162+0000","last_fullsized":"2024-09-10T05:56:48.815162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821855+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:56:48.821855+0000","last_peered":"2024-09-10T05:56:48.821855+0000","last_clean":"2024-09-10T05:56:48.821855+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:56:48.821855+0000","last_undegraded":"2024-09-10T05:56:48.821855+0000","last_fullsized":"2024-09-10T05:56:48.821855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"66'3","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.789990+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:56:48.789990+0000","last_peered":"2024-09-10T05:56:48.789990+0000","last_clean":"2024-09-10T05:56:48.789990+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:56:48.789990+0000","last_undegraded":"2024-09-10T05:56:48.789990+0000","last_fullsized":"2024-09-10T05:56:48.789990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'6","reported_seq":116,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.028132+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:56:49.028132+0000","last_peered":"2024-09-10T05:56:49.028132+0000","last_clean":"2024-09-10T05:56:49.028132+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:56:49.028132+0000","last_undegraded":"2024-09-10T05:56:49.028132+0000","last_fullsized":"2024-09-10T05:56:49.028132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814930+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:56:48.814930+0000","last_peered":"2024-09-10T05:56:48.814930+0000","last_clean":"2024-09-10T05:56:48.814930+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:56:48.814930+0000","last_undegraded":"2024-09-10T05:56:48.814930+0000","last_fullsized":"2024-09-10T05:56:48.814930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.324564+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:56:49.324564+0000","last_peered":"2024-09-10T05:56:49.324564+0000","last_clean":"2024-09-10T05:56:49.324564+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:56:49.324564+0000","last_undegraded":"2024-09-10T05:56:49.324564+0000","last_fullsized":"2024-09-10T05:56:49.324564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812451+0000","last_change":"2024-09-10T05:56:23.044790+0000","last_active":"2024-09-10T05:56:48.812451+0000","last_peered":"2024-09-10T05:56:48.812451+0000","last_clean":"2024-09-10T05:56:48.812451+0000","last_became_active":"2024-09-10T05:56:23.044451+0000","last_became_peered":"2024-09-10T05:56:23.044451+0000","last_unstale":"2024-09-10T05:56:48.812451+0000","last_undegraded":"2024-09-10T05:56:48.812451+0000","last_fullsized":"2024-09-10T05:56:48.812451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:48.985907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":111,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818905+0000","last_change":"2024-09-10T05:56:23.059475+0000","last_active":"2024-09-10T05:56:48.818905+0000","last_peered":"2024-09-10T05:56:48.818905+0000","last_clean":"2024-09-10T05:56:48.818905+0000","last_became_active":"2024-09-10T05:56:23.059115+0000","last_became_peered":"2024-09-10T05:56:23.059115+0000","last_unstale":"2024-09-10T05:56:48.818905+0000","last_undegraded":"2024-09-10T05:56:48.818905+0000","last_fullsized":"2024-09-10T05:56:48.818905+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:38.752296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.781814+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:56:48.781814+0000","last_peered":"2024-09-10T05:56:48.781814+0000","last_clean":"2024-09-10T05:56:48.781814+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:56:48.781814+0000","last_undegraded":"2024-09-10T05:56:48.781814+0000","last_fullsized":"2024-09-10T05:56:48.781814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815867+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:56:48.815867+0000","last_peered":"2024-09-10T05:56:48.815867+0000","last_clean":"2024-09-10T05:56:48.815867+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:56:48.815867+0000","last_undegraded":"2024-09-10T05:56:48.815867+0000","last_fullsized":"2024-09-10T05:56:48.815867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":109,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814870+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:56:48.814870+0000","last_peered":"2024-09-10T05:56:48.814870+0000","last_clean":"2024-09-10T05:56:48.814870+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:56:48.814870+0000","last_undegraded":"2024-09-10T05:56:48.814870+0000","last_fullsized":"2024-09-10T05:56:48.814870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822553+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:56:48.822553+0000","last_peered":"2024-09-10T05:56:48.822553+0000","last_clean":"2024-09-10T05:56:48.822553+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:56:48.822553+0000","last_undegraded":"2024-09-10T05:56:48.822553+0000","last_fullsized":"2024-09-10T05:56:48.822553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.327119+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:56:49.327119+0000","last_peered":"2024-09-10T05:56:49.327119+0000","last_clean":"2024-09-10T05:56:49.327119+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:56:49.327119+0000","last_undegraded":"2024-09-10T05:56:49.327119+0000","last_fullsized":"2024-09-10T05:56:49.327119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"66'2","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822276+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:56:48.822276+0000","last_peered":"2024-09-10T05:56:48.822276+0000","last_clean":"2024-09-10T05:56:48.822276+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:56:48.822276+0000","last_undegraded":"2024-09-10T05:56:48.822276+0000","last_fullsized":"2024-09-10T05:56:48.822276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"66'2","reported_seq":111,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818369+0000","last_change":"2024-09-10T05:56:23.060761+0000","last_active":"2024-09-10T05:56:48.818369+0000","last_peered":"2024-09-10T05:56:48.818369+0000","last_clean":"2024-09-10T05:56:48.818369+0000","last_became_active":"2024-09-10T05:56:23.060478+0000","last_became_peered":"2024-09-10T05:56:23.060478+0000","last_unstale":"2024-09-10T05:56:48.818369+0000","last_undegraded":"2024-09-10T05:56:48.818369+0000","last_fullsized":"2024-09-10T05:56:48.818369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:37.688502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782392+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:56:48.782392+0000","last_peered":"2024-09-10T05:56:48.782392+0000","last_clean":"2024-09-10T05:56:48.782392+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:56:48.782392+0000","last_undegraded":"2024-09-10T05:56:48.782392+0000","last_fullsized":"2024-09-10T05:56:48.782392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818580+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:56:48.818580+0000","last_peered":"2024-09-10T05:56:48.818580+0000","last_clean":"2024-09-10T05:56:48.818580+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:56:48.818580+0000","last_undegraded":"2024-09-10T05:56:48.818580+0000","last_fullsized":"2024-09-10T05:56:48.818580+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812773+0000","last_change":"2024-09-10T05:56:23.031635+0000","last_active":"2024-09-10T05:56:48.812773+0000","last_peered":"2024-09-10T05:56:48.812773+0000","last_clean":"2024-09-10T05:56:48.812773+0000","last_became_active":"2024-09-10T05:56:23.026992+0000","last_became_peered":"2024-09-10T05:56:23.026992+0000","last_unstale":"2024-09-10T05:56:48.812773+0000","last_undegraded":"2024-09-10T05:56:48.812773+0000","last_fullsized":"2024-09-10T05:56:48.812773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:50.760900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.897320+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:56:49.897320+0000","last_peered":"2024-09-10T05:56:49.897320+0000","last_clean":"2024-09-10T05:56:49.897320+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:56:49.897320+0000","last_undegraded":"2024-09-10T05:56:49.897320+0000","last_fullsized":"2024-09-10T05:56:49.897320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777825+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:56:48.777825+0000","last_peered":"2024-09-10T05:56:48.777825+0000","last_clean":"2024-09-10T05:56:48.777825+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:56:48.777825+0000","last_undegraded":"2024-09-10T05:56:48.777825+0000","last_fullsized":"2024-09-10T05:56:48.777825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.781555+0000","last_change":"2024-09-10T05:56:23.056685+0000","last_active":"2024-09-10T05:56:48.781555+0000","last_peered":"2024-09-10T05:56:48.781555+0000","last_clean":"2024-09-10T05:56:48.781555+0000","last_became_active":"2024-09-10T05:56:23.055767+0000","last_became_peered":"2024-09-10T05:56:23.055767+0000","last_unstale":"2024-09-10T05:56:48.781555+0000","last_undegraded":"2024-09-10T05:56:48.781555+0000","last_fullsized":"2024-09-10T05:56:48.781555+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:32.495236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"66'2","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813101+0000","last_change":"2024-09-10T05:56:23.049625+0000","last_active":"2024-09-10T05:56:48.813101+0000","last_peered":"2024-09-10T05:56:48.813101+0000","last_clean":"2024-09-10T05:56:48.813101+0000","last_became_active":"2024-09-10T05:56:23.049267+0000","last_became_peered":"2024-09-10T05:56:23.049267+0000","last_unstale":"2024-09-10T05:56:48.813101+0000","last_undegraded":"2024-09-10T05:56:48.813101+0000","last_fullsized":"2024-09-10T05:56:48.813101+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:52.397184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815276+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:56:48.815276+0000","last_peered":"2024-09-10T05:56:48.815276+0000","last_clean":"2024-09-10T05:56:48.815276+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:56:48.815276+0000","last_undegraded":"2024-09-10T05:56:48.815276+0000","last_fullsized":"2024-09-10T05:56:48.815276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790580+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:56:48.790580+0000","last_peered":"2024-09-10T05:56:48.790580+0000","last_clean":"2024-09-10T05:56:48.790580+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:56:48.790580+0000","last_undegraded":"2024-09-10T05:56:48.790580+0000","last_fullsized":"2024-09-10T05:56:48.790580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"66'25","reported_seq":126,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779411+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:56:48.779411+0000","last_peered":"2024-09-10T05:56:48.779411+0000","last_clean":"2024-09-10T05:56:48.779411+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:56:48.779411+0000","last_undegraded":"2024-09-10T05:56:48.779411+0000","last_fullsized":"2024-09-10T05:56:48.779411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815664+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:56:48.815664+0000","last_peered":"2024-09-10T05:56:48.815664+0000","last_clean":"2024-09-10T05:56:48.815664+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:56:48.815664+0000","last_undegraded":"2024-09-10T05:56:48.815664+0000","last_fullsized":"2024-09-10T05:56:48.815664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"67'32","reported_seq":117,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.895162+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:56:49.895162+0000","last_peered":"2024-09-10T05:56:49.895162+0000","last_clean":"2024-09-10T05:56:49.895162+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:56:49.895162+0000","last_undegraded":"2024-09-10T05:56:49.895162+0000","last_fullsized":"2024-09-10T05:56:49.895162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":74,"num_read_kb":74,"num_write":64,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.028647+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:56:49.028647+0000","last_peered":"2024-09-10T05:56:49.028647+0000","last_clean":"2024-09-10T05:56:49.028647+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:56:49.028647+0000","last_undegraded":"2024-09-10T05:56:49.028647+0000","last_fullsized":"2024-09-10T05:56:49.028647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"65'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777902+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:56:48.777902+0000","last_peered":"2024-09-10T05:56:48.777902+0000","last_clean":"2024-09-10T05:56:48.777902+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:56:48.777902+0000","last_undegraded":"2024-09-10T05:56:48.777902+0000","last_fullsized":"2024-09-10T05:56:48.777902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813218+0000","last_change":"2024-09-10T05:56:23.017197+0000","last_active":"2024-09-10T05:56:48.813218+0000","last_peered":"2024-09-10T05:56:48.813218+0000","last_clean":"2024-09-10T05:56:48.813218+0000","last_became_active":"2024-09-10T05:56:23.016946+0000","last_became_peered":"2024-09-10T05:56:23.016946+0000","last_unstale":"2024-09-10T05:56:48.813218+0000","last_undegraded":"2024-09-10T05:56:48.813218+0000","last_fullsized":"2024-09-10T05:56:48.813218+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:17.357508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":103,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.783361+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:56:48.783361+0000","last_peered":"2024-09-10T05:56:48.783361+0000","last_clean":"2024-09-10T05:56:48.783361+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:56:48.783361+0000","last_undegraded":"2024-09-10T05:56:48.783361+0000","last_fullsized":"2024-09-10T05:56:48.783361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782598+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:56:48.782598+0000","last_peered":"2024-09-10T05:56:48.782598+0000","last_clean":"2024-09-10T05:56:48.782598+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:56:48.782598+0000","last_undegraded":"2024-09-10T05:56:48.782598+0000","last_fullsized":"2024-09-10T05:56:48.782598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.571906+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:56:49.571906+0000","last_peered":"2024-09-10T05:56:49.571906+0000","last_clean":"2024-09-10T05:56:49.571906+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:56:49.571906+0000","last_undegraded":"2024-09-10T05:56:49.571906+0000","last_fullsized":"2024-09-10T05:56:49.571906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779686+0000","last_change":"2024-09-10T05:56:23.042081+0000","last_active":"2024-09-10T05:56:48.779686+0000","last_peered":"2024-09-10T05:56:48.779686+0000","last_clean":"2024-09-10T05:56:48.779686+0000","last_became_active":"2024-09-10T05:56:23.041763+0000","last_became_peered":"2024-09-10T05:56:23.041763+0000","last_unstale":"2024-09-10T05:56:48.779686+0000","last_undegraded":"2024-09-10T05:56:48.779686+0000","last_fullsized":"2024-09-10T05:56:48.779686+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:01.116823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"66'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815005+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:56:48.815005+0000","last_peered":"2024-09-10T05:56:48.815005+0000","last_clean":"2024-09-10T05:56:48.815005+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:56:48.815005+0000","last_undegraded":"2024-09-10T05:56:48.815005+0000","last_fullsized":"2024-09-10T05:56:48.815005+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813629+0000","last_change":"2024-09-10T05:56:23.055375+0000","last_active":"2024-09-10T05:56:48.813629+0000","last_peered":"2024-09-10T05:56:48.813629+0000","last_clean":"2024-09-10T05:56:48.813629+0000","last_became_active":"2024-09-10T05:56:23.052761+0000","last_became_peered":"2024-09-10T05:56:23.052761+0000","last_unstale":"2024-09-10T05:56:48.813629+0000","last_undegraded":"2024-09-10T05:56:48.813629+0000","last_fullsized":"2024-09-10T05:56:48.813629+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:57.904540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":122,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818528+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:56:48.818528+0000","last_peered":"2024-09-10T05:56:48.818528+0000","last_clean":"2024-09-10T05:56:48.818528+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:56:48.818528+0000","last_undegraded":"2024-09-10T05:56:48.818528+0000","last_fullsized":"2024-09-10T05:56:48.818528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"67'80","reported_seq":175,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.840516+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:56:49.840516+0000","last_peered":"2024-09-10T05:56:49.840516+0000","last_clean":"2024-09-10T05:56:49.840516+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:56:49.840516+0000","last_undegraded":"2024-09-10T05:56:49.840516+0000","last_fullsized":"2024-09-10T05:56:49.840516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782099+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:56:48.782099+0000","last_peered":"2024-09-10T05:56:48.782099+0000","last_clean":"2024-09-10T05:56:48.782099+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:56:48.782099+0000","last_undegraded":"2024-09-10T05:56:48.782099+0000","last_fullsized":"2024-09-10T05:56:48.782099+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813633+0000","last_change":"2024-09-10T05:56:23.011597+0000","last_active":"2024-09-10T05:56:48.813633+0000","last_peered":"2024-09-10T05:56:48.813633+0000","last_clean":"2024-09-10T05:56:48.813633+0000","last_became_active":"2024-09-10T05:56:23.008641+0000","last_became_peered":"2024-09-10T05:56:23.008641+0000","last_unstale":"2024-09-10T05:56:48.813633+0000","last_undegraded":"2024-09-10T05:56:48.813633+0000","last_fullsized":"2024-09-10T05:56:48.813633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:28.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821576+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:56:48.821576+0000","last_peered":"2024-09-10T05:56:48.821576+0000","last_clean":"2024-09-10T05:56:48.821576+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:56:48.821576+0000","last_undegraded":"2024-09-10T05:56:48.821576+0000","last_fullsized":"2024-09-10T05:56:48.821576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790746+0000","last_change":"2024-09-10T05:56:23.060792+0000","last_active":"2024-09-10T05:56:48.790746+0000","last_peered":"2024-09-10T05:56:48.790746+0000","last_clean":"2024-09-10T05:56:48.790746+0000","last_became_active":"2024-09-10T05:56:23.059745+0000","last_became_peered":"2024-09-10T05:56:23.059745+0000","last_unstale":"2024-09-10T05:56:48.790746+0000","last_undegraded":"2024-09-10T05:56:48.790746+0000","last_fullsized":"2024-09-10T05:56:48.790746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:11.407144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"66'19","reported_seq":115,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815516+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:56:48.815516+0000","last_peered":"2024-09-10T05:56:48.815516+0000","last_clean":"2024-09-10T05:56:48.815516+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:56:48.815516+0000","last_undegraded":"2024-09-10T05:56:48.815516+0000","last_fullsized":"2024-09-10T05:56:48.815516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"67'82","reported_seq":116,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.846188+0000","last_change":"2024-09-10T05:56:23.146978+0000","last_active":"2024-09-10T05:56:49.846188+0000","last_peered":"2024-09-10T05:56:49.846188+0000","last_clean":"2024-09-10T05:56:49.846188+0000","last_became_active":"2024-09-10T05:56:23.037617+0000","last_became_peered":"2024-09-10T05:56:23.037617+0000","last_unstale":"2024-09-10T05:56:49.846188+0000","last_undegraded":"2024-09-10T05:56:49.846188+0000","last_fullsized":"2024-09-10T05:56:49.846188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:49.068438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.030511+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:56:49.030511+0000","last_peered":"2024-09-10T05:56:49.030511+0000","last_clean":"2024-09-10T05:56:49.030511+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:56:49.030511+0000","last_undegraded":"2024-09-10T05:56:49.030511+0000","last_fullsized":"2024-09-10T05:56:49.030511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"66'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.816000+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:56:48.816000+0000","last_peered":"2024-09-10T05:56:48.816000+0000","last_clean":"2024-09-10T05:56:48.816000+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:56:48.816000+0000","last_undegraded":"2024-09-10T05:56:48.816000+0000","last_fullsized":"2024-09-10T05:56:48.816000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":87,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814577+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:56:48.814577+0000","last_peered":"2024-09-10T05:56:48.814577+0000","last_clean":"2024-09-10T05:56:48.814577+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:56:48.814577+0000","last_undegraded":"2024-09-10T05:56:48.814577+0000","last_fullsized":"2024-09-10T05:56:48.814577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"67'31","reported_seq":131,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.789715+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:56:48.789715+0000","last_peered":"2024-09-10T05:56:48.789715+0000","last_clean":"2024-09-10T05:56:48.789715+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:56:48.789715+0000","last_undegraded":"2024-09-10T05:56:48.789715+0000","last_fullsized":"2024-09-10T05:56:48.789715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786219+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:56:48.786219+0000","last_peered":"2024-09-10T05:56:48.786219+0000","last_clean":"2024-09-10T05:56:48.786219+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:56:48.786219+0000","last_undegraded":"2024-09-10T05:56:48.786219+0000","last_fullsized":"2024-09-10T05:56:48.786219+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.283140+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:56:49.283140+0000","last_peered":"2024-09-10T05:56:49.283140+0000","last_clean":"2024-09-10T05:56:49.283140+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:56:49.283140+0000","last_undegraded":"2024-09-10T05:56:49.283140+0000","last_fullsized":"2024-09-10T05:56:49.283140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"67'4","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.324120+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:56:49.324120+0000","last_peered":"2024-09-10T05:56:49.324120+0000","last_clean":"2024-09-10T05:56:49.324120+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:56:49.324120+0000","last_undegraded":"2024-09-10T05:56:49.324120+0000","last_fullsized":"2024-09-10T05:56:49.324120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815769+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:56:48.815769+0000","last_peered":"2024-09-10T05:56:48.815769+0000","last_clean":"2024-09-10T05:56:48.815769+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:56:48.815769+0000","last_undegraded":"2024-09-10T05:56:48.815769+0000","last_fullsized":"2024-09-10T05:56:48.815769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818150+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:56:48.818150+0000","last_peered":"2024-09-10T05:56:48.818150+0000","last_clean":"2024-09-10T05:56:48.818150+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:56:48.818150+0000","last_undegraded":"2024-09-10T05:56:48.818150+0000","last_fullsized":"2024-09-10T05:56:48.818150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"66'19","reported_seq":45,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812912+0000","last_change":"2024-09-10T05:56:23.084361+0000","last_active":"2024-09-10T05:56:48.812912+0000","last_peered":"2024-09-10T05:56:48.812912+0000","last_clean":"2024-09-10T05:56:48.812912+0000","last_became_active":"2024-09-10T05:56:23.020849+0000","last_became_peered":"2024-09-10T05:56:23.020849+0000","last_unstale":"2024-09-10T05:56:48.812912+0000","last_undegraded":"2024-09-10T05:56:48.812912+0000","last_fullsized":"2024-09-10T05:56:48.812912+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:38.911377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812535+0000","last_change":"2024-09-10T05:56:23.035832+0000","last_active":"2024-09-10T05:56:48.812535+0000","last_peered":"2024-09-10T05:56:48.812535+0000","last_clean":"2024-09-10T05:56:48.812535+0000","last_became_active":"2024-09-10T05:56:23.035097+0000","last_became_peered":"2024-09-10T05:56:23.035097+0000","last_unstale":"2024-09-10T05:56:48.812535+0000","last_undegraded":"2024-09-10T05:56:48.812535+0000","last_fullsized":"2024-09-10T05:56:48.812535+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:59.003597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821713+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:56:48.821713+0000","last_peered":"2024-09-10T05:56:48.821713+0000","last_clean":"2024-09-10T05:56:48.821713+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:56:48.821713+0000","last_undegraded":"2024-09-10T05:56:48.821713+0000","last_fullsized":"2024-09-10T05:56:48.821713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"66'2","reported_seq":99,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822053+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:56:48.822053+0000","last_peered":"2024-09-10T05:56:48.822053+0000","last_clean":"2024-09-10T05:56:48.822053+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:56:48.822053+0000","last_undegraded":"2024-09-10T05:56:48.822053+0000","last_fullsized":"2024-09-10T05:56:48.822053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815843+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:56:48.815843+0000","last_peered":"2024-09-10T05:56:48.815843+0000","last_clean":"2024-09-10T05:56:48.815843+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:56:48.815843+0000","last_undegraded":"2024-09-10T05:56:48.815843+0000","last_fullsized":"2024-09-10T05:56:48.815843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818637+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:56:48.818637+0000","last_peered":"2024-09-10T05:56:48.818637+0000","last_clean":"2024-09-10T05:56:48.818637+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:56:48.818637+0000","last_undegraded":"2024-09-10T05:56:48.818637+0000","last_fullsized":"2024-09-10T05:56:48.818637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"66'31","reported_seq":136,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814772+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:56:48.814772+0000","last_peered":"2024-09-10T05:56:48.814772+0000","last_clean":"2024-09-10T05:56:48.814772+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:56:48.814772+0000","last_undegraded":"2024-09-10T05:56:48.814772+0000","last_fullsized":"2024-09-10T05:56:48.814772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"67'80","reported_seq":242,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.906101+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:56:49.906101+0000","last_peered":"2024-09-10T05:56:49.906101+0000","last_clean":"2024-09-10T05:56:49.906101+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:56:49.906101+0000","last_undegraded":"2024-09-10T05:56:49.906101+0000","last_fullsized":"2024-09-10T05:56:49.906101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779409+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:56:48.779409+0000","last_peered":"2024-09-10T05:56:48.779409+0000","last_clean":"2024-09-10T05:56:48.779409+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:56:48.779409+0000","last_undegraded":"2024-09-10T05:56:48.779409+0000","last_fullsized":"2024-09-10T05:56:48.779409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":116,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.898794+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:56:49.898794+0000","last_peered":"2024-09-10T05:56:49.898794+0000","last_clean":"2024-09-10T05:56:49.898794+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:56:49.898794+0000","last_undegraded":"2024-09-10T05:56:49.898794+0000","last_fullsized":"2024-09-10T05:56:49.898794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790630+0000","last_change":"2024-09-10T05:56:23.065547+0000","last_active":"2024-09-10T05:56:48.790630+0000","last_peered":"2024-09-10T05:56:48.790630+0000","last_clean":"2024-09-10T05:56:48.790630+0000","last_became_active":"2024-09-10T05:56:23.064717+0000","last_became_peered":"2024-09-10T05:56:23.064717+0000","last_unstale":"2024-09-10T05:56:48.790630+0000","last_undegraded":"2024-09-10T05:56:48.790630+0000","last_fullsized":"2024-09-10T05:56:48.790630+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:15:47.807683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818310+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:56:48.818310+0000","last_peered":"2024-09-10T05:56:48.818310+0000","last_clean":"2024-09-10T05:56:48.818310+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:56:48.818310+0000","last_undegraded":"2024-09-10T05:56:48.818310+0000","last_fullsized":"2024-09-10T05:56:48.818310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"66'32","reported_seq":137,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777709+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:56:48.777709+0000","last_peered":"2024-09-10T05:56:48.777709+0000","last_clean":"2024-09-10T05:56:48.777709+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:56:48.777709+0000","last_undegraded":"2024-09-10T05:56:48.777709+0000","last_fullsized":"2024-09-10T05:56:48.777709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818083+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:56:48.818083+0000","last_peered":"2024-09-10T05:56:48.818083+0000","last_clean":"2024-09-10T05:56:48.818083+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:56:48.818083+0000","last_undegraded":"2024-09-10T05:56:48.818083+0000","last_fullsized":"2024-09-10T05:56:48.818083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"66'3","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.440016+0000","last_change":"2024-09-10T05:56:23.037024+0000","last_active":"2024-09-10T05:56:49.440016+0000","last_peered":"2024-09-10T05:56:49.440016+0000","last_clean":"2024-09-10T05:56:49.440016+0000","last_became_active":"2024-09-10T05:56:23.036371+0000","last_became_peered":"2024-09-10T05:56:23.036371+0000","last_unstale":"2024-09-10T05:56:49.440016+0000","last_undegraded":"2024-09-10T05:56:49.440016+0000","last_fullsized":"2024-09-10T05:56:49.440016+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:18.668696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782559+0000","last_change":"2024-09-10T05:56:23.057903+0000","last_active":"2024-09-10T05:56:48.782559+0000","last_peered":"2024-09-10T05:56:48.782559+0000","last_clean":"2024-09-10T05:56:48.782559+0000","last_became_active":"2024-09-10T05:56:23.056044+0000","last_became_peered":"2024-09-10T05:56:23.056044+0000","last_unstale":"2024-09-10T05:56:48.782559+0000","last_undegraded":"2024-09-10T05:56:48.782559+0000","last_fullsized":"2024-09-10T05:56:48.782559+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:23.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813006+0000","last_change":"2024-09-10T05:56:23.039960+0000","last_active":"2024-09-10T05:56:48.813006+0000","last_peered":"2024-09-10T05:56:48.813006+0000","last_clean":"2024-09-10T05:56:48.813006+0000","last_became_active":"2024-09-10T05:56:23.027827+0000","last_became_peered":"2024-09-10T05:56:23.027827+0000","last_unstale":"2024-09-10T05:56:48.813006+0000","last_undegraded":"2024-09-10T05:56:48.813006+0000","last_fullsized":"2024-09-10T05:56:48.813006+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:52.667117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818396+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:56:48.818396+0000","last_peered":"2024-09-10T05:56:48.818396+0000","last_clean":"2024-09-10T05:56:48.818396+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:56:48.818396+0000","last_undegraded":"2024-09-10T05:56:48.818396+0000","last_fullsized":"2024-09-10T05:56:48.818396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"66'23","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782584+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:56:48.782584+0000","last_peered":"2024-09-10T05:56:48.782584+0000","last_clean":"2024-09-10T05:56:48.782584+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:56:48.782584+0000","last_undegraded":"2024-09-10T05:56:48.782584+0000","last_fullsized":"2024-09-10T05:56:48.782584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779589+0000","last_change":"2024-09-10T05:56:23.042970+0000","last_active":"2024-09-10T05:56:48.779589+0000","last_peered":"2024-09-10T05:56:48.779589+0000","last_clean":"2024-09-10T05:56:48.779589+0000","last_became_active":"2024-09-10T05:56:23.041811+0000","last_became_peered":"2024-09-10T05:56:23.041811+0000","last_unstale":"2024-09-10T05:56:48.779589+0000","last_undegraded":"2024-09-10T05:56:48.779589+0000","last_fullsized":"2024-09-10T05:56:48.779589+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:27.729049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":30,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812314+0000","last_change":"2024-09-10T05:56:23.045520+0000","last_active":"2024-09-10T05:56:48.812314+0000","last_peered":"2024-09-10T05:56:48.812314+0000","last_clean":"2024-09-10T05:56:48.812314+0000","last_became_active":"2024-09-10T05:56:23.044502+0000","last_became_peered":"2024-09-10T05:56:23.044502+0000","last_unstale":"2024-09-10T05:56:48.812314+0000","last_undegraded":"2024-09-10T05:56:48.812314+0000","last_fullsized":"2024-09-10T05:56:48.812314+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:45.272996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.612570+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:56:49.612570+0000","last_peered":"2024-09-10T05:56:49.612570+0000","last_clean":"2024-09-10T05:56:49.612570+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:56:49.612570+0000","last_undegraded":"2024-09-10T05:56:49.612570+0000","last_fullsized":"2024-09-10T05:56:49.612570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822265+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:56:48.822265+0000","last_peered":"2024-09-10T05:56:48.822265+0000","last_clean":"2024-09-10T05:56:48.822265+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:56:48.822265+0000","last_undegraded":"2024-09-10T05:56:48.822265+0000","last_fullsized":"2024-09-10T05:56:48.822265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786838+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:56:48.786838+0000","last_peered":"2024-09-10T05:56:48.786838+0000","last_clean":"2024-09-10T05:56:48.786838+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:56:48.786838+0000","last_undegraded":"2024-09-10T05:56:48.786838+0000","last_fullsized":"2024-09-10T05:56:48.786838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"66'19","reported_seq":155,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818826+0000","last_change":"2024-09-10T05:56:23.109965+0000","last_active":"2024-09-10T05:56:48.818826+0000","last_peered":"2024-09-10T05:56:48.818826+0000","last_clean":"2024-09-10T05:56:48.818826+0000","last_became_active":"2024-09-10T05:56:23.061551+0000","last_became_peered":"2024-09-10T05:56:23.061551+0000","last_unstale":"2024-09-10T05:56:48.818826+0000","last_undegraded":"2024-09-10T05:56:48.818826+0000","last_fullsized":"2024-09-10T05:56:48.818826+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:17.436490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"67'80","reported_seq":183,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.842824+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:56:49.842824+0000","last_peered":"2024-09-10T05:56:49.842824+0000","last_clean":"2024-09-10T05:56:49.842824+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:56:49.842824+0000","last_undegraded":"2024-09-10T05:56:49.842824+0000","last_fullsized":"2024-09-10T05:56:49.842824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786151+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:56:48.786151+0000","last_peered":"2024-09-10T05:56:48.786151+0000","last_clean":"2024-09-10T05:56:48.786151+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:56:48.786151+0000","last_undegraded":"2024-09-10T05:56:48.786151+0000","last_fullsized":"2024-09-10T05:56:48.786151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.783199+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:56:48.783199+0000","last_peered":"2024-09-10T05:56:48.783199+0000","last_clean":"2024-09-10T05:56:48.783199+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:56:48.783199+0000","last_undegraded":"2024-09-10T05:56:48.783199+0000","last_fullsized":"2024-09-10T05:56:48.783199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782104+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:56:48.782104+0000","last_peered":"2024-09-10T05:56:48.782104+0000","last_clean":"2024-09-10T05:56:48.782104+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:56:48.782104+0000","last_undegraded":"2024-09-10T05:56:48.782104+0000","last_fullsized":"2024-09-10T05:56:48.782104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":194,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.821376+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:56:49.821376+0000","last_peered":"2024-09-10T05:56:49.821376+0000","last_clean":"2024-09-10T05:56:49.821376+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:56:49.821376+0000","last_undegraded":"2024-09-10T05:56:49.821376+0000","last_fullsized":"2024-09-10T05:56:49.821376+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813115+0000","last_change":"2024-09-10T05:56:23.121112+0000","last_active":"2024-09-10T05:56:48.813115+0000","last_peered":"2024-09-10T05:56:48.813115+0000","last_clean":"2024-09-10T05:56:48.813115+0000","last_became_active":"2024-09-10T05:56:23.025741+0000","last_became_peered":"2024-09-10T05:56:23.025741+0000","last_unstale":"2024-09-10T05:56:48.813115+0000","last_undegraded":"2024-09-10T05:56:48.813115+0000","last_fullsized":"2024-09-10T05:56:48.813115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:43.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"67'80","reported_seq":206,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.901351+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:56:49.901351+0000","last_peered":"2024-09-10T05:56:49.901351+0000","last_clean":"2024-09-10T05:56:49.901351+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:56:49.901351+0000","last_undegraded":"2024-09-10T05:56:49.901351+0000","last_fullsized":"2024-09-10T05:56:49.901351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782253+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:56:48.782253+0000","last_peered":"2024-09-10T05:56:48.782253+0000","last_clean":"2024-09-10T05:56:48.782253+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:56:48.782253+0000","last_undegraded":"2024-09-10T05:56:48.782253+0000","last_fullsized":"2024-09-10T05:56:48.782253+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":118,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.615023+0000","last_change":"2024-09-10T05:56:23.037294+0000","last_active":"2024-09-10T05:56:49.615023+0000","last_peered":"2024-09-10T05:56:49.615023+0000","last_clean":"2024-09-10T05:56:49.615023+0000","last_became_active":"2024-09-10T05:56:23.036712+0000","last_became_peered":"2024-09-10T05:56:23.036712+0000","last_unstale":"2024-09-10T05:56:49.615023+0000","last_undegraded":"2024-09-10T05:56:49.615023+0000","last_fullsized":"2024-09-10T05:56:49.615023+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:09.211978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812188+0000","last_change":"2024-09-10T05:56:23.052086+0000","last_active":"2024-09-10T05:56:48.812188+0000","last_peered":"2024-09-10T05:56:48.812188+0000","last_clean":"2024-09-10T05:56:48.812188+0000","last_became_active":"2024-09-10T05:56:23.049459+0000","last_became_peered":"2024-09-10T05:56:23.049459+0000","last_unstale":"2024-09-10T05:56:48.812188+0000","last_undegraded":"2024-09-10T05:56:48.812188+0000","last_fullsized":"2024-09-10T05:56:48.812188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:34.805862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.783023+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:56:48.783023+0000","last_peered":"2024-09-10T05:56:48.783023+0000","last_clean":"2024-09-10T05:56:48.783023+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:56:48.783023+0000","last_undegraded":"2024-09-10T05:56:48.783023+0000","last_fullsized":"2024-09-10T05:56:48.783023+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"66'21","reported_seq":114,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790490+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:56:48.790490+0000","last_peered":"2024-09-10T05:56:48.790490+0000","last_clean":"2024-09-10T05:56:48.790490+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:56:48.790490+0000","last_undegraded":"2024-09-10T05:56:48.790490+0000","last_fullsized":"2024-09-10T05:56:48.790490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821719+0000","last_change":"2024-09-10T05:56:23.050573+0000","last_active":"2024-09-10T05:56:48.821719+0000","last_peered":"2024-09-10T05:56:48.821719+0000","last_clean":"2024-09-10T05:56:48.821719+0000","last_became_active":"2024-09-10T05:56:23.049743+0000","last_became_peered":"2024-09-10T05:56:23.049743+0000","last_unstale":"2024-09-10T05:56:48.821719+0000","last_undegraded":"2024-09-10T05:56:48.821719+0000","last_fullsized":"2024-09-10T05:56:48.821719+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786120+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:56:48.786120+0000","last_peered":"2024-09-10T05:56:48.786120+0000","last_clean":"2024-09-10T05:56:48.786120+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:56:48.786120+0000","last_undegraded":"2024-09-10T05:56:48.786120+0000","last_fullsized":"2024-09-10T05:56:48.786120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'6","reported_seq":114,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.898154+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:56:49.898154+0000","last_peered":"2024-09-10T05:56:49.898154+0000","last_clean":"2024-09-10T05:56:49.898154+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:56:49.898154+0000","last_undegraded":"2024-09-10T05:56:49.898154+0000","last_fullsized":"2024-09-10T05:56:49.898154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":200,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814839+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:56:48.814839+0000","last_peered":"2024-09-10T05:56:48.814839+0000","last_clean":"2024-09-10T05:56:48.814839+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:56:48.814839+0000","last_undegraded":"2024-09-10T05:56:48.814839+0000","last_fullsized":"2024-09-10T05:56:48.814839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790200+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:56:48.790200+0000","last_peered":"2024-09-10T05:56:48.790200+0000","last_clean":"2024-09-10T05:56:48.790200+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:56:48.790200+0000","last_undegraded":"2024-09-10T05:56:48.790200+0000","last_fullsized":"2024-09-10T05:56:48.790200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812554+0000","last_change":"2024-09-10T05:56:23.037052+0000","last_active":"2024-09-10T05:56:48.812554+0000","last_peered":"2024-09-10T05:56:48.812554+0000","last_clean":"2024-09-10T05:56:48.812554+0000","last_became_active":"2024-09-10T05:56:23.036767+0000","last_became_peered":"2024-09-10T05:56:23.036767+0000","last_unstale":"2024-09-10T05:56:48.812554+0000","last_undegraded":"2024-09-10T05:56:48.812554+0000","last_fullsized":"2024-09-10T05:56:48.812554+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:09.974956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":87,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815340+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:56:48.815340+0000","last_peered":"2024-09-10T05:56:48.815340+0000","last_clean":"2024-09-10T05:56:48.815340+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:56:48.815340+0000","last_undegraded":"2024-09-10T05:56:48.815340+0000","last_fullsized":"2024-09-10T05:56:48.815340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"66'31","reported_seq":173,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790748+0000","last_change":"2024-09-10T05:56:23.124071+0000","last_active":"2024-09-10T05:56:48.790748+0000","last_peered":"2024-09-10T05:56:48.790748+0000","last_clean":"2024-09-10T05:56:48.790748+0000","last_became_active":"2024-09-10T05:56:23.062515+0000","last_became_peered":"2024-09-10T05:56:23.062515+0000","last_unstale":"2024-09-10T05:56:48.790748+0000","last_undegraded":"2024-09-10T05:56:48.790748+0000","last_fullsized":"2024-09-10T05:56:48.790748+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779465+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:56:48.779465+0000","last_peered":"2024-09-10T05:56:48.779465+0000","last_clean":"2024-09-10T05:56:48.779465+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:56:48.779465+0000","last_undegraded":"2024-09-10T05:56:48.779465+0000","last_fullsized":"2024-09-10T05:56:48.779465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821465+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:56:48.821465+0000","last_peered":"2024-09-10T05:56:48.821465+0000","last_clean":"2024-09-10T05:56:48.821465+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:56:48.821465+0000","last_undegraded":"2024-09-10T05:56:48.821465+0000","last_fullsized":"2024-09-10T05:56:48.821465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.326618+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:56:49.326618+0000","last_peered":"2024-09-10T05:56:49.326618+0000","last_clean":"2024-09-10T05:56:49.326618+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:56:49.326618+0000","last_undegraded":"2024-09-10T05:56:49.326618+0000","last_fullsized":"2024-09-10T05:56:49.326618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814714+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:56:48.814714+0000","last_peered":"2024-09-10T05:56:48.814714+0000","last_clean":"2024-09-10T05:56:48.814714+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:56:48.814714+0000","last_undegraded":"2024-09-10T05:56:48.814714+0000","last_fullsized":"2024-09-10T05:56:48.814714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777799+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:56:48.777799+0000","last_peered":"2024-09-10T05:56:48.777799+0000","last_clean":"2024-09-10T05:56:48.777799+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:56:48.777799+0000","last_undegraded":"2024-09-10T05:56:48.777799+0000","last_fullsized":"2024-09-10T05:56:48.777799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.791042+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:56:48.791042+0000","last_peered":"2024-09-10T05:56:48.791042+0000","last_clean":"2024-09-10T05:56:48.791042+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:56:48.791042+0000","last_undegraded":"2024-09-10T05:56:48.791042+0000","last_fullsized":"2024-09-10T05:56:48.791042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"67'94","reported_seq":242,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.848661+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:56:49.848661+0000","last_peered":"2024-09-10T05:56:49.848661+0000","last_clean":"2024-09-10T05:56:49.848661+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:56:49.848661+0000","last_undegraded":"2024-09-10T05:56:49.848661+0000","last_fullsized":"2024-09-10T05:56:49.848661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":131,"num_read_kb":115,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815394+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:56:48.815394+0000","last_peered":"2024-09-10T05:56:48.815394+0000","last_clean":"2024-09-10T05:56:48.815394+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:56:48.815394+0000","last_undegraded":"2024-09-10T05:56:48.815394+0000","last_fullsized":"2024-09-10T05:56:48.815394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":83,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.849898+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:56:49.849898+0000","last_peered":"2024-09-10T05:56:49.849898+0000","last_clean":"2024-09-10T05:56:49.849898+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:56:49.849898+0000","last_undegraded":"2024-09-10T05:56:49.849898+0000","last_fullsized":"2024-09-10T05:56:49.849898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"66'2","reported_seq":99,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787923+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:56:48.787923+0000","last_peered":"2024-09-10T05:56:48.787923+0000","last_clean":"2024-09-10T05:56:48.787923+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:56:48.787923+0000","last_undegraded":"2024-09-10T05:56:48.787923+0000","last_fullsized":"2024-09-10T05:56:48.787923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818266+0000","last_change":"2024-09-10T05:56:23.064028+0000","last_active":"2024-09-10T05:56:48.818266+0000","last_peered":"2024-09-10T05:56:48.818266+0000","last_clean":"2024-09-10T05:56:48.818266+0000","last_became_active":"2024-09-10T05:56:23.063737+0000","last_became_peered":"2024-09-10T05:56:23.063737+0000","last_unstale":"2024-09-10T05:56:48.818266+0000","last_undegraded":"2024-09-10T05:56:48.818266+0000","last_fullsized":"2024-09-10T05:56:48.818266+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:13.386211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786044+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:56:48.786044+0000","last_peered":"2024-09-10T05:56:48.786044+0000","last_clean":"2024-09-10T05:56:48.786044+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:56:48.786044+0000","last_undegraded":"2024-09-10T05:56:48.786044+0000","last_fullsized":"2024-09-10T05:56:48.786044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":87,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818761+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:56:48.818761+0000","last_peered":"2024-09-10T05:56:48.818761+0000","last_clean":"2024-09-10T05:56:48.818761+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:56:48.818761+0000","last_undegraded":"2024-09-10T05:56:48.818761+0000","last_fullsized":"2024-09-10T05:56:48.818761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815677+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:56:48.815677+0000","last_peered":"2024-09-10T05:56:48.815677+0000","last_clean":"2024-09-10T05:56:48.815677+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:56:48.815677+0000","last_undegraded":"2024-09-10T05:56:48.815677+0000","last_fullsized":"2024-09-10T05:56:48.815677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.778032+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:56:48.778032+0000","last_peered":"2024-09-10T05:56:48.778032+0000","last_clean":"2024-09-10T05:56:48.778032+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:56:48.778032+0000","last_undegraded":"2024-09-10T05:56:48.778032+0000","last_fullsized":"2024-09-10T05:56:48.778032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812623+0000","last_change":"2024-09-10T05:56:23.045091+0000","last_active":"2024-09-10T05:56:48.812623+0000","last_peered":"2024-09-10T05:56:48.812623+0000","last_clean":"2024-09-10T05:56:48.812623+0000","last_became_active":"2024-09-10T05:56:23.037788+0000","last_became_peered":"2024-09-10T05:56:23.037788+0000","last_unstale":"2024-09-10T05:56:48.812623+0000","last_undegraded":"2024-09-10T05:56:48.812623+0000","last_fullsized":"2024-09-10T05:56:48.812623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:15.274180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.326926+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:56:49.326926+0000","last_peered":"2024-09-10T05:56:49.326926+0000","last_clean":"2024-09-10T05:56:49.326926+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:56:49.326926+0000","last_undegraded":"2024-09-10T05:56:49.326926+0000","last_fullsized":"2024-09-10T05:56:49.326926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":109,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790273+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:56:48.790273+0000","last_peered":"2024-09-10T05:56:48.790273+0000","last_clean":"2024-09-10T05:56:48.790273+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:56:48.790273+0000","last_undegraded":"2024-09-10T05:56:48.790273+0000","last_fullsized":"2024-09-10T05:56:48.790273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"66'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782878+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:56:48.782878+0000","last_peered":"2024-09-10T05:56:48.782878+0000","last_clean":"2024-09-10T05:56:48.782878+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:56:48.782878+0000","last_undegraded":"2024-09-10T05:56:48.782878+0000","last_fullsized":"2024-09-10T05:56:48.782878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779144+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:56:48.779144+0000","last_peered":"2024-09-10T05:56:48.779144+0000","last_clean":"2024-09-10T05:56:48.779144+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:56:48.779144+0000","last_undegraded":"2024-09-10T05:56:48.779144+0000","last_fullsized":"2024-09-10T05:56:48.779144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813216+0000","last_change":"2024-09-10T05:56:23.133328+0000","last_active":"2024-09-10T05:56:48.813216+0000","last_peered":"2024-09-10T05:56:48.813216+0000","last_clean":"2024-09-10T05:56:48.813216+0000","last_became_active":"2024-09-10T05:56:23.028081+0000","last_became_peered":"2024-09-10T05:56:23.028081+0000","last_unstale":"2024-09-10T05:56:48.813216+0000","last_undegraded":"2024-09-10T05:56:48.813216+0000","last_fullsized":"2024-09-10T05:56:48.813216+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:08.397388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822057+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:56:48.822057+0000","last_peered":"2024-09-10T05:56:48.822057+0000","last_clean":"2024-09-10T05:56:48.822057+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:56:48.822057+0000","last_undegraded":"2024-09-10T05:56:48.822057+0000","last_fullsized":"2024-09-10T05:56:48.822057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.789425+0000","last_change":"2024-09-10T05:56:23.065400+0000","last_active":"2024-09-10T05:56:48.789425+0000","last_peered":"2024-09-10T05:56:48.789425+0000","last_clean":"2024-09-10T05:56:48.789425+0000","last_became_active":"2024-09-10T05:56:23.064530+0000","last_became_peered":"2024-09-10T05:56:23.064530+0000","last_unstale":"2024-09-10T05:56:48.789425+0000","last_undegraded":"2024-09-10T05:56:48.789425+0000","last_fullsized":"2024-09-10T05:56:48.789425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:39.048277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":56,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818179+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:56:48.818179+0000","last_peered":"2024-09-10T05:56:48.818179+0000","last_clean":"2024-09-10T05:56:48.818179+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:56:48.818179+0000","last_undegraded":"2024-09-10T05:56:48.818179+0000","last_fullsized":"2024-09-10T05:56:48.818179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.791115+0000","last_change":"2024-09-10T05:56:23.061131+0000","last_active":"2024-09-10T05:56:48.791115+0000","last_peered":"2024-09-10T05:56:48.791115+0000","last_clean":"2024-09-10T05:56:48.791115+0000","last_became_active":"2024-09-10T05:56:23.059938+0000","last_became_peered":"2024-09-10T05:56:23.059938+0000","last_unstale":"2024-09-10T05:56:48.791115+0000","last_undegraded":"2024-09-10T05:56:48.791115+0000","last_fullsized":"2024-09-10T05:56:48.791115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:24.743938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787069+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:56:48.787069+0000","last_peered":"2024-09-10T05:56:48.787069+0000","last_clean":"2024-09-10T05:56:48.787069+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:56:48.787069+0000","last_undegraded":"2024-09-10T05:56:48.787069+0000","last_fullsized":"2024-09-10T05:56:48.787069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":140,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.810666+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:56:49.810666+0000","last_peered":"2024-09-10T05:56:49.810666+0000","last_clean":"2024-09-10T05:56:49.810666+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:56:49.810666+0000","last_undegraded":"2024-09-10T05:56:49.810666+0000","last_fullsized":"2024-09-10T05:56:49.810666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"66'39","reported_seq":203,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.778332+0000","last_change":"2024-09-10T05:56:23.082938+0000","last_active":"2024-09-10T05:56:48.778332+0000","last_peered":"2024-09-10T05:56:48.778332+0000","last_clean":"2024-09-10T05:56:48.778332+0000","last_became_active":"2024-09-10T05:56:23.012137+0000","last_became_peered":"2024-09-10T05:56:23.012137+0000","last_unstale":"2024-09-10T05:56:48.778332+0000","last_undegraded":"2024-09-10T05:56:48.778332+0000","last_fullsized":"2024-09-10T05:56:48.778332+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:12.650262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.781669+0000","last_change":"2024-09-10T05:56:23.057279+0000","last_active":"2024-09-10T05:56:48.781669+0000","last_peered":"2024-09-10T05:56:48.781669+0000","last_clean":"2024-09-10T05:56:48.781669+0000","last_became_active":"2024-09-10T05:56:23.055517+0000","last_became_peered":"2024-09-10T05:56:23.055517+0000","last_unstale":"2024-09-10T05:56:48.781669+0000","last_undegraded":"2024-09-10T05:56:48.781669+0000","last_fullsized":"2024-09-10T05:56:48.781669+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:18.809677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779138+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:56:48.779138+0000","last_peered":"2024-09-10T05:56:48.779138+0000","last_clean":"2024-09-10T05:56:48.779138+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:56:48.779138+0000","last_undegraded":"2024-09-10T05:56:48.779138+0000","last_fullsized":"2024-09-10T05:56:48.779138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":99,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.778666+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:56:48.778666+0000","last_peered":"2024-09-10T05:56:48.778666+0000","last_clean":"2024-09-10T05:56:48.778666+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:56:48.778666+0000","last_undegraded":"2024-09-10T05:56:48.778666+0000","last_fullsized":"2024-09-10T05:56:48.778666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786990+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:56:48.786990+0000","last_peered":"2024-09-10T05:56:48.786990+0000","last_clean":"2024-09-10T05:56:48.786990+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:56:48.786990+0000","last_undegraded":"2024-09-10T05:56:48.786990+0000","last_fullsized":"2024-09-10T05:56:48.786990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.816035+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:56:48.816035+0000","last_peered":"2024-09-10T05:56:48.816035+0000","last_clean":"2024-09-10T05:56:48.816035+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:56:48.816035+0000","last_undegraded":"2024-09-10T05:56:48.816035+0000","last_fullsized":"2024-09-10T05:56:48.816035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821884+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:56:48.821884+0000","last_peered":"2024-09-10T05:56:48.821884+0000","last_clean":"2024-09-10T05:56:48.821884+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:56:48.821884+0000","last_undegraded":"2024-09-10T05:56:48.821884+0000","last_fullsized":"2024-09-10T05:56:48.821884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":115,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.785967+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:56:48.785967+0000","last_peered":"2024-09-10T05:56:48.785967+0000","last_clean":"2024-09-10T05:56:48.785967+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:56:48.785967+0000","last_undegraded":"2024-09-10T05:56:48.785967+0000","last_fullsized":"2024-09-10T05:56:48.785967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"67'80","reported_seq":174,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.839107+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:56:49.839107+0000","last_peered":"2024-09-10T05:56:49.839107+0000","last_clean":"2024-09-10T05:56:49.839107+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:56:49.839107+0000","last_undegraded":"2024-09-10T05:56:49.839107+0000","last_fullsized":"2024-09-10T05:56:49.839107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813720+0000","last_change":"2024-09-10T05:56:23.034838+0000","last_active":"2024-09-10T05:56:48.813720+0000","last_peered":"2024-09-10T05:56:48.813720+0000","last_clean":"2024-09-10T05:56:48.813720+0000","last_became_active":"2024-09-10T05:56:23.034573+0000","last_became_peered":"2024-09-10T05:56:23.034573+0000","last_unstale":"2024-09-10T05:56:48.813720+0000","last_undegraded":"2024-09-10T05:56:48.813720+0000","last_fullsized":"2024-09-10T05:56:48.813720+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:49.615870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812169+0000","last_change":"2024-09-10T05:56:23.008780+0000","last_active":"2024-09-10T05:56:48.812169+0000","last_peered":"2024-09-10T05:56:48.812169+0000","last_clean":"2024-09-10T05:56:48.812169+0000","last_became_active":"2024-09-10T05:56:23.008366+0000","last_became_peered":"2024-09-10T05:56:23.008366+0000","last_unstale":"2024-09-10T05:56:48.812169+0000","last_undegraded":"2024-09-10T05:56:48.812169+0000","last_fullsized":"2024-09-10T05:56:48.812169+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:13.265099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813578+0000","last_change":"2024-09-10T05:56:23.008892+0000","last_active":"2024-09-10T05:56:48.813578+0000","last_peered":"2024-09-10T05:56:48.813578+0000","last_clean":"2024-09-10T05:56:48.813578+0000","last_became_active":"2024-09-10T05:56:23.008313+0000","last_became_peered":"2024-09-10T05:56:23.008313+0000","last_unstale":"2024-09-10T05:56:48.813578+0000","last_undegraded":"2024-09-10T05:56:48.813578+0000","last_fullsized":"2024-09-10T05:56:48.813578+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:27.800265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787879+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:56:48.787879+0000","last_peered":"2024-09-10T05:56:48.787879+0000","last_clean":"2024-09-10T05:56:48.787879+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:56:48.787879+0000","last_undegraded":"2024-09-10T05:56:48.787879+0000","last_fullsized":"2024-09-10T05:56:48.787879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.781817+0000","last_change":"2024-09-10T05:56:23.057234+0000","last_active":"2024-09-10T05:56:48.781817+0000","last_peered":"2024-09-10T05:56:48.781817+0000","last_clean":"2024-09-10T05:56:48.781817+0000","last_became_active":"2024-09-10T05:56:23.056440+0000","last_became_peered":"2024-09-10T05:56:23.056440+0000","last_unstale":"2024-09-10T05:56:48.781817+0000","last_undegraded":"2024-09-10T05:56:48.781817+0000","last_fullsized":"2024-09-10T05:56:48.781817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:40.029847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":149,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782414+0000","last_change":"2024-09-10T05:56:23.097232+0000","last_active":"2024-09-10T05:56:48.782414+0000","last_peered":"2024-09-10T05:56:48.782414+0000","last_clean":"2024-09-10T05:56:48.782414+0000","last_became_active":"2024-09-10T05:56:23.058304+0000","last_became_peered":"2024-09-10T05:56:23.058304+0000","last_unstale":"2024-09-10T05:56:48.782414+0000","last_undegraded":"2024-09-10T05:56:48.782414+0000","last_fullsized":"2024-09-10T05:56:48.782414+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:19.449857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"67'82","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.844966+0000","last_change":"2024-09-10T05:56:23.135596+0000","last_active":"2024-09-10T05:56:49.844966+0000","last_peered":"2024-09-10T05:56:49.844966+0000","last_clean":"2024-09-10T05:56:49.844966+0000","last_became_active":"2024-09-10T05:56:23.040743+0000","last_became_peered":"2024-09-10T05:56:23.040743+0000","last_unstale":"2024-09-10T05:56:49.844966+0000","last_undegraded":"2024-09-10T05:56:49.844966+0000","last_fullsized":"2024-09-10T05:56:49.844966+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:19.913543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.778109+0000","last_change":"2024-09-10T05:56:23.051198+0000","last_active":"2024-09-10T05:56:48.778109+0000","last_peered":"2024-09-10T05:56:48.778109+0000","last_clean":"2024-09-10T05:56:48.778109+0000","last_became_active":"2024-09-10T05:56:23.050845+0000","last_became_peered":"2024-09-10T05:56:23.050845+0000","last_unstale":"2024-09-10T05:56:48.778109+0000","last_undegraded":"2024-09-10T05:56:48.778109+0000","last_fullsized":"2024-09-10T05:56:48.778109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:06.435647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.326153+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:56:49.326153+0000","last_peered":"2024-09-10T05:56:49.326153+0000","last_clean":"2024-09-10T05:56:49.326153+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:56:49.326153+0000","last_undegraded":"2024-09-10T05:56:49.326153+0000","last_fullsized":"2024-09-10T05:56:49.326153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779684+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:56:48.779684+0000","last_peered":"2024-09-10T05:56:48.779684+0000","last_clean":"2024-09-10T05:56:48.779684+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:56:48.779684+0000","last_undegraded":"2024-09-10T05:56:48.779684+0000","last_fullsized":"2024-09-10T05:56:48.779684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822213+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:56:48.822213+0000","last_peered":"2024-09-10T05:56:48.822213+0000","last_clean":"2024-09-10T05:56:48.822213+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:56:48.822213+0000","last_undegraded":"2024-09-10T05:56:48.822213+0000","last_fullsized":"2024-09-10T05:56:48.822213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812587+0000","last_change":"2024-09-10T05:56:23.052359+0000","last_active":"2024-09-10T05:56:48.812587+0000","last_peered":"2024-09-10T05:56:48.812587+0000","last_clean":"2024-09-10T05:56:48.812587+0000","last_became_active":"2024-09-10T05:56:23.049786+0000","last_became_peered":"2024-09-10T05:56:23.049786+0000","last_unstale":"2024-09-10T05:56:48.812587+0000","last_undegraded":"2024-09-10T05:56:48.812587+0000","last_fullsized":"2024-09-10T05:56:48.812587+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:49.134672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"66'38","reported_seq":144,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814742+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:56:48.814742+0000","last_peered":"2024-09-10T05:56:48.814742+0000","last_clean":"2024-09-10T05:56:48.814742+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:56:48.814742+0000","last_undegraded":"2024-09-10T05:56:48.814742+0000","last_fullsized":"2024-09-10T05:56:48.814742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812630+0000","last_change":"2024-09-10T05:56:23.052211+0000","last_active":"2024-09-10T05:56:48.812630+0000","last_peered":"2024-09-10T05:56:48.812630+0000","last_clean":"2024-09-10T05:56:48.812630+0000","last_became_active":"2024-09-10T05:56:23.051916+0000","last_became_peered":"2024-09-10T05:56:23.051916+0000","last_unstale":"2024-09-10T05:56:48.812630+0000","last_undegraded":"2024-09-10T05:56:48.812630+0000","last_fullsized":"2024-09-10T05:56:48.812630+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:56.921238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.851099+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:56:49.851099+0000","last_peered":"2024-09-10T05:56:49.851099+0000","last_clean":"2024-09-10T05:56:49.851099+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:56:49.851099+0000","last_undegraded":"2024-09-10T05:56:49.851099+0000","last_fullsized":"2024-09-10T05:56:49.851099+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779510+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:56:48.779510+0000","last_peered":"2024-09-10T05:56:48.779510+0000","last_clean":"2024-09-10T05:56:48.779510+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:56:48.779510+0000","last_undegraded":"2024-09-10T05:56:48.779510+0000","last_fullsized":"2024-09-10T05:56:48.779510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782278+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:56:48.782278+0000","last_peered":"2024-09-10T05:56:48.782278+0000","last_clean":"2024-09-10T05:56:48.782278+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:56:48.782278+0000","last_undegraded":"2024-09-10T05:56:48.782278+0000","last_fullsized":"2024-09-10T05:56:48.782278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782324+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:56:48.782324+0000","last_peered":"2024-09-10T05:56:48.782324+0000","last_clean":"2024-09-10T05:56:48.782324+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:56:48.782324+0000","last_undegraded":"2024-09-10T05:56:48.782324+0000","last_fullsized":"2024-09-10T05:56:48.782324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786516+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:56:48.786516+0000","last_peered":"2024-09-10T05:56:48.786516+0000","last_clean":"2024-09-10T05:56:48.786516+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:56:48.786516+0000","last_undegraded":"2024-09-10T05:56:48.786516+0000","last_fullsized":"2024-09-10T05:56:48.786516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"67'22","reported_seq":48,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812204+0000","last_change":"2024-09-10T05:56:23.074045+0000","last_active":"2024-09-10T05:56:48.812204+0000","last_peered":"2024-09-10T05:56:48.812204+0000","last_clean":"2024-09-10T05:56:48.812204+0000","last_became_active":"2024-09-10T05:56:23.019631+0000","last_became_peered":"2024-09-10T05:56:23.019631+0000","last_unstale":"2024-09-10T05:56:48.812204+0000","last_undegraded":"2024-09-10T05:56:48.812204+0000","last_fullsized":"2024-09-10T05:56:48.812204+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:54.559625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812231+0000","last_change":"2024-09-10T05:56:23.045936+0000","last_active":"2024-09-10T05:56:48.812231+0000","last_peered":"2024-09-10T05:56:48.812231+0000","last_clean":"2024-09-10T05:56:48.812231+0000","last_became_active":"2024-09-10T05:56:23.038258+0000","last_became_peered":"2024-09-10T05:56:23.038258+0000","last_unstale":"2024-09-10T05:56:48.812231+0000","last_undegraded":"2024-09-10T05:56:48.812231+0000","last_fullsized":"2024-09-10T05:56:48.812231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.439503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813406+0000","last_change":"2024-09-10T05:56:23.017188+0000","last_active":"2024-09-10T05:56:48.813406+0000","last_peered":"2024-09-10T05:56:48.813406+0000","last_clean":"2024-09-10T05:56:48.813406+0000","last_became_active":"2024-09-10T05:56:23.016931+0000","last_became_peered":"2024-09-10T05:56:23.016931+0000","last_unstale":"2024-09-10T05:56:48.813406+0000","last_undegraded":"2024-09-10T05:56:48.813406+0000","last_fullsized":"2024-09-10T05:56:48.813406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:27.661737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786472+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:56:48.786472+0000","last_peered":"2024-09-10T05:56:48.786472+0000","last_clean":"2024-09-10T05:56:48.786472+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:56:48.786472+0000","last_undegraded":"2024-09-10T05:56:48.786472+0000","last_fullsized":"2024-09-10T05:56:48.786472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815835+0000","last_change":"2024-09-10T05:56:23.021907+0000","last_active":"2024-09-10T05:56:48.815835+0000","last_peered":"2024-09-10T05:56:48.815835+0000","last_clean":"2024-09-10T05:56:48.815835+0000","last_became_active":"2024-09-10T05:56:23.021259+0000","last_became_peered":"2024-09-10T05:56:23.021259+0000","last_unstale":"2024-09-10T05:56:48.815835+0000","last_undegraded":"2024-09-10T05:56:48.815835+0000","last_fullsized":"2024-09-10T05:56:48.815835+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:14.123922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812627+0000","last_change":"2024-09-10T05:56:23.031916+0000","last_active":"2024-09-10T05:56:48.812627+0000","last_peered":"2024-09-10T05:56:48.812627+0000","last_clean":"2024-09-10T05:56:48.812627+0000","last_became_active":"2024-09-10T05:56:23.027500+0000","last_became_peered":"2024-09-10T05:56:23.027500+0000","last_unstale":"2024-09-10T05:56:48.812627+0000","last_undegraded":"2024-09-10T05:56:48.812627+0000","last_fullsized":"2024-09-10T05:56:48.812627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:46.438549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"45'5","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777776+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:56:48.777776+0000","last_peered":"2024-09-10T05:56:48.777776+0000","last_clean":"2024-09-10T05:56:48.777776+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:56:48.777776+0000","last_undegraded":"2024-09-10T05:56:48.777776+0000","last_fullsized":"2024-09-10T05:56:48.777776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814724+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:56:48.814724+0000","last_peered":"2024-09-10T05:56:48.814724+0000","last_clean":"2024-09-10T05:56:48.814724+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:56:48.814724+0000","last_undegraded":"2024-09-10T05:56:48.814724+0000","last_fullsized":"2024-09-10T05:56:48.814724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.984357+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:56:48.984357+0000","last_peered":"2024-09-10T05:56:48.984357+0000","last_clean":"2024-09-10T05:56:48.984357+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:56:48.984357+0000","last_undegraded":"2024-09-10T05:56:48.984357+0000","last_fullsized":"2024-09-10T05:56:48.984357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"66'4","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812275+0000","last_change":"2024-09-10T05:56:23.018017+0000","last_active":"2024-09-10T05:56:48.812275+0000","last_peered":"2024-09-10T05:56:48.812275+0000","last_clean":"2024-09-10T05:56:48.812275+0000","last_became_active":"2024-09-10T05:56:23.008084+0000","last_became_peered":"2024-09-10T05:56:23.008084+0000","last_unstale":"2024-09-10T05:56:48.812275+0000","last_undegraded":"2024-09-10T05:56:48.812275+0000","last_fullsized":"2024-09-10T05:56:48.812275+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:37.245150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.791126+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:56:48.791126+0000","last_peered":"2024-09-10T05:56:48.791126+0000","last_clean":"2024-09-10T05:56:48.791126+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:56:48.791126+0000","last_undegraded":"2024-09-10T05:56:48.791126+0000","last_fullsized":"2024-09-10T05:56:48.791126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":87,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814402+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:56:48.814402+0000","last_peered":"2024-09-10T05:56:48.814402+0000","last_clean":"2024-09-10T05:56:48.814402+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:56:48.814402+0000","last_undegraded":"2024-09-10T05:56:48.814402+0000","last_fullsized":"2024-09-10T05:56:48.814402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"67'16","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812865+0000","last_change":"2024-09-10T05:56:23.144815+0000","last_active":"2024-09-10T05:56:48.812865+0000","last_peered":"2024-09-10T05:56:48.812865+0000","last_clean":"2024-09-10T05:56:48.812865+0000","last_became_active":"2024-09-10T05:56:23.041150+0000","last_became_peered":"2024-09-10T05:56:23.041150+0000","last_unstale":"2024-09-10T05:56:48.812865+0000","last_undegraded":"2024-09-10T05:56:48.812865+0000","last_fullsized":"2024-09-10T05:56:48.812865+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:26.741208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821716+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:56:48.821716+0000","last_peered":"2024-09-10T05:56:48.821716+0000","last_clean":"2024-09-10T05:56:48.821716+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:56:48.821716+0000","last_undegraded":"2024-09-10T05:56:48.821716+0000","last_fullsized":"2024-09-10T05:56:48.821716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790078+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:56:48.790078+0000","last_peered":"2024-09-10T05:56:48.790078+0000","last_clean":"2024-09-10T05:56:48.790078+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:56:48.790078+0000","last_undegraded":"2024-09-10T05:56:48.790078+0000","last_fullsized":"2024-09-10T05:56:48.790078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.327648+0000","last_change":"2024-09-10T05:56:23.052761+0000","last_active":"2024-09-10T05:56:49.327648+0000","last_peered":"2024-09-10T05:56:49.327648+0000","last_clean":"2024-09-10T05:56:49.327648+0000","last_became_active":"2024-09-10T05:56:23.049110+0000","last_became_peered":"2024-09-10T05:56:23.049110+0000","last_unstale":"2024-09-10T05:56:49.327648+0000","last_undegraded":"2024-09-10T05:56:49.327648+0000","last_fullsized":"2024-09-10T05:56:49.327648+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:44.011144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779721+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:56:48.779721+0000","last_peered":"2024-09-10T05:56:48.779721+0000","last_clean":"2024-09-10T05:56:48.779721+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:56:48.779721+0000","last_undegraded":"2024-09-10T05:56:48.779721+0000","last_fullsized":"2024-09-10T05:56:48.779721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821764+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:56:48.821764+0000","last_peered":"2024-09-10T05:56:48.821764+0000","last_clean":"2024-09-10T05:56:48.821764+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:56:48.821764+0000","last_undegraded":"2024-09-10T05:56:48.821764+0000","last_fullsized":"2024-09-10T05:56:48.821764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"66'13","reported_seq":103,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814603+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:56:48.814603+0000","last_peered":"2024-09-10T05:56:48.814603+0000","last_clean":"2024-09-10T05:56:48.814603+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:56:48.814603+0000","last_undegraded":"2024-09-10T05:56:48.814603+0000","last_fullsized":"2024-09-10T05:56:48.814603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777934+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:56:48.777934+0000","last_peered":"2024-09-10T05:56:48.777934+0000","last_clean":"2024-09-10T05:56:48.777934+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:56:48.777934+0000","last_undegraded":"2024-09-10T05:56:48.777934+0000","last_fullsized":"2024-09-10T05:56:48.777934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"66'4","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822153+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:56:48.822153+0000","last_peered":"2024-09-10T05:56:48.822153+0000","last_clean":"2024-09-10T05:56:48.822153+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:56:48.822153+0000","last_undegraded":"2024-09-10T05:56:48.822153+0000","last_fullsized":"2024-09-10T05:56:48.822153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812269+0000","last_change":"2024-09-10T05:56:23.010745+0000","last_active":"2024-09-10T05:56:48.812269+0000","last_peered":"2024-09-10T05:56:48.812269+0000","last_clean":"2024-09-10T05:56:48.812269+0000","last_became_active":"2024-09-10T05:56:23.010466+0000","last_became_peered":"2024-09-10T05:56:23.010466+0000","last_unstale":"2024-09-10T05:56:48.812269+0000","last_undegraded":"2024-09-10T05:56:48.812269+0000","last_fullsized":"2024-09-10T05:56:48.812269+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:12.448397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.779515+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:56:48.779515+0000","last_peered":"2024-09-10T05:56:48.779515+0000","last_clean":"2024-09-10T05:56:48.779515+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:56:48.779515+0000","last_undegraded":"2024-09-10T05:56:48.779515+0000","last_fullsized":"2024-09-10T05:56:48.779515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"66'28","reported_seq":127,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786975+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:56:48.786975+0000","last_peered":"2024-09-10T05:56:48.786975+0000","last_clean":"2024-09-10T05:56:48.786975+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:56:48.786975+0000","last_undegraded":"2024-09-10T05:56:48.786975+0000","last_fullsized":"2024-09-10T05:56:48.786975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790348+0000","last_change":"2024-09-10T05:56:23.065281+0000","last_active":"2024-09-10T05:56:48.790348+0000","last_peered":"2024-09-10T05:56:48.790348+0000","last_clean":"2024-09-10T05:56:48.790348+0000","last_became_active":"2024-09-10T05:56:23.064464+0000","last_became_peered":"2024-09-10T05:56:23.064464+0000","last_unstale":"2024-09-10T05:56:48.790348+0000","last_undegraded":"2024-09-10T05:56:48.790348+0000","last_fullsized":"2024-09-10T05:56:48.790348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:21.392647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812683+0000","last_change":"2024-09-10T05:56:23.045151+0000","last_active":"2024-09-10T05:56:48.812683+0000","last_peered":"2024-09-10T05:56:48.812683+0000","last_clean":"2024-09-10T05:56:48.812683+0000","last_became_active":"2024-09-10T05:56:23.040353+0000","last_became_peered":"2024-09-10T05:56:23.040353+0000","last_unstale":"2024-09-10T05:56:48.812683+0000","last_undegraded":"2024-09-10T05:56:48.812683+0000","last_fullsized":"2024-09-10T05:56:48.812683+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:43.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.032022+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:56:49.032022+0000","last_peered":"2024-09-10T05:56:49.032022+0000","last_clean":"2024-09-10T05:56:49.032022+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:56:49.032022+0000","last_undegraded":"2024-09-10T05:56:49.032022+0000","last_fullsized":"2024-09-10T05:56:49.032022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"66'1","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786275+0000","last_change":"2024-09-10T05:56:23.050367+0000","last_active":"2024-09-10T05:56:48.786275+0000","last_peered":"2024-09-10T05:56:48.786275+0000","last_clean":"2024-09-10T05:56:48.786275+0000","last_became_active":"2024-09-10T05:56:23.050069+0000","last_became_peered":"2024-09-10T05:56:23.050069+0000","last_unstale":"2024-09-10T05:56:48.786275+0000","last_undegraded":"2024-09-10T05:56:48.786275+0000","last_fullsized":"2024-09-10T05:56:48.786275+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:04.360756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822108+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:56:48.822108+0000","last_peered":"2024-09-10T05:56:48.822108+0000","last_clean":"2024-09-10T05:56:48.822108+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:56:48.822108+0000","last_undegraded":"2024-09-10T05:56:48.822108+0000","last_fullsized":"2024-09-10T05:56:48.822108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"66'19","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815193+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:56:48.815193+0000","last_peered":"2024-09-10T05:56:48.815193+0000","last_clean":"2024-09-10T05:56:48.815193+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:56:48.815193+0000","last_undegraded":"2024-09-10T05:56:48.815193+0000","last_fullsized":"2024-09-10T05:56:48.815193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787483+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:56:48.787483+0000","last_peered":"2024-09-10T05:56:48.787483+0000","last_clean":"2024-09-10T05:56:48.787483+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:56:48.787483+0000","last_undegraded":"2024-09-10T05:56:48.787483+0000","last_fullsized":"2024-09-10T05:56:48.787483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821602+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:56:48.821602+0000","last_peered":"2024-09-10T05:56:48.821602+0000","last_clean":"2024-09-10T05:56:48.821602+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:56:48.821602+0000","last_undegraded":"2024-09-10T05:56:48.821602+0000","last_fullsized":"2024-09-10T05:56:48.821602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813133+0000","last_change":"2024-09-10T05:56:23.045737+0000","last_active":"2024-09-10T05:56:48.813133+0000","last_peered":"2024-09-10T05:56:48.813133+0000","last_clean":"2024-09-10T05:56:48.813133+0000","last_became_active":"2024-09-10T05:56:23.045444+0000","last_became_peered":"2024-09-10T05:56:23.045444+0000","last_unstale":"2024-09-10T05:56:48.813133+0000","last_undegraded":"2024-09-10T05:56:48.813133+0000","last_fullsized":"2024-09-10T05:56:48.813133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:30.592439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782679+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:56:48.782679+0000","last_peered":"2024-09-10T05:56:48.782679+0000","last_clean":"2024-09-10T05:56:48.782679+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:56:48.782679+0000","last_undegraded":"2024-09-10T05:56:48.782679+0000","last_fullsized":"2024-09-10T05:56:48.782679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":160,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.808371+0000","last_change":"2024-09-10T05:56:23.127993+0000","last_active":"2024-09-10T05:56:49.808371+0000","last_peered":"2024-09-10T05:56:49.808371+0000","last_clean":"2024-09-10T05:56:49.808371+0000","last_became_active":"2024-09-10T05:56:23.062056+0000","last_became_peered":"2024-09-10T05:56:23.062056+0000","last_unstale":"2024-09-10T05:56:49.808371+0000","last_undegraded":"2024-09-10T05:56:49.808371+0000","last_fullsized":"2024-09-10T05:56:49.808371+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:40.985541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"66'23","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813576+0000","last_change":"2024-09-10T05:56:23.107948+0000","last_active":"2024-09-10T05:56:48.813576+0000","last_peered":"2024-09-10T05:56:48.813576+0000","last_clean":"2024-09-10T05:56:48.813576+0000","last_became_active":"2024-09-10T05:56:23.025431+0000","last_became_peered":"2024-09-10T05:56:23.025431+0000","last_unstale":"2024-09-10T05:56:48.813576+0000","last_undegraded":"2024-09-10T05:56:48.813576+0000","last_fullsized":"2024-09-10T05:56:48.813576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:02.951376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787548+0000","last_change":"2024-09-10T05:56:23.016482+0000","last_active":"2024-09-10T05:56:48.787548+0000","last_peered":"2024-09-10T05:56:48.787548+0000","last_clean":"2024-09-10T05:56:48.787548+0000","last_became_active":"2024-09-10T05:56:23.015986+0000","last_became_peered":"2024-09-10T05:56:23.015986+0000","last_unstale":"2024-09-10T05:56:48.787548+0000","last_undegraded":"2024-09-10T05:56:48.787548+0000","last_fullsized":"2024-09-10T05:56:48.787548+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:20.881180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.789646+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:56:48.789646+0000","last_peered":"2024-09-10T05:56:48.789646+0000","last_clean":"2024-09-10T05:56:48.789646+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:56:48.789646+0000","last_undegraded":"2024-09-10T05:56:48.789646+0000","last_fullsized":"2024-09-10T05:56:48.789646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818612+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:56:48.818612+0000","last_peered":"2024-09-10T05:56:48.818612+0000","last_clean":"2024-09-10T05:56:48.818612+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:56:48.818612+0000","last_undegraded":"2024-09-10T05:56:48.818612+0000","last_fullsized":"2024-09-10T05:56:48.818612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"65'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.778014+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:56:48.778014+0000","last_peered":"2024-09-10T05:56:48.778014+0000","last_clean":"2024-09-10T05:56:48.778014+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:56:48.778014+0000","last_undegraded":"2024-09-10T05:56:48.778014+0000","last_fullsized":"2024-09-10T05:56:48.778014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787571+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:56:48.787571+0000","last_peered":"2024-09-10T05:56:48.787571+0000","last_clean":"2024-09-10T05:56:48.787571+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:56:48.787571+0000","last_undegraded":"2024-09-10T05:56:48.787571+0000","last_fullsized":"2024-09-10T05:56:48.787571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":109,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782746+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:56:48.782746+0000","last_peered":"2024-09-10T05:56:48.782746+0000","last_clean":"2024-09-10T05:56:48.782746+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:56:48.782746+0000","last_undegraded":"2024-09-10T05:56:48.782746+0000","last_fullsized":"2024-09-10T05:56:48.782746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"67'80","reported_seq":174,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.837924+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:56:49.837924+0000","last_peered":"2024-09-10T05:56:49.837924+0000","last_clean":"2024-09-10T05:56:49.837924+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:56:49.837924+0000","last_undegraded":"2024-09-10T05:56:49.837924+0000","last_fullsized":"2024-09-10T05:56:49.837924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":83,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814374+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:56:48.814374+0000","last_peered":"2024-09-10T05:56:48.814374+0000","last_clean":"2024-09-10T05:56:48.814374+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:56:48.814374+0000","last_undegraded":"2024-09-10T05:56:48.814374+0000","last_fullsized":"2024-09-10T05:56:48.814374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":118,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.907593+0000","last_change":"2024-09-10T05:56:23.057534+0000","last_active":"2024-09-10T05:56:49.907593+0000","last_peered":"2024-09-10T05:56:49.907593+0000","last_clean":"2024-09-10T05:56:49.907593+0000","last_became_active":"2024-09-10T05:56:23.055973+0000","last_became_peered":"2024-09-10T05:56:23.055973+0000","last_unstale":"2024-09-10T05:56:49.907593+0000","last_undegraded":"2024-09-10T05:56:49.907593+0000","last_fullsized":"2024-09-10T05:56:49.907593+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:25.497531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790479+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:56:48.790479+0000","last_peered":"2024-09-10T05:56:48.790479+0000","last_clean":"2024-09-10T05:56:48.790479+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:56:48.790479+0000","last_undegraded":"2024-09-10T05:56:48.790479+0000","last_fullsized":"2024-09-10T05:56:48.790479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":87,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814747+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:56:48.814747+0000","last_peered":"2024-09-10T05:56:48.814747+0000","last_clean":"2024-09-10T05:56:48.814747+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:56:48.814747+0000","last_undegraded":"2024-09-10T05:56:48.814747+0000","last_fullsized":"2024-09-10T05:56:48.814747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"66'43","reported_seq":159,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.789884+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:56:48.789884+0000","last_peered":"2024-09-10T05:56:48.789884+0000","last_clean":"2024-09-10T05:56:48.789884+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:56:48.789884+0000","last_undegraded":"2024-09-10T05:56:48.789884+0000","last_fullsized":"2024-09-10T05:56:48.789884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777405+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:56:48.777405+0000","last_peered":"2024-09-10T05:56:48.777405+0000","last_clean":"2024-09-10T05:56:48.777405+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:56:48.777405+0000","last_undegraded":"2024-09-10T05:56:48.777405+0000","last_fullsized":"2024-09-10T05:56:48.777405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":75,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815989+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:56:48.815989+0000","last_peered":"2024-09-10T05:56:48.815989+0000","last_clean":"2024-09-10T05:56:48.815989+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:56:48.815989+0000","last_undegraded":"2024-09-10T05:56:48.815989+0000","last_fullsized":"2024-09-10T05:56:48.815989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"66'2","reported_seq":111,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782509+0000","last_change":"2024-09-10T05:56:23.056838+0000","last_active":"2024-09-10T05:56:48.782509+0000","last_peered":"2024-09-10T05:56:48.782509+0000","last_clean":"2024-09-10T05:56:48.782509+0000","last_became_active":"2024-09-10T05:56:23.055918+0000","last_became_peered":"2024-09-10T05:56:23.055918+0000","last_unstale":"2024-09-10T05:56:48.782509+0000","last_undegraded":"2024-09-10T05:56:48.782509+0000","last_fullsized":"2024-09-10T05:56:48.782509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:03.148051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.791004+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:56:48.791004+0000","last_peered":"2024-09-10T05:56:48.791004+0000","last_clean":"2024-09-10T05:56:48.791004+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:56:48.791004+0000","last_undegraded":"2024-09-10T05:56:48.791004+0000","last_fullsized":"2024-09-10T05:56:48.791004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.789934+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:56:48.789934+0000","last_peered":"2024-09-10T05:56:48.789934+0000","last_clean":"2024-09-10T05:56:48.789934+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:56:48.789934+0000","last_undegraded":"2024-09-10T05:56:48.789934+0000","last_fullsized":"2024-09-10T05:56:48.789934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"66'19","reported_seq":114,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777519+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:56:48.777519+0000","last_peered":"2024-09-10T05:56:48.777519+0000","last_clean":"2024-09-10T05:56:48.777519+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:56:48.777519+0000","last_undegraded":"2024-09-10T05:56:48.777519+0000","last_fullsized":"2024-09-10T05:56:48.777519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821542+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:56:48.821542+0000","last_peered":"2024-09-10T05:56:48.821542+0000","last_clean":"2024-09-10T05:56:48.821542+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:56:48.821542+0000","last_undegraded":"2024-09-10T05:56:48.821542+0000","last_fullsized":"2024-09-10T05:56:48.821542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":35,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813351+0000","last_change":"2024-09-10T05:56:23.034843+0000","last_active":"2024-09-10T05:56:48.813351+0000","last_peered":"2024-09-10T05:56:48.813351+0000","last_clean":"2024-09-10T05:56:48.813351+0000","last_became_active":"2024-09-10T05:56:23.033226+0000","last_became_peered":"2024-09-10T05:56:23.033226+0000","last_unstale":"2024-09-10T05:56:48.813351+0000","last_undegraded":"2024-09-10T05:56:48.813351+0000","last_fullsized":"2024-09-10T05:56:48.813351+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:40.377323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812393+0000","last_change":"2024-09-10T05:56:23.034224+0000","last_active":"2024-09-10T05:56:48.812393+0000","last_peered":"2024-09-10T05:56:48.812393+0000","last_clean":"2024-09-10T05:56:48.812393+0000","last_became_active":"2024-09-10T05:56:23.033976+0000","last_became_peered":"2024-09-10T05:56:23.033976+0000","last_unstale":"2024-09-10T05:56:48.812393+0000","last_undegraded":"2024-09-10T05:56:48.812393+0000","last_fullsized":"2024-09-10T05:56:48.812393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:30.677812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813309+0000","last_change":"2024-09-10T05:56:23.026756+0000","last_active":"2024-09-10T05:56:48.813309+0000","last_peered":"2024-09-10T05:56:48.813309+0000","last_clean":"2024-09-10T05:56:48.813309+0000","last_became_active":"2024-09-10T05:56:23.026265+0000","last_became_peered":"2024-09-10T05:56:23.026265+0000","last_unstale":"2024-09-10T05:56:48.813309+0000","last_undegraded":"2024-09-10T05:56:48.813309+0000","last_fullsized":"2024-09-10T05:56:48.813309+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.455768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.781584+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:56:48.781584+0000","last_peered":"2024-09-10T05:56:48.781584+0000","last_clean":"2024-09-10T05:56:48.781584+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:56:48.781584+0000","last_undegraded":"2024-09-10T05:56:48.781584+0000","last_fullsized":"2024-09-10T05:56:48.781584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"66'15","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812852+0000","last_change":"2024-09-10T05:56:23.093611+0000","last_active":"2024-09-10T05:56:48.812852+0000","last_peered":"2024-09-10T05:56:48.812852+0000","last_clean":"2024-09-10T05:56:48.812852+0000","last_became_active":"2024-09-10T05:56:23.021588+0000","last_became_peered":"2024-09-10T05:56:23.021588+0000","last_unstale":"2024-09-10T05:56:48.812852+0000","last_undegraded":"2024-09-10T05:56:48.812852+0000","last_fullsized":"2024-09-10T05:56:48.812852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:05.418407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.781902+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:56:48.781902+0000","last_peered":"2024-09-10T05:56:48.781902+0000","last_clean":"2024-09-10T05:56:48.781902+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:56:48.781902+0000","last_undegraded":"2024-09-10T05:56:48.781902+0000","last_fullsized":"2024-09-10T05:56:48.781902+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.981573+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:56:48.981573+0000","last_peered":"2024-09-10T05:56:48.981573+0000","last_clean":"2024-09-10T05:56:48.981573+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:56:48.981573+0000","last_undegraded":"2024-09-10T05:56:48.981573+0000","last_fullsized":"2024-09-10T05:56:48.981573+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.899496+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:56:49.899496+0000","last_peered":"2024-09-10T05:56:49.899496+0000","last_clean":"2024-09-10T05:56:49.899496+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:56:49.899496+0000","last_undegraded":"2024-09-10T05:56:49.899496+0000","last_fullsized":"2024-09-10T05:56:49.899496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":56,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818760+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:56:48.818760+0000","last_peered":"2024-09-10T05:56:48.818760+0000","last_clean":"2024-09-10T05:56:48.818760+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:56:48.818760+0000","last_undegraded":"2024-09-10T05:56:48.818760+0000","last_fullsized":"2024-09-10T05:56:48.818760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":87,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786026+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:56:48.786026+0000","last_peered":"2024-09-10T05:56:48.786026+0000","last_clean":"2024-09-10T05:56:48.786026+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:56:48.786026+0000","last_undegraded":"2024-09-10T05:56:48.786026+0000","last_fullsized":"2024-09-10T05:56:48.786026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"66'26","reported_seq":127,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.782082+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:56:48.782082+0000","last_peered":"2024-09-10T05:56:48.782082+0000","last_clean":"2024-09-10T05:56:48.782082+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:56:48.782082+0000","last_undegraded":"2024-09-10T05:56:48.782082+0000","last_fullsized":"2024-09-10T05:56:48.782082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.777840+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:56:48.777840+0000","last_peered":"2024-09-10T05:56:48.777840+0000","last_clean":"2024-09-10T05:56:48.777840+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:56:48.777840+0000","last_undegraded":"2024-09-10T05:56:48.777840+0000","last_fullsized":"2024-09-10T05:56:48.777840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.783083+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:56:48.783083+0000","last_peered":"2024-09-10T05:56:48.783083+0000","last_clean":"2024-09-10T05:56:48.783083+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:56:48.783083+0000","last_undegraded":"2024-09-10T05:56:48.783083+0000","last_fullsized":"2024-09-10T05:56:48.783083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"66'2","reported_seq":99,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787808+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:56:48.787808+0000","last_peered":"2024-09-10T05:56:48.787808+0000","last_clean":"2024-09-10T05:56:48.787808+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:56:48.787808+0000","last_undegraded":"2024-09-10T05:56:48.787808+0000","last_fullsized":"2024-09-10T05:56:48.787808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821529+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:56:48.821529+0000","last_peered":"2024-09-10T05:56:48.821529+0000","last_clean":"2024-09-10T05:56:48.821529+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:56:48.821529+0000","last_undegraded":"2024-09-10T05:56:48.821529+0000","last_fullsized":"2024-09-10T05:56:48.821529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":122,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.897497+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:56:49.897497+0000","last_peered":"2024-09-10T05:56:49.897497+0000","last_clean":"2024-09-10T05:56:49.897497+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:56:49.897497+0000","last_undegraded":"2024-09-10T05:56:49.897497+0000","last_fullsized":"2024-09-10T05:56:49.897497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818158+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:56:48.818158+0000","last_peered":"2024-09-10T05:56:48.818158+0000","last_clean":"2024-09-10T05:56:48.818158+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:56:48.818158+0000","last_undegraded":"2024-09-10T05:56:48.818158+0000","last_fullsized":"2024-09-10T05:56:48.818158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"66'2","reported_seq":99,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790751+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:56:48.790751+0000","last_peered":"2024-09-10T05:56:48.790751+0000","last_clean":"2024-09-10T05:56:48.790751+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:56:48.790751+0000","last_undegraded":"2024-09-10T05:56:48.790751+0000","last_fullsized":"2024-09-10T05:56:48.790751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790230+0000","last_change":"2024-09-10T05:56:23.060633+0000","last_active":"2024-09-10T05:56:48.790230+0000","last_peered":"2024-09-10T05:56:48.790230+0000","last_clean":"2024-09-10T05:56:48.790230+0000","last_became_active":"2024-09-10T05:56:23.059675+0000","last_became_peered":"2024-09-10T05:56:23.059675+0000","last_unstale":"2024-09-10T05:56:48.790230+0000","last_undegraded":"2024-09-10T05:56:48.790230+0000","last_fullsized":"2024-09-10T05:56:48.790230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:54.126172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787029+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:56:48.787029+0000","last_peered":"2024-09-10T05:56:48.787029+0000","last_clean":"2024-09-10T05:56:48.787029+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:56:48.787029+0000","last_undegraded":"2024-09-10T05:56:48.787029+0000","last_fullsized":"2024-09-10T05:56:48.787029+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.778196+0000","last_change":"2024-09-10T05:56:23.047159+0000","last_active":"2024-09-10T05:56:48.778196+0000","last_peered":"2024-09-10T05:56:48.778196+0000","last_clean":"2024-09-10T05:56:48.778196+0000","last_became_active":"2024-09-10T05:56:23.046548+0000","last_became_peered":"2024-09-10T05:56:23.046548+0000","last_unstale":"2024-09-10T05:56:48.778196+0000","last_undegraded":"2024-09-10T05:56:48.778196+0000","last_fullsized":"2024-09-10T05:56:48.778196+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:39.908493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.615938+0000","last_change":"2024-09-10T05:56:23.020863+0000","last_active":"2024-09-10T05:56:49.615938+0000","last_peered":"2024-09-10T05:56:49.615938+0000","last_clean":"2024-09-10T05:56:49.615938+0000","last_became_active":"2024-09-10T05:56:23.020453+0000","last_became_peered":"2024-09-10T05:56:23.020453+0000","last_unstale":"2024-09-10T05:56:49.615938+0000","last_undegraded":"2024-09-10T05:56:49.615938+0000","last_fullsized":"2024-09-10T05:56:49.615938+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:00.711513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813247+0000","last_change":"2024-09-10T05:56:23.028796+0000","last_active":"2024-09-10T05:56:48.813247+0000","last_peered":"2024-09-10T05:56:48.813247+0000","last_clean":"2024-09-10T05:56:48.813247+0000","last_became_active":"2024-09-10T05:56:23.028497+0000","last_became_peered":"2024-09-10T05:56:23.028497+0000","last_unstale":"2024-09-10T05:56:48.813247+0000","last_undegraded":"2024-09-10T05:56:48.813247+0000","last_fullsized":"2024-09-10T05:56:48.813247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:09.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"67'6","reported_seq":116,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.897037+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:56:49.897037+0000","last_peered":"2024-09-10T05:56:49.897037+0000","last_clean":"2024-09-10T05:56:49.897037+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:56:49.897037+0000","last_undegraded":"2024-09-10T05:56:49.897037+0000","last_fullsized":"2024-09-10T05:56:49.897037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.787718+0000","last_change":"2024-09-10T05:56:23.037012+0000","last_active":"2024-09-10T05:56:48.787718+0000","last_peered":"2024-09-10T05:56:48.787718+0000","last_clean":"2024-09-10T05:56:48.787718+0000","last_became_active":"2024-09-10T05:56:23.036730+0000","last_became_peered":"2024-09-10T05:56:23.036730+0000","last_unstale":"2024-09-10T05:56:48.787718+0000","last_undegraded":"2024-09-10T05:56:48.787718+0000","last_fullsized":"2024-09-10T05:56:48.787718+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:47.789902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812311+0000","last_change":"2024-09-10T05:56:23.049294+0000","last_active":"2024-09-10T05:56:48.812311+0000","last_peered":"2024-09-10T05:56:48.812311+0000","last_clean":"2024-09-10T05:56:48.812311+0000","last_became_active":"2024-09-10T05:56:23.049026+0000","last_became_peered":"2024-09-10T05:56:23.049026+0000","last_unstale":"2024-09-10T05:56:48.812311+0000","last_undegraded":"2024-09-10T05:56:48.812311+0000","last_fullsized":"2024-09-10T05:56:48.812311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:42.468350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.822691+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:56:48.822691+0000","last_peered":"2024-09-10T05:56:48.822691+0000","last_clean":"2024-09-10T05:56:48.822691+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:56:48.822691+0000","last_undegraded":"2024-09-10T05:56:48.822691+0000","last_fullsized":"2024-09-10T05:56:48.822691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.898661+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:56:49.898661+0000","last_peered":"2024-09-10T05:56:49.898661+0000","last_clean":"2024-09-10T05:56:49.898661+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:56:49.898661+0000","last_undegraded":"2024-09-10T05:56:49.898661+0000","last_fullsized":"2024-09-10T05:56:49.898661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.813682+0000","last_change":"2024-09-10T05:56:23.055385+0000","last_active":"2024-09-10T05:56:48.813682+0000","last_peered":"2024-09-10T05:56:48.813682+0000","last_clean":"2024-09-10T05:56:48.813682+0000","last_became_active":"2024-09-10T05:56:23.053209+0000","last_became_peered":"2024-09-10T05:56:23.053209+0000","last_unstale":"2024-09-10T05:56:48.813682+0000","last_undegraded":"2024-09-10T05:56:48.813682+0000","last_fullsized":"2024-09-10T05:56:48.813682+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:12.695061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.028201+0000","last_change":"2024-09-10T05:56:23.043354+0000","last_active":"2024-09-10T05:56:49.028201+0000","last_peered":"2024-09-10T05:56:49.028201+0000","last_clean":"2024-09-10T05:56:49.028201+0000","last_became_active":"2024-09-10T05:56:23.042470+0000","last_became_peered":"2024-09-10T05:56:23.042470+0000","last_unstale":"2024-09-10T05:56:49.028201+0000","last_undegraded":"2024-09-10T05:56:49.028201+0000","last_fullsized":"2024-09-10T05:56:49.028201+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:34.970506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"66'1","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790319+0000","last_change":"2024-09-10T05:56:23.065960+0000","last_active":"2024-09-10T05:56:48.790319+0000","last_peered":"2024-09-10T05:56:48.790319+0000","last_clean":"2024-09-10T05:56:48.790319+0000","last_became_active":"2024-09-10T05:56:23.064580+0000","last_became_peered":"2024-09-10T05:56:23.064580+0000","last_unstale":"2024-09-10T05:56:48.790319+0000","last_undegraded":"2024-09-10T05:56:48.790319+0000","last_fullsized":"2024-09-10T05:56:48.790319+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:54.286114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"67'4","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.895578+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:56:49.895578+0000","last_peered":"2024-09-10T05:56:49.895578+0000","last_clean":"2024-09-10T05:56:49.895578+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:56:49.895578+0000","last_undegraded":"2024-09-10T05:56:49.895578+0000","last_fullsized":"2024-09-10T05:56:49.895578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.812425+0000","last_change":"2024-09-10T05:56:23.039970+0000","last_active":"2024-09-10T05:56:48.812425+0000","last_peered":"2024-09-10T05:56:48.812425+0000","last_clean":"2024-09-10T05:56:48.812425+0000","last_became_active":"2024-09-10T05:56:23.028702+0000","last_became_peered":"2024-09-10T05:56:23.028702+0000","last_unstale":"2024-09-10T05:56:48.812425+0000","last_undegraded":"2024-09-10T05:56:48.812425+0000","last_fullsized":"2024-09-10T05:56:48.812425+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:00.770967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818486+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:56:48.818486+0000","last_peered":"2024-09-10T05:56:48.818486+0000","last_clean":"2024-09-10T05:56:48.818486+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:56:48.818486+0000","last_undegraded":"2024-09-10T05:56:48.818486+0000","last_fullsized":"2024-09-10T05:56:48.818486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790142+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:56:48.790142+0000","last_peered":"2024-09-10T05:56:48.790142+0000","last_clean":"2024-09-10T05:56:48.790142+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:56:48.790142+0000","last_undegraded":"2024-09-10T05:56:48.790142+0000","last_fullsized":"2024-09-10T05:56:48.790142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.613428+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:56:49.613428+0000","last_peered":"2024-09-10T05:56:49.613428+0000","last_clean":"2024-09-10T05:56:49.613428+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:56:49.613428+0000","last_undegraded":"2024-09-10T05:56:49.613428+0000","last_fullsized":"2024-09-10T05:56:49.613428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.778365+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:56:48.778365+0000","last_peered":"2024-09-10T05:56:48.778365+0000","last_clean":"2024-09-10T05:56:48.778365+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:56:48.778365+0000","last_undegraded":"2024-09-10T05:56:48.778365+0000","last_fullsized":"2024-09-10T05:56:48.778365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":103,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815038+0000","last_change":"2024-09-10T05:56:23.041678+0000","last_active":"2024-09-10T05:56:48.815038+0000","last_peered":"2024-09-10T05:56:48.815038+0000","last_clean":"2024-09-10T05:56:48.815038+0000","last_became_active":"2024-09-10T05:56:23.040913+0000","last_became_peered":"2024-09-10T05:56:23.040913+0000","last_unstale":"2024-09-10T05:56:48.815038+0000","last_undegraded":"2024-09-10T05:56:48.815038+0000","last_fullsized":"2024-09-10T05:56:48.815038+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:42.175576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.821973+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:56:48.821973+0000","last_peered":"2024-09-10T05:56:48.821973+0000","last_clean":"2024-09-10T05:56:48.821973+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:56:48.821973+0000","last_undegraded":"2024-09-10T05:56:48.821973+0000","last_fullsized":"2024-09-10T05:56:48.821973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.897194+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:56:49.897194+0000","last_peered":"2024-09-10T05:56:49.897194+0000","last_clean":"2024-09-10T05:56:49.897194+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:56:49.897194+0000","last_undegraded":"2024-09-10T05:56:49.897194+0000","last_fullsized":"2024-09-10T05:56:49.897194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.815966+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:56:48.815966+0000","last_peered":"2024-09-10T05:56:48.815966+0000","last_clean":"2024-09-10T05:56:48.815966+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:56:48.815966+0000","last_undegraded":"2024-09-10T05:56:48.815966+0000","last_fullsized":"2024-09-10T05:56:48.815966+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":37,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.615348+0000","last_change":"2024-09-10T05:56:23.040862+0000","last_active":"2024-09-10T05:56:49.615348+0000","last_peered":"2024-09-10T05:56:49.615348+0000","last_clean":"2024-09-10T05:56:49.615348+0000","last_became_active":"2024-09-10T05:56:23.040554+0000","last_became_peered":"2024-09-10T05:56:23.040554+0000","last_unstale":"2024-09-10T05:56:49.615348+0000","last_undegraded":"2024-09-10T05:56:49.615348+0000","last_fullsized":"2024-09-10T05:56:49.615348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:05.730570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.818854+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:56:48.818854+0000","last_peered":"2024-09-10T05:56:48.818854+0000","last_clean":"2024-09-10T05:56:48.818854+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:56:48.818854+0000","last_undegraded":"2024-09-10T05:56:48.818854+0000","last_fullsized":"2024-09-10T05:56:48.818854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":103,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.814626+0000","last_change":"2024-09-10T05:56:23.022264+0000","last_active":"2024-09-10T05:56:48.814626+0000","last_peered":"2024-09-10T05:56:48.814626+0000","last_clean":"2024-09-10T05:56:48.814626+0000","last_became_active":"2024-09-10T05:56:23.021493+0000","last_became_peered":"2024-09-10T05:56:23.021493+0000","last_unstale":"2024-09-10T05:56:48.814626+0000","last_undegraded":"2024-09-10T05:56:48.814626+0000","last_fullsized":"2024-09-10T05:56:48.814626+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:17.610734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.791147+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:56:48.791147+0000","last_peered":"2024-09-10T05:56:48.791147+0000","last_clean":"2024-09-10T05:56:48.791147+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:56:48.791147+0000","last_undegraded":"2024-09-10T05:56:48.791147+0000","last_fullsized":"2024-09-10T05:56:48.791147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"66'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.790255+0000","last_change":"2024-09-10T05:55:22.567056+0000","last_active":"2024-09-10T05:56:48.790255+0000","last_peered":"2024-09-10T05:56:48.790255+0000","last_clean":"2024-09-10T05:56:48.790255+0000","last_became_active":"2024-09-10T05:55:22.563015+0000","last_became_peered":"2024-09-10T05:55:22.563015+0000","last_unstale":"2024-09-10T05:56:48.790255+0000","last_undegraded":"2024-09-10T05:56:48.790255+0000","last_fullsized":"2024-09-10T05:56:48.790255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:09.009494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'2","reported_seq":116,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.326357+0000","last_change":"2024-09-10T05:56:23.043355+0000","last_active":"2024-09-10T05:56:49.326357+0000","last_peered":"2024-09-10T05:56:49.326357+0000","last_clean":"2024-09-10T05:56:49.326357+0000","last_became_active":"2024-09-10T05:56:23.042207+0000","last_became_peered":"2024-09-10T05:56:23.042207+0000","last_unstale":"2024-09-10T05:56:49.326357+0000","last_undegraded":"2024-09-10T05:56:49.326357+0000","last_fullsized":"2024-09-10T05:56:49.326357+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:01.926326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:48.786241+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:56:48.786241+0000","last_peered":"2024-09-10T05:56:48.786241+0000","last_clean":"2024-09-10T05:56:48.786241+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:56:48.786241+0000","last_undegraded":"2024-09-10T05:56:48.786241+0000","last_fullsized":"2024-09-10T05:56:48.786241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-10T05:56:49.030051+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:56:49.030051+0000","last_peered":"2024-09-10T05:56:49.030051+0000","last_clean":"2024-09-10T05:56:49.030051+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:56:49.030051+0000","last_undegraded":"2024-09-10T05:56:49.030051+0000","last_fullsized":"2024-09-10T05:56:49.030051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":223,"num_read_kb":211,"num_write":193,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":644,"ondisk_log_size":644,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":21872,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1056,"num_read_kb":783,"num_write":619,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":11856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":775,"ondisk_log_size":775,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":264,"num_read_kb":264,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":988,"num_read_kb":972,"num_write":200,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":48,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40764,"kb_used_data":9580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331076,"statfs":{"total":96636764160,"available":96595021824,"internally_reserved":0,"allocated":9809920,"data_stored":9399945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":4892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":5009408,"data_stored":4616162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40224,"kb_used_data":9040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331616,"statfs":{"total":96636764160,"available":96595574784,"internally_reserved":0,"allocated":9256960,"data_stored":8811445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38112,"kb_used_data":6924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333728,"statfs":{"total":96636764160,"available":96597737472,"internally_reserved":0,"allocated":7090176,"data_stored":6712813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42308,"kb_used_data":6960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329532,"statfs":{"total":96636764160,"available":96593440768,"internally_reserved":0,"allocated":7127040,"data_stored":6714113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":794624,"data_stored":420063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38212,"kb_used_data":2864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333628,"statfs":{"total":96636764160,"available":96597635072,"internally_reserved":0,"allocated":2932736,"data_stored":2518870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51052,"kb_used_data":15708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94320788,"statfs":{"total":96636764160,"available":96584486912,"internally_reserved":0,"allocated":16084992,"data_stored":15691243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:56:53.099 INFO:tasks.thrashosds.thrasher:Setting 4.23 to [0, 3] 2024-09-10T05:56:53.099 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.23', '0', '3'] 2024-09-10T05:56:53.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.23 0 3 2024-09-10T05:56:53.171 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:53.169+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:53.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:53.250 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:53.250 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:53.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:53.250 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4251.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 101.004340709, 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088920690000000007, 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4251", 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/1145776937", 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:56:53.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243750+0000", 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0137e-05 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243764+0000", 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3343000000000001e-05 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243794+0000", 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0239999999999998e-05 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243817+0000", 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824e-05 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.246388+0000", 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025713670000000002 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.246410+0000", 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2480000000000002e-05 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249256+0000", 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002845509 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249567+0000", 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031058799999999999 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249992+0000", 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042563699999999998 2024-09-10T05:56:53.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252356+0000", 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002363502 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252407+0000", 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1165999999999998e-05 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252528+0000", 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121363 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252632+0000", 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010391300000000001 2024-09-10T05:56:53.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4251.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 98.996008481000004, 2024-09-10T05:56:53.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010958255, 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4251", 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/1145776937", 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-10T05:56:53.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252076+0000", 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252099+0000", 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3153e-05 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252137+0000", 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7666999999999997e-05 2024-09-10T05:56:53.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252155+0000", 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8609000000000001e-05 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252327+0000", 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171569 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:53.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252348+0000", 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1263999999999998e-05 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.259952+0000", 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076040960000000003 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.260114+0000", 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161886 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.260335+0000", 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022080099999999999 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.261869+0000", 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001534058 2024-09-10T05:56:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.262871+0000", 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001001643 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.262960+0000", 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9666000000000005e-05 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.263031+0000", 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0290000000000006e-05 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 82.631145267999997, 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010468468, 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 48 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616939+0000", 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4599999999999999e-06 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616954+0000", 2024-09-10T05:56:53.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4610000000000001e-05 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616989+0000", 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5797000000000003e-05 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617046+0000", 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6433e-05 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617244+0000", 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019829299999999999 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617263+0000", 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9125000000000001e-05 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621042+0000", 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003778965 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621238+0000", 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019574800000000001 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621490+0000", 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025198700000000001 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.623910+0000", 2024-09-10T05:56:53.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024204529999999999 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627203+0000", 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032926129999999998 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627317+0000", 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114281 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627404+0000", 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6703e-05 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.276 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:381 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.276 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:56:53.276 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.470426283999998, 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065762249999999998, 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 381 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:56:53.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777656+0000", 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.826e-06 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777668+0000", 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1963999999999999e-05 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777693+0000", 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4640000000000001e-05 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777712+0000", 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9193000000000001e-05 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777906+0000", 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019432799999999999 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.778802+0000", 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00089519199999999995 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.779325+0000", 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052333600000000001 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.780468+0000", 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001142716 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783996+0000", 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003528411 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784121+0000", 2024-09-10T05:56:53.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124843 2024-09-10T05:56:53.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784231+0000", 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109776 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:390 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.466451548999999, 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055076079999999998, 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 390 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781631+0000", 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.61e-06 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781639+0000", 2024-09-10T05:56:53.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2230000000000007e-06 2024-09-10T05:56:53.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781664+0000", 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5092999999999998e-05 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781682+0000", 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7487e-05 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781823+0000", 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014109499999999999 2024-09-10T05:56:53.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782162+0000", 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033949099999999998 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782672+0000", 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050964000000000001 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784363+0000", 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016913799999999999 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786905+0000", 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025418870000000001 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787043+0000", 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013796899999999999 2024-09-10T05:56:53.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787137+0000", 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3733000000000005e-05 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:393 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.465513741999999, 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077284750000000003, 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 393 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782570+0000", 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9500000000000001e-06 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782585+0000", 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4610000000000001e-05 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782659+0000", 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4536000000000006e-05 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782685+0000", 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6210000000000001e-05 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782834+0000", 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148422 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783053+0000", 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021885200000000001 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783516+0000", 2024-09-10T05:56:53.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046384699999999998 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784646+0000", 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001129283 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789993+0000", 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005347437 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790140+0000", 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014694299999999999 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790295+0000", 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015538499999999999 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:396 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.296 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.462729757000005, 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051714830000000002, 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 396 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785354+0000", 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785366+0000", 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2310000000000001e-05 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785400+0000", 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3696999999999999e-05 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785423+0000", 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3099999999999999e-05 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785532+0000", 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010885199999999999 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785678+0000", 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014572599999999999 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785955+0000", 2024-09-10T05:56:53.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000277285 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787555+0000", 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00160023 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790318+0000", 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027628000000000002 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790435+0000", 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117068 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790522+0000", 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7287999999999995e-05 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:407 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.457715941000004, 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006264721, 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 407 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790367+0000", 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790377+0000", 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8400000000000007e-06 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790400+0000", 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3597000000000001e-05 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790421+0000", 2024-09-10T05:56:53.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0265999999999999e-05 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790569+0000", 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014849899999999999 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790848+0000", 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000278845 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791347+0000", 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049885700000000001 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792836+0000", 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014886579999999999 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796350+0000", 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035142009999999998 2024-09-10T05:56:53.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796503+0000", 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015316200000000001 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796630+0000", 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126556 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:428 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.452339944000002, 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066193700000000003, 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 428 2024-09-10T05:56:53.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795742+0000", 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5859999999999999e-06 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795751+0000", 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4630000000000001e-06 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795777+0000", 2024-09-10T05:56:53.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795795+0000", 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8604e-05 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795908+0000", 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112161 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796099+0000", 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019159600000000001 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796749+0000", 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065039299999999998 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.798354+0000", 2024-09-10T05:56:53.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016048569999999999 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802104+0000", 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037494389999999998 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802245+0000", 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141433 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802360+0000", 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114945 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:510 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.432695185, 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060473189999999998, 2024-09-10T05:56:53.315 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 510 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815388+0000", 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5840000000000002e-06 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815401+0000", 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2768e-05 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815420+0000", 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9585999999999998e-05 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815433+0000", 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2882e-05 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815534+0000", 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100849 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815790+0000", 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025556100000000002 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816121+0000", 2024-09-10T05:56:53.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000331016 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.817470+0000", 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013493439999999999 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821255+0000", 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037850499999999999 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821358+0000", 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102737 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821433+0000", 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4942000000000002e-05 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:530 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.426317651999994, 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051103920000000001, 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 530 2024-09-10T05:56:53.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821764+0000", 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2780000000000001e-06 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821772+0000", 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6639999999999998e-06 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821806+0000", 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4264000000000003e-05 2024-09-10T05:56:53.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821829+0000", 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2691999999999999e-05 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821928+0000", 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8968999999999994e-05 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822167+0000", 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023884199999999999 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822520+0000", 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035353400000000002 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824363+0000", 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018423619999999999 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826759+0000", 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023964469999999999 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826828+0000", 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9035999999999994e-05 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826873+0000", 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5303999999999999e-05 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:564 6.4 e36/30 6:2166d8e1:gc::gc.3:head v 36'11, mlcod=36'9)", 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.414534431999996, 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061892409999999998, 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833547+0000", 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-10T05:56:53.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833560+0000", 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2405999999999999e-05 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833576+0000", 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6409000000000002e-05 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833588+0000", 2024-09-10T05:56:53.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1419e-05 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833675+0000", 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7739999999999997e-05 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833709+0000", 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3303999999999998e-05 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839674+0000", 2024-09-10T05:56:53.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059653070000000004 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839736+0000", 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1686999999999994e-05 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:566 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:56:53.332 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.413747615999995, 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054717589999999997, 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 566 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834335+0000", 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7260000000000001e-06 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834351+0000", 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6415000000000001e-05 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834376+0000", 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4615000000000001e-05 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834397+0000", 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1083000000000001e-05 2024-09-10T05:56:53.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834495+0000", 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7805000000000003e-05 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834630+0000", 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135594 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834912+0000", 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028163199999999998 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.835936+0000", 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001024205 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839651+0000", 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037152940000000001 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839738+0000", 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6007000000000005e-05 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839805+0000", 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7383000000000002e-05 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.338 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:828 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.336090824999999, 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00558758, 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 828 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911991+0000", 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1570000000000001e-06 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911997+0000", 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0349999999999998e-06 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912009+0000", 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1824999999999999e-05 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912017+0000", 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2879999999999993e-06 2024-09-10T05:56:53.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912078+0000", 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0869000000000003e-05 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912145+0000", 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7222000000000001e-05 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912278+0000", 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013305700000000001 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.913176+0000", 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000897213 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917462+0000", 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042859439999999999 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917526+0000", 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849000000000002e-05 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917578+0000", 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1121000000000001e-05 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:841 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.329707811000006, 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053076190000000004, 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 841 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918374+0000", 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.64e-07 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918379+0000", 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8670000000000002e-06 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918390+0000", 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.134e-05 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918395+0000", 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3360000000000002e-06 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918442+0000", 2024-09-10T05:56:53.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6817999999999998e-05 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918501+0000", 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8461999999999997e-05 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918620+0000", 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119731 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.919469+0000", 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084865199999999998 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923609+0000", 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041400059999999999 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923654+0000", 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4413000000000003e-05 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923681+0000", 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.703e-05 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:843 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 79.327286701000006, 2024-09-10T05:56:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056796060000000002, 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 843 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:56:53.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920795+0000", 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0809999999999999e-06 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920800+0000", 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7670000000000003e-06 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920815+0000", 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4848000000000001e-05 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920823+0000", 2024-09-10T05:56:53.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8089999999999993e-06 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920885+0000", 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2675999999999994e-05 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920951+0000", 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5401999999999995e-05 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:53.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.921085+0000", 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.922066+0000", 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098162100000000001 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926361+0000", 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042945659999999997 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926424+0000", 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3357999999999999e-05 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926474+0000", 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9360000000000002e-05 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.6858616739999999, 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.358 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:56:53.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.363 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.6590508860000002, 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:56:53.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:56:53.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.827206093, 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.370 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:56:53.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1812 3.30 3:0f16d871:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.819127699, 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017116908, 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:53.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1812 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428955+0000", 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6700000000000001e-06 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431687+0000", 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002732342 2024-09-10T05:56:53.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431712+0000", 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5114e-05 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431725+0000", 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2976000000000001e-05 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:53.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431862+0000", 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013720799999999999 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432067+0000", 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205028 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432272+0000", 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205105 2024-09-10T05:56:53.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.439520+0000", 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072476550000000004 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445702+0000", 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061817640000000002 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:53.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445898+0000", 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195928 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446070+0000", 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017211799999999999 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:53.382 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:53.383 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:53.384 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:53.385 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:53.385 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:53.385 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:53.386 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:53.386 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:53.387 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:53.387 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:53.387 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:53.381+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:53.387 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:53.388 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:53.407 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:53.407 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:53.427 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:53.427 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:53.446 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:53.446 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:53.485 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:53.481+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:53.556 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:53.557 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:53.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:53.615 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:53.613+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:53.689 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:53.685+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:53.738 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:53.738 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:53.752 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:53.790 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:53.789+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:53.795 INFO:teuthology.orchestra.run.smithi070.stderr:set 4.23 pg_upmap mapping to [0,3] 2024-09-10T05:56:53.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:56:53.877 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:53.877 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:53.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:53.894 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:53.889+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:53.995 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:53.993+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:54.058 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:54.058 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:54.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:54.119 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:54.117+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:54.197 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:54.198 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:54.198 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:54.193+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:54.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:54.301 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:54.297+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:54.381 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:54.381 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:54.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:54.443 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:54.441+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:54.504 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:54.501+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:54.511 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:54.511 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:54.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:54.605 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:54.601+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:54.681 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:54.681 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:54.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:54.739 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:54.737+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:54.805 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:56:54.807 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:54.805+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:54.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:54.919 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:54.917+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:54.997 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:54.998 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:55.008 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:55.005+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:55.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:55.109 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:55.105+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:55.161 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:55.161 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:55.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:55.218 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:55.217+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:55.300 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:55.300 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:55.312 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:55.309+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:55.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:56:55.413 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:55.409+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:55.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:56:55.470 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:55.471 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:55.485 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:56:55.529 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:55.525+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:55.530 INFO:tasks.workunit.client.0.smithi070.stdout:quota enabled for the bucket: buck_2024_08_10_05_56_51 2024-09-10T05:56:55.530 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 2Gb. 2024-09-10T05:56:55.530 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:55.530 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-09-10T05:56:55.530 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:56:55.530 INFO:tasks.workunit.client.0.smithi070.stdout:delete objects successful 2024-09-10T05:56:55.598 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:55.598 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:55.614 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:55.613+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:55.616 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:55.617 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:55.633 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:55.634 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:55.644 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:55.644 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:55.644 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:55.644 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:55.644 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:55.650 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:55.650 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:55.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:56:55.672 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:55.672 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:55.693 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:55.693 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:55.714 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:55.714 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:55.715 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:55.713+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:55.735 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:55.735 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:55.778 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:55.778 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.146965707000007, 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:56:55.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.785 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 85.142054139999999, 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:56:55.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:56:55.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.029561084999997, 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:56:55.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:56:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:56:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:56:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:56:55.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:55.800 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.024713797000004, 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:56:55.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:56:55.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:56:55.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.011985136000007, 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:56:55.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.813 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.977601316000005, 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:56:55.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:56:55.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:56:55.819 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.971833316000001, 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:56:55.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:56:55.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.971241340999995, 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:56:55.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:56:55.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:56:55.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:56:55.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.967808845999997, 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:56:55.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:56:55.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.964872904000003, 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:56:55.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:56:55.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:56:55.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.813729170000002, 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:55.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:56:55.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.854 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.553358317000004, 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:56:55.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.549337696999999, 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:56:55.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:55.868 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.539893430000006, 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:56:55.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:56:55.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:56:55.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.535972301000001, 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.876 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:55.882 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.494979556999994, 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:56:55.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:56:55.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:56:55.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.324450170000006, 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:56:55.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:56:55.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.895 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.312984145000001, 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:56:55.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:56:55.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4865.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0638107310000002, 2024-09-10T05:56:55.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054676530000000003, 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4865", 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/4085573642", 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 50 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714146+0000", 2024-09-10T05:56:55.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0999999999999997e-07 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714150+0000", 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714161+0000", 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714166+0000", 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4639999999999997e-06 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714219+0000", 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2574000000000002e-05 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714269+0000", 2024-09-10T05:56:55.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0351e-05 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714347+0000", 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8499999999999997e-05 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714798+0000", 2024-09-10T05:56:55.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045035000000000002 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719534+0000", 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047363489999999999 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719565+0000", 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1087999999999998e-05 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719613+0000", 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.774e-05 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2486 4.34 4:2f069146:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:51.382755+0000", 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3952008229999997, 2024-09-10T05:56:55.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003194185, 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2486 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382755+0000", 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382755+0000", 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382758+0000", 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:55.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382769+0000", 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1226000000000001e-05 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382793+0000", 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4158000000000001e-05 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382803+0000", 2024-09-10T05:56:55.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0282000000000001e-05 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382872+0000", 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8889999999999999e-05 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.383009+0000", 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013705 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:55.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.383111+0000", 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001016 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.383882+0000", 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077086099999999996 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.385896+0000", 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020142409999999999 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.385926+0000", 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0159e-05 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.385949+0000", 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3337e-05 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:55.916 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:55.917 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:55.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:56:55.919 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:55.913+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:56.019 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:56.017+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:56.070 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:56.071 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:56.071 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:56:56.071 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:56.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:56:56.135 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:56.133+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:56.221 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:56.217+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:56.223 INFO:tasks.workunit.client.0.smithi070.stderr:100+0 records in 2024-09-10T05:56:56.223 INFO:tasks.workunit.client.0.smithi070.stderr:100+0 records out 2024-09-10T05:56:56.223 INFO:tasks.workunit.client.0.smithi070.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.690956 s, 1.5 GB/s 2024-09-10T05:56:56.246 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:56.246 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:56:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:56:56.247 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:56:56.247 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:56.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:56:56.321 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:56.321+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:56.385 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:56:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:56:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:56:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:56:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.385 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.756969452999996, 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.386 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.707766645000007, 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031728350000000002, 2024-09-10T05:56:56.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 216 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676745+0000", 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676749+0000", 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676762+0000", 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3743e-05 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676794+0000", 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1912999999999998e-05 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676811+0000", 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.611e-05 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.676929+0000", 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118893 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677155+0000", 2024-09-10T05:56:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022600800000000001 2024-09-10T05:56:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.677567+0000", 2024-09-10T05:56:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000411223 2024-09-10T05:56:56.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.678862+0000", 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001295203 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679716+0000", 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00085393000000000003 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679804+0000", 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7806000000000006e-05 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.679918+0000", 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114636 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:425 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.587703982999997, 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003332967, 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 425 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796808+0000", 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796809+0000", 2024-09-10T05:56:56.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.333e-06 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796816+0000", 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9700000000000002e-06 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796832+0000", 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5423000000000001e-05 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796842+0000", 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0579e-05 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.796907+0000", 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4844000000000005e-05 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797004+0000", 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:56:56.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797163+0000", 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159786 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.797756+0000", 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00059256599999999999 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800043+0000", 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022874499999999999 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800099+0000", 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5547999999999997e-05 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800141+0000", 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2073000000000002e-05 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:441 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.583680123999997, 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004534644, 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 441 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800832+0000", 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800833+0000", 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.113e-06 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800839+0000", 2024-09-10T05:56:56.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9390000000000002e-06 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800847+0000", 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4190000000000002e-06 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800857+0000", 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.149e-06 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800923+0000", 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6914000000000003e-05 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800987+0000", 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3241e-05 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801160+0000", 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017361899999999999 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801876+0000", 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00071587699999999996 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805261+0000", 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033848870000000001 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805321+0000", 2024-09-10T05:56:56.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9963000000000002e-05 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805367+0000", 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5522999999999998e-05 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:445 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:56.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.583112557000007, 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042667030000000002, 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 445 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:56.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801399+0000", 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801401+0000", 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.217e-06 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801407+0000", 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2650000000000002e-06 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801419+0000", 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2213e-05 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801427+0000", 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0330000000000008e-06 2024-09-10T05:56:56.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801505+0000", 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7478999999999995e-05 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801612+0000", 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000107292 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801764+0000", 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151552 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802314+0000", 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055030300000000003 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805549+0000", 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032352180000000002 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805615+0000", 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6420000000000004e-05 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.805666+0000", 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0711000000000003e-05 2024-09-10T05:56:56.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:513 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.565819970999996, 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032217729999999998, 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 513 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818692+0000", 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818693+0000", 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3740000000000001e-06 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818699+0000", 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4140000000000002e-06 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818710+0000", 2024-09-10T05:56:56.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294000000000001e-05 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818716+0000", 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0109999999999997e-06 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818785+0000", 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8363999999999998e-05 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818923+0000", 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013869800000000001 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.819151+0000", 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022798 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.820047+0000", 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00089604400000000003 2024-09-10T05:56:56.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821856+0000", 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018091209999999999 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821886+0000", 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9175000000000001e-05 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.821914+0000", 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8297999999999999e-05 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:557 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.549494121999999, 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033141030000000001, 2024-09-10T05:56:56.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 557 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835018+0000", 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835019+0000", 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1459999999999999e-06 2024-09-10T05:56:56.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835024+0000", 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3020000000000002e-06 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835037+0000", 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2523e-05 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835045+0000", 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1769999999999998e-06 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835115+0000", 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9496e-05 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835239+0000", 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012468900000000001 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835360+0000", 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000120914 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.835867+0000", 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050690999999999996 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838273+0000", 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024059519999999998 2024-09-10T05:56:56.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838307+0000", 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3575000000000003e-05 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.838332+0000", 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5418999999999998e-05 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:825 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.472359409999996, 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056639289999999998, 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 825 2024-09-10T05:56:56.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912153+0000", 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912154+0000", 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.297e-06 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912168+0000", 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4260000000000001e-05 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912183+0000", 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4657e-05 2024-09-10T05:56:56.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912193+0000", 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9930000000000007e-06 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912266+0000", 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3633999999999993e-05 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912379+0000", 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011234300000000001 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.912510+0000", 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013166100000000001 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.913078+0000", 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056757800000000001 2024-09-10T05:56:56.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917716+0000", 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046378230000000001 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917772+0000", 2024-09-10T05:56:56.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6072000000000001e-05 2024-09-10T05:56:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.917817+0000", 2024-09-10T05:56:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4610999999999997e-05 2024-09-10T05:56:56.439 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:831 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.466358017999994, 2024-09-10T05:56:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054088199999999999, 2024-09-10T05:56:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.441 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 831 2024-09-10T05:56:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918154+0000", 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918155+0000", 2024-09-10T05:56:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7800000000000001e-07 2024-09-10T05:56:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918158+0000", 2024-09-10T05:56:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4640000000000002e-06 2024-09-10T05:56:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918167+0000", 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0170000000000002e-06 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918172+0000", 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8169999999999998e-06 2024-09-10T05:56:56.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918220+0000", 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7611000000000002e-05 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918287+0000", 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7372000000000005e-05 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918386+0000", 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9351999999999993e-05 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.918851+0000", 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00046462000000000001 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923458+0000", 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046066350000000004 2024-09-10T05:56:56.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923516+0000", 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8681000000000003e-05 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.923563+0000", 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6573000000000003e-05 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:909 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.437710793999997, 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050071639999999997, 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 909 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946801+0000", 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946802+0000", 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2900000000000003e-07 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946807+0000", 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4399999999999996e-06 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946817+0000", 2024-09-10T05:56:56.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5640000000000002e-06 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946822+0000", 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7679999999999999e-06 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946865+0000", 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3460000000000001e-05 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.946919+0000", 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3304999999999999e-05 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947027+0000", 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010896 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.947505+0000", 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047783999999999999 2024-09-10T05:56:56.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951751+0000", 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042457040000000003 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951784+0000", 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.951808+0000", 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:927 6.1f 6:fd8d39b6:::obj_delete_at_hint.0000000030:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.429520573999994, 2024-09-10T05:56:56.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055542270000000001, 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 927 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954991+0000", 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954992+0000", 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6899999999999996e-07 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.954996+0000", 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0550000000000001e-06 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955008+0000", 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1885999999999999e-05 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955016+0000", 2024-09-10T05:56:56.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3830000000000003e-06 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955076+0000", 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0591999999999999e-05 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955170+0000", 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3517999999999995e-05 2024-09-10T05:56:56.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955379+0000", 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000208853 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.955895+0000", 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051614599999999999 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960457+0000", 2024-09-10T05:56:56.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045619809999999997 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960489+0000", 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1829999999999998e-05 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.960546+0000", 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7114000000000002e-05 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1069 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.363883086000001, 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039288120000000003, 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1069 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020629+0000", 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020630+0000", 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3500000000000005e-07 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020633+0000", 2024-09-10T05:56:56.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5370000000000002e-06 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020642+0000", 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0550000000000005e-06 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020649+0000", 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7460000000000003e-06 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020699+0000", 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0288999999999999e-05 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020758+0000", 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9033999999999998e-05 2024-09-10T05:56:56.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.020861+0000", 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102457 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.021347+0000", 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048650899999999999 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024501+0000", 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031532539999999999 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024534+0000", 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3633999999999997e-05 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.024558+0000", 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3462e-05 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1074 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.357123271999995, 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032681189999999999, 2024-09-10T05:56:56.470 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1074 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027389+0000", 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027390+0000", 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3699999999999999e-07 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027394+0000", 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6040000000000003e-06 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027407+0000", 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602999999999999e-05 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027415+0000", 2024-09-10T05:56:56.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2800000000000003e-06 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027471+0000", 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5506e-05 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027522+0000", 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1498000000000001e-05 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.027651+0000", 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128949 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.028125+0000", 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047413199999999999 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030600+0000", 2024-09-10T05:56:56.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024746809999999998 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030632+0000", 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2407999999999999e-05 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.030657+0000", 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4521000000000001e-05 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1079 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.353294063000007, 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047733469999999998, 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1079 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031218+0000", 2024-09-10T05:56:56.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031219+0000", 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8100000000000002e-07 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031221+0000", 2024-09-10T05:56:56.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8040000000000002e-06 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031229+0000", 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9659999999999996e-06 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031234+0000", 2024-09-10T05:56:56.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.172e-06 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031278+0000", 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4456999999999998e-05 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031323+0000", 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4706999999999997e-05 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031426+0000", 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103696 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.031951+0000", 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000524272 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035934+0000", 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039832269999999998 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035965+0000", 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0654999999999997e-05 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.035991+0000", 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.671e-05 2024-09-10T05:56:56.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1189 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.240280499999997, 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054397639999999997, 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1189 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144232+0000", 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144233+0000", 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8199999999999999e-06 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144240+0000", 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9500000000000004e-06 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144256+0000", 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6146000000000001e-05 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144279+0000", 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2779999999999999e-05 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144375+0000", 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5506000000000003e-05 2024-09-10T05:56:56.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144571+0000", 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019616699999999999 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.144859+0000", 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028786099999999999 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.145645+0000", 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078586499999999996 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149522+0000", 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038775329999999998 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149612+0000", 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9630999999999996e-05 2024-09-10T05:56:56.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.149671+0000", 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9505e-05 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.490 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1282 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 82.045938212999999, 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033190699999999999, 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1282 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338574+0000", 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338576+0000", 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4200000000000001e-06 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338590+0000", 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.36e-05 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338620+0000", 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0216e-05 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338635+0000", 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5147000000000001e-05 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.338792+0000", 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000157295 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339163+0000", 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000370627 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.339704+0000", 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054042900000000004 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.340937+0000", 2024-09-10T05:56:56.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001233778 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341740+0000", 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00080283999999999998 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341825+0000", 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4332999999999994e-05 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.341893+0000", 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8385000000000003e-05 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "MOSDPGPush(6.11 58/57 [PushOp(6:8eb99c53:gc::gc.22:head, version: 36'7, data_included: [0~110], data_size: 110, omap_header_size: 0, omap_entries_size: 0, attrset_size: 4, recovery_info: ObjectRecoveryInfo(6:8eb99c53:gc::gc.22:head@36'7, size: 110, copy_subset: [(0, 110)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 110, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:56.497 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.354666358999999, 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034789270000000001, 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029846+0000", 2024-09-10T05:56:56.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3200000000000004e-07 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.029859+0000", 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2537e-05 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030586+0000", 2024-09-10T05:56:56.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00072692399999999999 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030608+0000", 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2311999999999999e-05 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030725+0000", 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011652199999999999 2024-09-10T05:56:56.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.030784+0000", 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9029e-05 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:23.033325+0000", 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025408710000000001 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1783 4.11 4:8a160c10:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.3167148970000007, 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0035774140000000001, 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1783 2024-09-10T05:56:56.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067797+0000", 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067798+0000", 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4700000000000001e-07 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067801+0000", 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5920000000000001e-06 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067816+0000", 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4591e-05 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067821+0000", 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9309999999999999e-06 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067873+0000", 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2206999999999997e-05 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.067983+0000", 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110308 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.068132+0000", 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014854500000000001 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.069183+0000", 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010506879999999999 2024-09-10T05:56:56.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071286+0000", 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021033850000000002 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071336+0000", 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9783000000000001e-05 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.071375+0000", 2024-09-10T05:56:56.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8736999999999999e-05 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9514474509999999, 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.509 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1948 3.19 e66/57 3:9ae3dc4d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_2:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:56:56.514 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.972337928, 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079042509999999993, 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:56:56.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412177+0000", 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.729e-06 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414422+0000", 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022448400000000001 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414451+0000", 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9152000000000001e-05 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414470+0000", 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9487000000000002e-05 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414592+0000", 2024-09-10T05:56:56.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121329 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414626+0000", 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4696000000000001e-05 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.419964+0000", 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053377160000000002 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:56:56.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420078+0000", 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114302 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:56:56.519 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:56:56.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:56:56.521 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:56.517+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:56.622 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:56:56.617+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:56:56.654 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:56.654 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:56.654 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:56.654 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:56.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:56:56.755 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:56.753+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:56.823 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:56.820+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:56.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:56:56.837 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:56.837 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:56.837 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:56.837 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:56.837 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:56.851 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:56:56.939 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:56.937+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 88.463900409000004, 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.029 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:56:57.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:56:57.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:47 7.1f e33/32 7:f95f44c2:::notify.0:head v 33'2, mlcod=0'0)", 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 86.404298738999998, 2024-09-10T05:56:57.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044359259999999998, 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617581+0000", 2024-09-10T05:56:57.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617583+0000", 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.869e-06 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617595+0000", 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2116999999999999e-05 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617626+0000", 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0750999999999997e-05 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617642+0000", 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6348999999999999e-05 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617788+0000", 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146217 2024-09-10T05:56:57.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617840+0000", 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2116e-05 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621904+0000", 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040636739999999998 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.622017+0000", 2024-09-10T05:56:57.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112833 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.373630411999997, 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010770752999999999, 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.039 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 211 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648249+0000", 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648254+0000", 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7129999999999996e-06 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648272+0000", 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8219999999999998e-05 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648318+0000", 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.587e-05 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648342+0000", 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3963000000000001e-05 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648512+0000", 2024-09-10T05:56:57.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016986900000000001 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.648523+0000", 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1377e-05 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655659+0000", 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071362480000000004 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.655842+0000", 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183003 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.656217+0000", 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037440800000000001 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.657607+0000", 2024-09-10T05:56:57.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013897639999999999 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658836+0000", 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012289950000000001 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.658947+0000", 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111366 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.659020+0000", 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2957e-05 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:328 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.255682863000004, 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004524508, 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 328 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766197+0000", 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766199+0000", 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2199999999999999e-06 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766213+0000", 2024-09-10T05:56:57.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4355999999999999e-05 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766242+0000", 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8402999999999999e-05 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766260+0000", 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8297000000000001e-05 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766410+0000", 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015023900000000001 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.766619+0000", 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208459 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.767056+0000", 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043738400000000003 2024-09-10T05:56:57.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.769959+0000", 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029030219999999999 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770483+0000", 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052370300000000004 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770611+0000", 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012793900000000001 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.770721+0000", 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110486 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:469 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'8, mlcod=36'5)", 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.217523889999995, 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044680279999999998, 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804356+0000", 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804357+0000", 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.375e-06 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804371+0000", 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3742e-05 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804397+0000", 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6667000000000001e-05 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804413+0000", 2024-09-10T05:56:57.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5452999999999999e-05 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804522+0000", 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010861000000000001 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.804565+0000", 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3645e-05 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808669+0000", 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041042750000000001 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808824+0000", 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015426099999999999 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:482 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.057 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.214583814999997, 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050750819999999999, 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 482 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807296+0000", 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807298+0000", 2024-09-10T05:56:57.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807310+0000", 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1331999999999999e-05 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807339+0000", 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9203000000000001e-05 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807359+0000", 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0057000000000001e-05 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807796+0000", 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043656800000000003 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.807973+0000", 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017780399999999999 2024-09-10T05:56:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.808362+0000", 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038843200000000002 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.809521+0000", 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591279999999999 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812136+0000", 2024-09-10T05:56:57.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026146680000000001 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812266+0000", 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012996700000000001 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812371+0000", 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010532899999999999 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:496 6.14 e36/30 6:2e7dc4d8:lc::lc.22:head v 36'10, mlcod=36'8)", 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.211283499000004, 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004539492, 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:57.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810596+0000", 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810598+0000", 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5889999999999999e-06 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810607+0000", 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8060000000000006e-06 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810627+0000", 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9307999999999999e-05 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810642+0000", 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5043e-05 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810745+0000", 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103476 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810775+0000", 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9731999999999999e-05 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815033+0000", 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042580270000000002 2024-09-10T05:56:57.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815136+0000", 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010251099999999999 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:500 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.211059598000006, 2024-09-10T05:56:57.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004877139, 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 500 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:57.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810820+0000", 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810822+0000", 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2369999999999999e-06 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810831+0000", 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2029999999999998e-06 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810856+0000", 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5069999999999999e-05 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810872+0000", 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5716999999999999e-05 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.810987+0000", 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114671 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811119+0000", 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013172699999999999 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.811360+0000", 2024-09-10T05:56:57.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024131399999999999 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.812482+0000", 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011221339999999999 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815444+0000", 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002961553 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815584+0000", 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014047899999999999 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815697+0000", 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113034 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.074 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:508 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.207828395999996, 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043977, 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 508 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814051+0000", 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814053+0000", 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8470000000000001e-06 2024-09-10T05:56:57.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814063+0000", 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7310000000000005e-06 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814085+0000", 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2667000000000002e-05 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814102+0000", 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6877000000000001e-05 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814239+0000", 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013692899999999999 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814512+0000", 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027235300000000003 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.814884+0000", 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037204799999999999 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816043+0000", 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011591939999999999 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818310+0000", 2024-09-10T05:56:57.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022670580000000002 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818396+0000", 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6339000000000001e-05 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818449+0000", 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2657000000000001e-05 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:516 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.203224931999998, 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059518449999999999, 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 516 2024-09-10T05:56:57.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818655+0000", 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818656+0000", 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7400000000000001e-06 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818665+0000", 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.49e-06 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818688+0000", 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3269e-05 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818707+0000", 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8403e-05 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818837+0000", 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013014 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819032+0000", 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019494799999999999 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819292+0000", 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025996400000000001 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821071+0000", 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001779884 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824447+0000", 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033759580000000001 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824538+0000", 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0257e-05 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824606+0000", 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8792000000000001e-05 2024-09-10T05:56:57.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:518 6.2 6:4455f95b:lc::lc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.202896779, 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005046638, 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 518 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818983+0000", 2024-09-10T05:56:57.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818984+0000", 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6670000000000001e-06 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.818992+0000", 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1029999999999996e-06 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819012+0000", 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0849e-05 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819028+0000", 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5258e-05 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819116+0000", 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8380000000000004e-05 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819208+0000", 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1822000000000003e-05 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.819414+0000", 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020572900000000001 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.820610+0000", 2024-09-10T05:56:57.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011959340000000001 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823868+0000", 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032583410000000001 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.823961+0000", 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2944999999999999e-05 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824029+0000", 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8609999999999995e-05 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:527 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.200291105999995, 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055338990000000001, 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.093 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 527 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821588+0000", 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821590+0000", 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-06 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821599+0000", 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3459999999999994e-06 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821619+0000", 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9837999999999999e-05 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821660+0000", 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1254000000000002e-05 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821757+0000", 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7033000000000004e-05 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821934+0000", 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017711699999999999 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822179+0000", 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024508800000000002 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826469+0000", 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042896790000000002 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826950+0000", 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048117899999999998 2024-09-10T05:56:57.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827025+0000", 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5527999999999999e-05 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.827122+0000", 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6947000000000005e-05 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:910 6.1e 6:7e82ab18:lc::lc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.077301649999995, 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045075499999999999, 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.100 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944578+0000", 2024-09-10T05:56:57.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944580+0000", 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8500000000000001e-06 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944590+0000", 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0018e-05 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944610+0000", 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9864000000000002e-05 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944622+0000", 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-05 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944718+0000", 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5821000000000003e-05 2024-09-10T05:56:57.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.944820+0000", 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102599 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.945037+0000", 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021656600000000001 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948679+0000", 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003641811 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.948964+0000", 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028527400000000002 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949043+0000", 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9405000000000003e-05 2024-09-10T05:56:57.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.949085+0000", 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2162000000000001e-05 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:923 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.071647655000007, 2024-09-10T05:56:57.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044165810000000002, 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 923 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:57.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950232+0000", 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950233+0000", 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4279999999999999e-06 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950239+0000", 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0519999999999998e-06 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950255+0000", 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5460000000000001e-05 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950266+0000", 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1258e-05 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950362+0000", 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5472999999999999e-05 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950461+0000", 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8929000000000001e-05 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.950754+0000", 2024-09-10T05:56:57.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029323000000000001 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.951584+0000", 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083020700000000002 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954519+0000", 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029352390000000001 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954597+0000", 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7442999999999997e-05 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.954648+0000", 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1861999999999999e-05 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1782 4.22 4:4648cc62:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.112 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.9550834209999994, 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046802019999999996, 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1782 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066796+0000", 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066798+0000", 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5400000000000001e-06 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066806+0000", 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-06 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066827+0000", 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0313e-05 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066837+0000", 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0686000000000001e-05 2024-09-10T05:56:57.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066959+0000", 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012163900000000001 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067192+0000", 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023248400000000001 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:57.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067679+0000", 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048718500000000001 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.070092+0000", 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002413709 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071332+0000", 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001239991 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071408+0000", 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5768999999999999e-05 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071476+0000", 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8085999999999998e-05 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1786 4.13 4:caec078d:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.9549377489999991, 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046975749999999998, 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1786 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066942+0000", 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066943+0000", 2024-09-10T05:56:57.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.403e-06 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066950+0000", 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1729999999999998e-06 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066969+0000", 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8287e-05 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.066976+0000", 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7929999999999998e-06 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067162+0000", 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000185448 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067526+0000", 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036409300000000001 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.067944+0000", 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041810300000000002 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.070177+0000", 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022330470000000002 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071439+0000", 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001261727 2024-09-10T05:56:57.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071558+0000", 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119602 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.071639+0000", 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0898999999999999e-05 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5603537630000002, 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:57.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:56:57.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1917 4.22 4:45f13fff:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.0820670230000005, 2024-09-10T05:56:57.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045099989999999998, 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1917 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939813+0000", 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939815+0000", 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5660000000000001e-06 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939824+0000", 2024-09-10T05:56:57.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1800000000000002e-06 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939844+0000", 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0092e-05 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939855+0000", 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0677e-05 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.939940+0000", 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5173000000000006e-05 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.940128+0000", 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018807700000000001 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.940928+0000", 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079993900000000005 2024-09-10T05:56:57.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944069+0000", 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003140767 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944247+0000", 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177579 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944287+0000", 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0244000000000003e-05 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.944323+0000", 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5704999999999998e-05 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1947 3.3 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:56:57.135 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.6239915240000009, 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018605588999999999, 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1947 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397906+0000", 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402321+0000", 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044157889999999998 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402355+0000", 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3744000000000001e-05 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402371+0000", 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6135999999999999e-05 2024-09-10T05:56:57.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402469+0000", 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7844999999999996e-05 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402634+0000", 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000164644 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:57.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402772+0000", 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137768 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.412200+0000", 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094282930000000008 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416386+0000", 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041860109999999999 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416443+0000", 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6884e-05 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416494+0000", 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0831000000000002e-05 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.141 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1950 3.11 e66/24 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.427508+0000", 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.5943719759999997, 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014287441999999999, 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427508+0000", 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427508+0000", 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427510+0000", 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.858e-06 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430383+0000", 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028730159999999999 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430414+0000", 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0985999999999998e-05 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430428+0000", 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3329000000000001e-05 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430522+0000", 2024-09-10T05:56:57.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4456000000000005e-05 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.430544+0000", 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1355000000000001e-05 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.441724+0000", 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01118043 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.441795+0000", 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1012000000000004e-05 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.146 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:57.147 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:57.020+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:57.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:56:57.148 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:57.145+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:57.248 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:57.245+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:57.318 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:57.318 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:57.318 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:57.318 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:57.333 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:56:57.349 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:57.344+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:57.450 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:57.444+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:57.499 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:57.499 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:57.499 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:56:57.499 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:56:57.499 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:57.513 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:56:57.551 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:57.548+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:57.637 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:57.637 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:56:57.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:56:57.637 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:56:57.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4251.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 105.39002340899999, 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088920690000000007, 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4251", 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/1145776937", 2024-09-10T05:56:57.638 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243740+0000", 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243750+0000", 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0137e-05 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243764+0000", 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3343000000000001e-05 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243794+0000", 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0239999999999998e-05 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.243817+0000", 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824e-05 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.246388+0000", 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025713670000000002 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.246410+0000", 2024-09-10T05:56:57.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2480000000000002e-05 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249256+0000", 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002845509 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249567+0000", 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031058799999999999 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.249992+0000", 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042563699999999998 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252356+0000", 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002363502 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252407+0000", 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1165999999999998e-05 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252528+0000", 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121363 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:12.252632+0000", 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010391300000000001 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4251.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 103.38169118099999, 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010958255, 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4251", 2024-09-10T05:56:57.645 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/1145776937", 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252072+0000", 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252076+0000", 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252099+0000", 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3153e-05 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252137+0000", 2024-09-10T05:56:57.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7666999999999997e-05 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252155+0000", 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8609000000000001e-05 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252327+0000", 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171569 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.252348+0000", 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1263999999999998e-05 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.259952+0000", 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076040960000000003 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.260114+0000", 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161886 2024-09-10T05:56:57.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.260335+0000", 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022080099999999999 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.261869+0000", 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001534058 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.262871+0000", 2024-09-10T05:56:57.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001001643 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.262960+0000", 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9666000000000005e-05 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:14.263031+0000", 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0290000000000006e-05 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 87.016827968000001, 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010468468, 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.652 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 48 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616935+0000", 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616939+0000", 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4599999999999999e-06 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616954+0000", 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4610000000000001e-05 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616989+0000", 2024-09-10T05:56:57.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5797000000000003e-05 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617046+0000", 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6433e-05 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617244+0000", 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019829299999999999 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.617263+0000", 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9125000000000001e-05 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621042+0000", 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003778965 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621238+0000", 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019574800000000001 2024-09-10T05:56:57.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.621490+0000", 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025198700000000001 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.623910+0000", 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024204529999999999 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627203+0000", 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032926129999999998 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627317+0000", 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114281 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.627404+0000", 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6703e-05 2024-09-10T05:56:57.658 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:381 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.856108984000002, 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065762249999999998, 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.659 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 381 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777654+0000", 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777656+0000", 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.826e-06 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777668+0000", 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1963999999999999e-05 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777693+0000", 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4640000000000001e-05 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777712+0000", 2024-09-10T05:56:57.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9193000000000001e-05 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.777906+0000", 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019432799999999999 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.778802+0000", 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00089519199999999995 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.779325+0000", 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052333600000000001 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.780468+0000", 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001142716 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783996+0000", 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003528411 2024-09-10T05:56:57.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784121+0000", 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124843 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784231+0000", 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109776 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:390 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.852134249000002, 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055076079999999998, 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 390 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.666 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781629+0000", 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781631+0000", 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.61e-06 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781639+0000", 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2230000000000007e-06 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781664+0000", 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5092999999999998e-05 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781682+0000", 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7487e-05 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.781823+0000", 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014109499999999999 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782162+0000", 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033949099999999998 2024-09-10T05:56:57.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782672+0000", 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050964000000000001 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784363+0000", 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016913799999999999 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.786905+0000", 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025418870000000001 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787043+0000", 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013796899999999999 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787137+0000", 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3733000000000005e-05 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:393 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.851196442000003, 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077284750000000003, 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 393 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782567+0000", 2024-09-10T05:56:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782570+0000", 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9500000000000001e-06 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782585+0000", 2024-09-10T05:56:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4610000000000001e-05 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782659+0000", 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4536000000000006e-05 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782685+0000", 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6210000000000001e-05 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.782834+0000", 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000148422 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783053+0000", 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021885200000000001 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.783516+0000", 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046384699999999998 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.784646+0000", 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001129283 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.789993+0000", 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005347437 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790140+0000", 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014694299999999999 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790295+0000", 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015538499999999999 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:396 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.848412456999995, 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051714830000000002, 2024-09-10T05:56:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 396 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785351+0000", 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785354+0000", 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785366+0000", 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2310000000000001e-05 2024-09-10T05:56:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785400+0000", 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3696999999999999e-05 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785423+0000", 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3099999999999999e-05 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785532+0000", 2024-09-10T05:56:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010885199999999999 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785678+0000", 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014572599999999999 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.785955+0000", 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000277285 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.787555+0000", 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00160023 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790318+0000", 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027628000000000002 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790435+0000", 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117068 2024-09-10T05:56:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790522+0000", 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7287999999999995e-05 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:407 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.843398640999993, 2024-09-10T05:56:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006264721, 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 407 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790365+0000", 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790367+0000", 2024-09-10T05:56:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790377+0000", 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8400000000000007e-06 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790400+0000", 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3597000000000001e-05 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790421+0000", 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0265999999999999e-05 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790569+0000", 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014849899999999999 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.790848+0000", 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000278845 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.791347+0000", 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049885700000000001 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.792836+0000", 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014886579999999999 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796350+0000", 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035142009999999998 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796503+0000", 2024-09-10T05:56:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015316200000000001 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796630+0000", 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126556 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:428 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.838022644000006, 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066193700000000003, 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 428 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795741+0000", 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795742+0000", 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5859999999999999e-06 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795751+0000", 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4630000000000001e-06 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795777+0000", 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5893000000000001e-05 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795795+0000", 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8604e-05 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.795908+0000", 2024-09-10T05:56:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112161 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796099+0000", 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019159600000000001 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.796749+0000", 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065039299999999998 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.798354+0000", 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0016048569999999999 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802104+0000", 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037494389999999998 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802245+0000", 2024-09-10T05:56:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141433 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.802360+0000", 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114945 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:510 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.818377885000004, 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060473189999999998, 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 510 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815386+0000", 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815388+0000", 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5840000000000002e-06 2024-09-10T05:56:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815401+0000", 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2768e-05 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815420+0000", 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9585999999999998e-05 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815433+0000", 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2882e-05 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815534+0000", 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100849 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.815790+0000", 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025556100000000002 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.816121+0000", 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000331016 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.817470+0000", 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013493439999999999 2024-09-10T05:56:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821255+0000", 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037850499999999999 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821358+0000", 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102737 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821433+0000", 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4942000000000002e-05 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:530 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.812000351999998, 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051103920000000001, 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 530 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821763+0000", 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821764+0000", 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2780000000000001e-06 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821772+0000", 2024-09-10T05:56:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6639999999999998e-06 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821806+0000", 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4264000000000003e-05 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821829+0000", 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2691999999999999e-05 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.821928+0000", 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8968999999999994e-05 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822167+0000", 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023884199999999999 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.822520+0000", 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035353400000000002 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.824363+0000", 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018423619999999999 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826759+0000", 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023964469999999999 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826828+0000", 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9035999999999994e-05 2024-09-10T05:56:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.826873+0000", 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5303999999999999e-05 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:564 6.4 e36/30 6:2166d8e1:gc::gc.3:head v 36'11, mlcod=36'9)", 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.800217132, 2024-09-10T05:56:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061892409999999998, 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833546+0000", 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833547+0000", 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6899999999999996e-07 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833560+0000", 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2405999999999999e-05 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833576+0000", 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6409000000000002e-05 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833588+0000", 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1419e-05 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833675+0000", 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7739999999999997e-05 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.833709+0000", 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3303999999999998e-05 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839674+0000", 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059653070000000004 2024-09-10T05:56:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839736+0000", 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1686999999999994e-05 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:566 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.799430315999999, 2024-09-10T05:56:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054717589999999997, 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 566 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834333+0000", 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834335+0000", 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7260000000000001e-06 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834351+0000", 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6415000000000001e-05 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834376+0000", 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4615000000000001e-05 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834397+0000", 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1083000000000001e-05 2024-09-10T05:56:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834495+0000", 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7805000000000003e-05 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834630+0000", 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135594 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.834912+0000", 2024-09-10T05:56:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028163199999999998 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.835936+0000", 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001024205 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839651+0000", 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037152940000000001 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839738+0000", 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6007000000000005e-05 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.839805+0000", 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7383000000000002e-05 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:828 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:56:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.721773525000003, 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00558758, 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 828 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911990+0000", 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911991+0000", 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1570000000000001e-06 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.911997+0000", 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0349999999999998e-06 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912009+0000", 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1824999999999999e-05 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912017+0000", 2024-09-10T05:56:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2879999999999993e-06 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912078+0000", 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0869000000000003e-05 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912145+0000", 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7222000000000001e-05 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.912278+0000", 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013305700000000001 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.913176+0000", 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000897213 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917462+0000", 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042859439999999999 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917526+0000", 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4849000000000002e-05 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.917578+0000", 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1121000000000001e-05 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:841 6.19 6:9f626c48:lc::lc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.715390510999995, 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053076190000000004, 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 841 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918373+0000", 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918374+0000", 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.64e-07 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918379+0000", 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8670000000000002e-06 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918390+0000", 2024-09-10T05:56:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.134e-05 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918395+0000", 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3360000000000002e-06 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918442+0000", 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6817999999999998e-05 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918501+0000", 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8461999999999997e-05 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.918620+0000", 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119731 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.919469+0000", 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084865199999999998 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923609+0000", 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041400059999999999 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923654+0000", 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4413000000000003e-05 2024-09-10T05:56:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.923681+0000", 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.703e-05 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:843 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.712969400999995, 2024-09-10T05:56:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056796060000000002, 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 843 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920794+0000", 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920795+0000", 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0809999999999999e-06 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920800+0000", 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7670000000000003e-06 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920815+0000", 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4848000000000001e-05 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920823+0000", 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8089999999999993e-06 2024-09-10T05:56:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920885+0000", 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2675999999999994e-05 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.920951+0000", 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5401999999999995e-05 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.921085+0000", 2024-09-10T05:56:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.922066+0000", 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098162100000000001 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926361+0000", 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042945659999999997 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926424+0000", 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3357999999999999e-05 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:33.926474+0000", 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9360000000000002e-05 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.071544374, 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:56:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.044733586, 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:56:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:56:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.212888792999999, 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:56:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:56:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:56:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1812 3.30 3:0f16d871:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.204810398999999, 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017116908, 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:56:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1812 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428955+0000", 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6700000000000001e-06 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431687+0000", 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002732342 2024-09-10T05:56:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431712+0000", 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5114e-05 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431725+0000", 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2976000000000001e-05 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:56:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431862+0000", 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013720799999999999 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432067+0000", 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205028 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432272+0000", 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205105 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.439520+0000", 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072476550000000004 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445702+0000", 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061817640000000002 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:56:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445898+0000", 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195928 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446070+0000", 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017211799999999999 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:56:57.766 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:57.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:56:57.768 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:57.764+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:57.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:56:57.813 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:56:57.998 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:56:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:56:57.998 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:56:57.998 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:56:57.998 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:56:57.999 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:56:58.000 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:57.993+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:58.000 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:56:58.000 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:56:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:56:58.001 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:56:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:56:58.002 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:56:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:56:58.002 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:56:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:56:58.010 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:56:58.011 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:56:58.031 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:56:58.031 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:56:58.051 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:56:58.051 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:56:58.111 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:58.108+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:58.165 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:58.165 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:58.180 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:56:58.231 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:58.229+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:58.303 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:58.301+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:58.313 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:58.314 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:58.334 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:56:58.405 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:58.400+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:58.506 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:58.500+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:58.511 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:58.512 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:58.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:56:58.606 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:58.600+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:58.657 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:58.657 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:58.672 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:56:58.723 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:58.721+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:58.802 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:58.802 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:58.809 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:58.804+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:58.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:56:58.909 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:58.905+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:59.010 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:59.005+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:59.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:56:59.111 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:56:59.109+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:56:59.186 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:59.186 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:59.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:56:59.259 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:56:59.256+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:56:59.313 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:56:59.308+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:56:59.358 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:59.358 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:59.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:56:59.427 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:59.424+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:59.514 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:56:59.508+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:56:59.578 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:59.578 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:59.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:56:59.639 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:56:59.636+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:56:59.716 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:59.713+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:59.760 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:59.760 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:59.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:56:59.817 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:56:59.813+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:56:59.918 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:56:59.913+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:56:59.936 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:56:59.936 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:56:59.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:00.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:57:00.018 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:00.013+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:00.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:00.119 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:00.116+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:00.124 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:00.125 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:00.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:00.244 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:00.240+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:00.320 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:00.317+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:00.324 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:00.324 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:00.349 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:00.349 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:00.371 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:00.371 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:00.378 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:00.378 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:00.378 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:00.390 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:00.396 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:00.417 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:00.418 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:00.421 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:00.417+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:00.448 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:00.448 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:00.473 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:00.505 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:00.522 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:00.516+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:00.578 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:00.578 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:00.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:00.578 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:00.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 93.945905577999994, 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029954109999999999, 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 42 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.579 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630990+0000", 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.630993+0000", 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.587e-06 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631011+0000", 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8593e-05 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631044+0000", 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2353e-05 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631066+0000", 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1857000000000001e-05 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631167+0000", 2024-09-10T05:57:00.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101771 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631311+0000", 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.631456+0000", 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014495400000000001 2024-09-10T05:57:00.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.632381+0000", 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092467899999999997 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633787+0000", 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014065690000000001 2024-09-10T05:57:00.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633899+0000", 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011172599999999999 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.633986+0000", 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6742000000000004e-05 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 89.940994011000001, 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031369330000000002, 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 52 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635902+0000", 2024-09-10T05:57:00.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635905+0000", 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7439999999999999e-06 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635915+0000", 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0485e-05 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635941+0000", 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5568e-05 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.635955+0000", 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4122e-05 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636073+0000", 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011809800000000001 2024-09-10T05:57:00.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636366+0000", 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029304400000000001 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.636629+0000", 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026280599999999998 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.637556+0000", 2024-09-10T05:57:00.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00092701100000000005 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638928+0000", 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001372156 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.638988+0000", 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9707000000000003e-05 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:30.639039+0000", 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1192e-05 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.828500955999999, 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034026070000000002, 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 236 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748395+0000", 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748398+0000", 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.304e-06 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748411+0000", 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2500000000000001e-05 2024-09-10T05:57:00.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748441+0000", 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0205999999999998e-05 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748466+0000", 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4756000000000002e-05 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748593+0000", 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012756900000000001 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.748808+0000", 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000214706 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:00.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.749200+0000", 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039246000000000002 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.750838+0000", 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001637704 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751603+0000", 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076528399999999997 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751687+0000", 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3225000000000004e-05 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.751798+0000", 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000110893 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:239 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.823653668000006, 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003342982, 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 239 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753242+0000", 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753245+0000", 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.497e-06 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753255+0000", 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0767e-05 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753280+0000", 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4603000000000001e-05 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753294+0000", 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4181e-05 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753708+0000", 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041369099999999999 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.753830+0000", 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012228200000000001 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754032+0000", 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000201683 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.754829+0000", 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00079687200000000001 2024-09-10T05:57:00.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756462+0000", 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016329649999999999 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756535+0000", 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3398000000000004e-05 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.756585+0000", 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:312 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.810925006999994, 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027890549999999999, 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 312 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765971+0000", 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765972+0000", 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379999999999999e-06 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765978+0000", 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6239999999999999e-06 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.765993+0000", 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.517e-05 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766001+0000", 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9589999999999995e-06 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766066+0000", 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4466000000000002e-05 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766146+0000", 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0710999999999993e-05 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766327+0000", 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180855 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.766915+0000", 2024-09-10T05:57:00.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00058773699999999996 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768653+0000", 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017384360000000001 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768711+0000", 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8022000000000001e-05 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.768760+0000", 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8537e-05 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:438 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.776541187000007, 2024-09-10T05:57:00.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002731093, 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 438 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800355+0000", 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800356+0000", 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.437e-06 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800363+0000", 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7750000000000004e-06 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800379+0000", 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800390+0000", 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1223000000000001e-05 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800510+0000", 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011927200000000001 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800672+0000", 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016249600000000001 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.800876+0000", 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203766 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.801439+0000", 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056308300000000003 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.802970+0000", 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015307649999999999 2024-09-10T05:57:00.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803034+0000", 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4543999999999997e-05 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.803086+0000", 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1542000000000002e-05 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:464 6.14 6:2f3f5e88:lc::lc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.770773187000003, 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029599169999999998, 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 464 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806123+0000", 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806124+0000", 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2449999999999999e-06 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806132+0000", 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7959999999999996e-06 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806150+0000", 2024-09-10T05:57:00.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.855e-05 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806160+0000", 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3700000000000001e-06 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806226+0000", 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6208e-05 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806306+0000", 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0488000000000006e-05 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806499+0000", 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193072 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807343+0000", 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00084341099999999997 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.808982+0000", 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016388799999999999 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809039+0000", 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7775999999999997e-05 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.809083+0000", 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3121000000000003e-05 2024-09-10T05:57:00.625 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:469 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.770181211999997, 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053035640000000002, 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.626 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 469 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806715+0000", 2024-09-10T05:57:00.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806716+0000", 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2270000000000001e-06 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806722+0000", 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9549999999999997e-06 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806736+0000", 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4623999999999999e-05 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806746+0000", 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2140000000000002e-06 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806813+0000", 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7578999999999998e-05 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.806896+0000", 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189000000000006e-05 2024-09-10T05:57:00.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807090+0000", 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193723 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.807669+0000", 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000578423 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811915+0000", 2024-09-10T05:57:00.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042459129999999996 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811972+0000", 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7692000000000003e-05 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812018+0000", 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6025000000000001e-05 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:483 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.766748716999999, 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002850506, 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 483 2024-09-10T05:57:00.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810147+0000", 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810148+0000", 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7000000000000003e-07 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810152+0000", 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719999999999997e-06 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810165+0000", 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2585000000000001e-05 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810172+0000", 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9979999999999997e-06 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810232+0000", 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0136000000000002e-05 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810317+0000", 2024-09-10T05:57:00.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4382000000000006e-05 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.810490+0000", 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000173117 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.811039+0000", 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00054900499999999998 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812917+0000", 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018785200000000001 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812962+0000", 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4719000000000003e-05 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.812998+0000", 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5701999999999998e-05 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:496 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:57:00.639 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.763812775000005, 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053052300000000002, 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 496 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813083+0000", 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813084+0000", 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3629999999999999e-06 2024-09-10T05:57:00.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813090+0000", 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.711e-06 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813105+0000", 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4372999999999999e-05 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813115+0000", 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0451e-05 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813177+0000", 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1661000000000005e-05 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813237+0000", 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0139999999999997e-05 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813353+0000", 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115882 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.813846+0000", 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049340400000000002 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818270+0000", 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044239580000000004 2024-09-10T05:57:00.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818337+0000", 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6550999999999994e-05 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.818388+0000", 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1736000000000001e-05 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:955 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.612669041000004, 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043179519999999999, 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 955 2024-09-10T05:57:00.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964227+0000", 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964228+0000", 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0869999999999999e-06 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964233+0000", 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1950000000000002e-06 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964247+0000", 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3514e-05 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964254+0000", 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6279999999999996e-06 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964329+0000", 2024-09-10T05:57:00.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4980000000000004e-05 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964419+0000", 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0132999999999999e-05 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.964596+0000", 2024-09-10T05:57:00.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017657999999999999 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.965160+0000", 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056358099999999996 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968459+0000", 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032993440000000001 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968508+0000", 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9472999999999999e-05 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.968545+0000", 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6436999999999997e-05 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.352298188000006, 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0032056820000000001, 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1228 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224598+0000", 2024-09-10T05:57:00.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224601+0000", 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8760000000000001e-06 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224612+0000", 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1216999999999999e-05 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224643+0000", 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1372999999999999e-05 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224659+0000", 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.554e-05 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.224817+0000", 2024-09-10T05:57:00.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015828899999999999 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225199+0000", 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038217699999999998 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.225759+0000", 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000559776 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227104+0000", 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001344853 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227520+0000", 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00041608299999999998 2024-09-10T05:57:00.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227680+0000", 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016034299999999999 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.227803+0000", 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012315500000000001 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.660 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.348277568, 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030076259999999998, 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1230 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228618+0000", 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228620+0000", 2024-09-10T05:57:00.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228631+0000", 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0453e-05 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228654+0000", 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2756e-05 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228666+0000", 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2003e-05 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.228794+0000", 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012810299999999999 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229035+0000", 2024-09-10T05:57:00.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024138100000000001 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.229516+0000", 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00048131699999999999 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.230577+0000", 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001060238 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231363+0000", 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00078622999999999996 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231509+0000", 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014642600000000001 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.231626+0000", 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116629 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.338833300999994, 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030053530000000001, 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1234 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238063+0000", 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238065+0000", 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5160000000000001e-06 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238076+0000", 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1080000000000001e-05 2024-09-10T05:57:00.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238108+0000", 2024-09-10T05:57:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1408999999999997e-05 2024-09-10T05:57:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238123+0000", 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5227e-05 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238269+0000", 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000145876 2024-09-10T05:57:00.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.238616+0000", 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034741999999999998 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.239151+0000", 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00053519600000000004 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240402+0000", 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001250611 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240795+0000", 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00039323400000000001 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.240957+0000", 2024-09-10T05:57:00.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161712 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241068+0000", 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111072 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:57:00.674 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.334912172000003, 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028408750000000001, 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1236 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241984+0000", 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241986+0000", 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3240000000000001e-06 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.241997+0000", 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.064e-05 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242028+0000", 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1439000000000002e-05 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242047+0000", 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8960000000000001e-05 2024-09-10T05:57:00.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242172+0000", 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012531900000000001 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242413+0000", 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024102800000000001 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.242884+0000", 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00047009999999999999 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244038+0000", 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011543110000000001 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244557+0000", 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00051928599999999999 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244713+0000", 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015613899999999999 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.244825+0000", 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111329 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:57:00.681 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.293919427999995, 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002865111, 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1255 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282976+0000", 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282979+0000", 2024-09-10T05:57:00.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.282992+0000", 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.306e-05 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283023+0000", 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0886000000000002e-05 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283038+0000", 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5224e-05 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283166+0000", 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128279 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283385+0000", 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000218958 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.283702+0000", 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031609100000000001 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285047+0000", 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013458960000000001 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285692+0000", 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00064429500000000002 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285779+0000", 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6831999999999998e-05 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.285842+0000", 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3009999999999995e-05 2024-09-10T05:57:00.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.123390040999993, 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030050530000000002, 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.688 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1336 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453506+0000", 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453509+0000", 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.88e-06 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453521+0000", 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2027e-05 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453551+0000", 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0496000000000001e-05 2024-09-10T05:57:00.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453584+0000", 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3073e-05 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.453742+0000", 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158095 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454128+0000", 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038578100000000003 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.454683+0000", 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00055496899999999999 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.455969+0000", 2024-09-10T05:57:00.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001286127 2024-09-10T05:57:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456353+0000", 2024-09-10T05:57:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038342299999999998 2024-09-10T05:57:00.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456439+0000", 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6433000000000004e-05 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.456511+0000", 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1748999999999994e-05 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.111924016000003, 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029568870000000001, 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1342 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464972+0000", 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464974+0000", 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5229999999999998e-06 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.464986+0000", 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1133e-05 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465017+0000", 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1186999999999998e-05 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465038+0000", 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1616000000000001e-05 2024-09-10T05:57:00.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465225+0000", 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018656900000000001 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465460+0000", 2024-09-10T05:57:00.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000235302 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.465780+0000", 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031998999999999998 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.466900+0000", 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0011203109999999999 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467783+0000", 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00088217999999999999 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467867+0000", 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3930000000000004e-05 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:34.467929+0000", 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2145999999999998e-05 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4865.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:00.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.862750602, 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054676530000000003, 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4865", 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/4085573642", 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 50 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714145+0000", 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714146+0000", 2024-09-10T05:57:00.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0999999999999997e-07 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714150+0000", 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714161+0000", 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0361e-05 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714166+0000", 2024-09-10T05:57:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4639999999999997e-06 2024-09-10T05:57:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714219+0000", 2024-09-10T05:57:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2574000000000002e-05 2024-09-10T05:57:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.708 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714269+0000", 2024-09-10T05:57:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0351e-05 2024-09-10T05:57:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:00.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714347+0000", 2024-09-10T05:57:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8499999999999997e-05 2024-09-10T05:57:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.714798+0000", 2024-09-10T05:57:00.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045035000000000002 2024-09-10T05:57:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719534+0000", 2024-09-10T05:57:00.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047363489999999999 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719565+0000", 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1087999999999998e-05 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:46.719613+0000", 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.774e-05 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2486 4.34 4:2f069146:::.dir.53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:51.382755+0000", 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1941406939999997, 2024-09-10T05:57:00.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003194185, 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2486 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.714 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382755+0000", 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382755+0000", 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382758+0000", 2024-09-10T05:57:00.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3810000000000002e-06 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382769+0000", 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1226000000000001e-05 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382793+0000", 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4158000000000001e-05 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:00.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382803+0000", 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0282000000000001e-05 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.382872+0000", 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8889999999999999e-05 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.383009+0000", 2024-09-10T05:57:00.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013705 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.383111+0000", 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0001016 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.383882+0000", 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00077086099999999996 2024-09-10T05:57:00.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.385896+0000", 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020142409999999999 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.385926+0000", 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0159e-05 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:51.385949+0000", 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3337e-05 2024-09-10T05:57:00.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:00.720 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:00.720 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:00.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:00.722 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:00.716+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:00.824 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:00.816+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:00.853 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:57:00.909 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:00.909 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:00.910 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:00.910 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:00.923 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:00.920+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:00.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:01.025 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:01.021+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:01.115 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:01.116 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:01.116 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:01.125 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:01.120+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:01.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:01.226 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:01.220+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:01.327 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:01.324+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:01.331 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:01.331 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:01.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:01.331 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 87.702893353999997, 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:01.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:57:01.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:57:01.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.897371352, 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:57:01.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1948 3.19 e66/57 3:9ae3dc4d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_2:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.918261829, 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079042509999999993, 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412174+0000", 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412177+0000", 2024-09-10T05:57:01.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.729e-06 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414422+0000", 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022448400000000001 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414451+0000", 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9152000000000001e-05 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414470+0000", 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9487000000000002e-05 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414592+0000", 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121329 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.414626+0000", 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4696000000000001e-05 2024-09-10T05:57:01.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.419964+0000", 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053377160000000002 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420078+0000", 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114302 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.92879320600000004, 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:57:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:57:01.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:57:01.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:57:01.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2689 3.19 e73/57 3:99575c67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_152:head v 73'6, mlcod=73'4)", 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.523024+0000", 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.80741192299999998, 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076388560000000003, 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.523024+0000", 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.523024+0000", 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.523026+0000", 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0250000000000001e-06 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.524604+0000", 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015782159999999999 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.524625+0000", 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0513000000000002e-05 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.524638+0000", 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3540000000000001e-05 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.524715+0000", 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6309000000000004e-05 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.524740+0000", 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5823e-05 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530606+0000", 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058651620000000002 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530663+0000", 2024-09-10T05:57:01.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7268000000000001e-05 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2699 3.25 e73/57 3:a7585b47:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_162:head v 73'5, mlcod=73'3)", 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.635504+0000", 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.69493157299999997, 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094349470000000008, 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635504+0000", 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635504+0000", 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635507+0000", 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1660000000000001e-06 2024-09-10T05:57:01.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.637610+0000", 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002103438 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.637632+0000", 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2028e-05 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.637645+0000", 2024-09-10T05:57:01.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2661e-05 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.637719+0000", 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4313000000000005e-05 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.637750+0000", 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0629000000000001e-05 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644868+0000", 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071188270000000003 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644939+0000", 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0884999999999996e-05 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.66607532899999999, 2024-09-10T05:57:01.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:57:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:57:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:57:01.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:57:01.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.61077669000000001, 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:57:01.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:01.373 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.58146572200000002, 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:57:01.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:01.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2711 3.3c e73/57 3:3f29615d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_174:head v 73'2, mlcod=0'0)", 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.766319+0000", 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.56411697800000005, 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097024610000000008, 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.766319+0000", 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.766319+0000", 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.766321+0000", 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4820000000000001e-06 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770201+0000", 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038798840000000001 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770220+0000", 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8983000000000001e-05 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770231+0000", 2024-09-10T05:57:01.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0715e-05 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770321+0000", 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0321000000000005e-05 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770351+0000", 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9465e-05 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.775933+0000", 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055825960000000004 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.776021+0000", 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8015000000000003e-05 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.55971054799999997, 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:57:01.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:57:01.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:01.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2713 3.18 3:1b895b6f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.390 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.781917+0000", 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.548518705, 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085657170000000005, 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2713 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781917+0000", 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781917+0000", 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781920+0000", 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6979999999999998e-06 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.783473+0000", 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015528460000000001 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.783498+0000", 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4926000000000002e-05 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.783512+0000", 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3944999999999999e-05 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.783582+0000", 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0152000000000002e-05 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.783696+0000", 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011458700000000001 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.783791+0000", 2024-09-10T05:57:01.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4528e-05 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.789738+0000", 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005946631 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.790354+0000", 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000616619 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.790427+0000", 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2564000000000005e-05 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.790483+0000", 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6221000000000003e-05 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2717 3.25 e73/57 3:a515f872:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_180:head v 73'6, mlcod=73'4)", 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.822419+0000", 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.50801691000000004, 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0090370610000000007, 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822419+0000", 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822419+0000", 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822421+0000", 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.277e-06 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.824167+0000", 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001745405 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.824194+0000", 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7067999999999999e-05 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.824207+0000", 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2736e-05 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.824293+0000", 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6766000000000002e-05 2024-09-10T05:57:01.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.824322+0000", 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8856e-05 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831209+0000", 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006886639 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831456+0000", 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000247314 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.45413100899999997, 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:57:01.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:57:01.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.44332313200000001, 2024-09-10T05:57:01.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:01.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:57:01.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:57:01.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2730 3.19 e74/57 3:99f0627c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_193:head v 74'7, mlcod=73'5)", 2024-09-10T05:57:01.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.958127+0000", 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.37230892100000001, 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094055790000000007, 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.958127+0000", 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.958127+0000", 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.958128+0000", 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0299999999999999e-07 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.960002+0000", 2024-09-10T05:57:01.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018745700000000001 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.960017+0000", 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5211999999999999e-05 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.960027+0000", 2024-09-10T05:57:01.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9040000000000004e-06 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.960091+0000", 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3895999999999999e-05 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.960115+0000", 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3773000000000001e-05 2024-09-10T05:57:01.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967467+0000", 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073515550000000001 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967533+0000", 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6066000000000001e-05 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.30895370100000003, 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2744 3.18 3:1839a274:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_207:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.096057+0000", 2024-09-10T05:57:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.234378848, 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00902529, 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2744 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.096057+0000", 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.096057+0000", 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.096060+0000", 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6290000000000002e-06 2024-09-10T05:57:01.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.097382+0000", 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013220650000000001 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.097406+0000", 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4269000000000001e-05 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.097417+0000", 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0535e-05 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.097480+0000", 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3250999999999995e-05 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.097625+0000", 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562700000000001 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.097721+0000", 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5987000000000001e-05 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.102404+0000", 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046827409999999998 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.104962+0000", 2024-09-10T05:57:01.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00255829 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.105030+0000", 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7967999999999997e-05 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.105082+0000", 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1928000000000002e-05 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.22424034700000001, 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:57:01.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.15471901299999999, 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:01.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:01.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:57:01.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:01.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:57:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:57:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:01.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:01.442 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:01.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:01.444 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:01.440+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:01.544 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:01.541+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:01.577 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:01.577 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:01.577 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:01.577 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:01.584 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 1Gb. 2024-09-10T05:57:01.584 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:57:01.584 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:57:01.584 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-09-10T05:57:01.584 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:57:01.592 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:01.645 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:01.640+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:01.745 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:01.740+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:01.768 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:01.768 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:01.768 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:01.768 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:01.768 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:01.783 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:57:01.783 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:57:01.785 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:01.847 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:01.840+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:01.907 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:01.907 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 93.347728889999999, 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.908 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:01.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:57:01.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:57:01.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:57:01.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.914 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.444182244, 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.915 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:57:01.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1947 3.3 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.507820004999999, 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018605588999999999, 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.920 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1947 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397906+0000", 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402321+0000", 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044157889999999998 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402355+0000", 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3744000000000001e-05 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402371+0000", 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6135999999999999e-05 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402469+0000", 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7844999999999996e-05 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402634+0000", 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000164644 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402772+0000", 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137768 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.412200+0000", 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094282930000000008 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416386+0000", 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041860109999999999 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416443+0000", 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6884e-05 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416494+0000", 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0831000000000002e-05 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.926 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2686 3.3 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.4262693799999999, 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015526295000000001, 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2686 2024-09-10T05:57:01.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479442+0000", 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2370000000000001e-06 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483270+0000", 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038281890000000001 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483292+0000", 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2232999999999999e-05 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483303+0000", 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0641e-05 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483406+0000", 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102905 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483629+0000", 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022338699999999999 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483850+0000", 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022084700000000001 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.492245+0000", 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083952639999999995 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494655+0000", 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024096769999999998 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494835+0000", 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179798 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494965+0000", 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013011699999999999 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.932 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2697 3.a e73/24 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.2861324060000001, 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016453567999999998, 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619579+0000", 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9189999999999999e-06 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622839+0000", 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032599949999999999 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622882+0000", 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3118999999999998e-05 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622905+0000", 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3232999999999999e-05 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623007+0000", 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101598 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623035+0000", 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8772000000000002e-05 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.635939+0000", 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012903694 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636029+0000", 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0237999999999999e-05 2024-09-10T05:57:01.936 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2706 3.1d e73/24 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.195746424, 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01721114, 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709964+0000", 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6690000000000002e-06 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712686+0000", 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027220600000000001 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712724+0000", 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7376000000000003e-05 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712745+0000", 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0786000000000001e-05 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712899+0000", 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015498199999999999 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712957+0000", 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7889000000000001e-05 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727050+0000", 2024-09-10T05:57:01.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014093114 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727173+0000", 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012226399999999999 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2719 3.1b e73/24 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head v 73'3, mlcod=65'1)", 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:01.941 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.0601567489999999, 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018608657000000001, 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845553+0000", 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849483+0000", 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039301420000000002 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849521+0000", 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-10T05:57:01.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849543+0000", 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1869e-05 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849706+0000", 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163132 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849769+0000", 2024-09-10T05:57:01.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3162000000000003e-05 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864021+0000", 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014252117 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864160+0000", 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013903599999999999 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.945 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2720 3.9 3:90160a04:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.0513699240000001, 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016834844000000002, 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2720 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:01.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854342+0000", 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0430000000000001e-06 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859157+0000", 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048145640000000003 2024-09-10T05:57:01.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859195+0000", 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8609000000000003e-05 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859221+0000", 2024-09-10T05:57:01.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6086000000000001e-05 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859430+0000", 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020873800000000001 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859733+0000", 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030246400000000001 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859961+0000", 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022790700000000001 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.870502+0000", 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010541889 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871010+0000", 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050712499999999998 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871106+0000", 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6220999999999999e-05 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871173+0000", 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7198000000000003e-05 2024-09-10T05:57:01.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2721 3.9 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.0394021680000001, 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021537937, 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.953 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2721 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866311+0000", 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7260000000000002e-06 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872270+0000", 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059589939999999996 2024-09-10T05:57:01.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872300+0000", 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0023e-05 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872321+0000", 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1005999999999998e-05 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872492+0000", 2024-09-10T05:57:01.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017168500000000001 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872729+0000", 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236357 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872962+0000", 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023289299999999999 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883222+0000", 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010260607 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887676+0000", 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044541950000000002 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887772+0000", 2024-09-10T05:57:01.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6089999999999996e-05 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887844+0000", 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1360999999999997e-05 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2727 3.1c e74/24 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.96876712399999998, 2024-09-10T05:57:01.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020405939000000001, 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936942+0000", 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6300000000000004e-07 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940348+0000", 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034059559999999999 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940389+0000", 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1173e-05 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940411+0000", 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2546000000000001e-05 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940673+0000", 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026151599999999999 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940736+0000", 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2707999999999997e-05 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957202+0000", 2024-09-10T05:57:01.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016466524999999999 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957347+0000", 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:01.964 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.96858662299999998, 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:57:01.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:57:01.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.95959196099999999, 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.971 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:57:01.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:57:01.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:57:01.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2737 3.e e74/24 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.87511471500000004, 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019750409, 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030594+0000", 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035304+0000", 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047101030000000002 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035338+0000", 2024-09-10T05:57:01.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3969e-05 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035355+0000", 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6747000000000001e-05 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035496+0000", 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014153599999999999 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035533+0000", 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6675999999999999e-05 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050221+0000", 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014687973999999999 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050344+0000", 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012263000000000001 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2743 3.34 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:01.982 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.81981301100000004, 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020245447999999999, 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2743 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085897+0000", 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.243e-06 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091156+0000", 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052584149999999998 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091186+0000", 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0648999999999997e-05 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091206+0000", 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9415999999999998e-05 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091331+0000", 2024-09-10T05:57:01.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012479 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091576+0000", 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024558300000000001 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091810+0000", 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023423000000000001 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.104889+0000", 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013079084 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105976+0000", 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010860659999999999 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106070+0000", 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4810999999999997e-05 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106140+0000", 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0160999999999995e-05 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2755 3.11 e74/24 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head v 74'8, mlcod=73'6)", 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.69368041199999997, 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021403122, 2024-09-10T05:57:01.989 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:01.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212031+0000", 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218661+0000", 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066300990000000004 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218698+0000", 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7109e-05 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218716+0000", 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7776000000000001e-05 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218848+0000", 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013285 2024-09-10T05:57:01.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218898+0000", 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9561999999999997e-05 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233312+0000", 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014414009 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:01.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233431+0000", 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001187 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2756 3.1a 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:01.994 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.691629033, 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021135549, 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2756 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:01.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214082+0000", 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218251+0000", 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041687790000000001 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218292+0000", 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0602000000000002e-05 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218318+0000", 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5701999999999999e-05 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218474+0000", 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015660000000000001 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218952+0000", 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047828600000000002 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.219315+0000", 2024-09-10T05:57:01.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036209600000000001 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233050+0000", 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013735041999999999 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234930+0000", 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018799870000000001 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:01.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235091+0000", 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016182499999999999 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235215+0000", 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012318999999999999 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.000 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2758 3.14 3:2b3c5956:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.67163409100000004, 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020489027999999999, 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2758 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234084+0000", 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0288999999999999e-05 2024-09-10T05:57:02.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239117+0000", 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050329579999999997 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239150+0000", 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2391999999999998e-05 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239168+0000", 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8122999999999999e-05 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239346+0000", 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017855200000000001 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239754+0000", 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040791800000000001 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.240162+0000", 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040800899999999998 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249324+0000", 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091615710000000003 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254280+0000", 2024-09-10T05:57:02.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049566990000000002 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254445+0000", 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016484599999999999 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254563+0000", 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011767100000000001 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.006 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2759 3.3 3:c2c35e3f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.66268455100000001, 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015920593, 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2759 2024-09-10T05:57:02.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243026+0000", 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.463e-06 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248521+0000", 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054947249999999998 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248562+0000", 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152999999999997e-05 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248585+0000", 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3252e-05 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248713+0000", 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012798700000000001 2024-09-10T05:57:02.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248967+0000", 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025380900000000002 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249206+0000", 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000239433 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258753+0000", 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009546433 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258778+0000", 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5199999999999999e-05 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258865+0000", 2024-09-10T05:57:02.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6784000000000001e-05 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258944+0000", 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9354e-05 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2776 3.31 e74/24 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:02.013 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.476008086, 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016659686, 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429703+0000", 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9730000000000002e-06 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435067+0000", 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053637779999999996 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435100+0000", 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3473000000000003e-05 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435116+0000", 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6053e-05 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435324+0000", 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020727699999999999 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435367+0000", 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3019000000000003e-05 2024-09-10T05:57:02.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446249+0000", 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010882106000000001 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446360+0000", 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111007 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2777 3.1b e74/24 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.46590667800000002, 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016908191999999999, 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439804+0000", 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7530000000000002e-06 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444587+0000", 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047832309999999998 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444632+0000", 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4502999999999997e-05 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444656+0000", 2024-09-10T05:57:02.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3748999999999999e-05 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444878+0000", 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022217 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444944+0000", 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5811999999999999e-05 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456502+0000", 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011558406 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456710+0000", 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020756799999999999 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.023 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.024 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:02.025 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:02.026 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:02.020+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:02.125 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:02.121+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:02.153 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:02.153 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:02.153 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:02.154 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:02.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:02.255 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:02.253+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:02.326 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:02.321+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:02.336 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:02.336 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:02.336 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:02.336 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:02.336 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:02.350 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:02.428 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:02.424+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:02.521 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:02.521 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:02.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.955587252000001, 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.522 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:57:02.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:57:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:57:02.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.527 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.928776464, 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:57:02.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:02.533 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.096931671, 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:57:02.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.539 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1812 3.30 3:0f16d871:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.088853277, 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017116908, 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.540 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1812 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428955+0000", 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6700000000000001e-06 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431687+0000", 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002732342 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431712+0000", 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5114e-05 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431725+0000", 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2976000000000001e-05 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431862+0000", 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013720799999999999 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432067+0000", 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205028 2024-09-10T05:57:02.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432272+0000", 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205105 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.439520+0000", 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072476550000000004 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445702+0000", 2024-09-10T05:57:02.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061817640000000002 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445898+0000", 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195928 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446070+0000", 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017211799999999999 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2704 3.16 3:6b2c0ee3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.8349245459999999, 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022182810000000001, 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2704 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682886+0000", 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4429999999999996e-06 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686829+0000", 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039425720000000001 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686867+0000", 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8466000000000001e-05 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686887+0000", 2024-09-10T05:57:02.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9629000000000001e-05 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687049+0000", 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161619 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687342+0000", 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029348500000000001 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687579+0000", 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023733000000000001 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.696533+0000", 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089536040000000004 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704753+0000", 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082205669999999998 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704929+0000", 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017553499999999999 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.705065+0000", 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013556000000000001 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2706 3.1d 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.814224778, 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024374384999999998, 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2706 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703585+0000", 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.287e-06 2024-09-10T05:57:02.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709069+0000", 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005484432 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709101+0000", 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2063000000000001e-05 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709117+0000", 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709221+0000", 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103867 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709490+0000", 2024-09-10T05:57:02.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269053 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709739+0000", 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024859600000000002 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.724317+0000", 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014578512 2024-09-10T05:57:02.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727648+0000", 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033310420000000002 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727824+0000", 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017585100000000001 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727956+0000", 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013196 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2707 3.5 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.8048188000000001, 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016855370000000001, 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.558 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2707 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712991+0000", 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5700000000000001e-06 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717888+0000", 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048966290000000004 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717925+0000", 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7404999999999998e-05 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717946+0000", 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0662999999999999e-05 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718163+0000", 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021718400000000001 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718403+0000", 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240196 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718611+0000", 2024-09-10T05:57:02.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208161 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728002+0000", 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093903579999999997 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729567+0000", 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001565005 2024-09-10T05:57:02.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729711+0000", 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014411599999999999 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729843+0000", 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013208299999999999 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.564 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2708 3.2a 3:546514ef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7947892990000001, 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021062501000000001, 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.565 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2708 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:02.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723020+0000", 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6259999999999999e-06 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727965+0000", 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049453429999999996 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727991+0000", 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6083000000000001e-05 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728016+0000", 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728170+0000", 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015342900000000001 2024-09-10T05:57:02.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728472+0000", 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030251099999999999 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728707+0000", 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023466700000000001 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739602+0000", 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010895083 2024-09-10T05:57:02.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743763+0000", 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041615360000000004 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743947+0000", 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018321400000000001 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744080+0000", 2024-09-10T05:57:02.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013281999999999999 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2709 3.36 e73/24 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head v 73'5, mlcod=72'3)", 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.777266475, 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015622295, 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.571 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740542+0000", 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:57:02.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744345+0000", 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038023129999999999 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744379+0000", 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4224999999999998e-05 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744404+0000", 2024-09-10T05:57:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4586000000000001e-05 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744558+0000", 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000154146 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744622+0000", 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4491000000000003e-05 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756023+0000", 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011401262000000001 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756162+0000", 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013869199999999999 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.575 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2711 3.3c 3:3f29615d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.757354651, 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015648141000000001, 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2711 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760456+0000", 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2869999999999998e-06 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764614+0000", 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041582520000000003 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764651+0000", 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6439000000000001e-05 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764670+0000", 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9536000000000001e-05 2024-09-10T05:57:02.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764820+0000", 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974300000000001 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765073+0000", 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025336599999999999 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765314+0000", 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024024300000000001 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.774451+0000", 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091372620000000002 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775903+0000", 2024-09-10T05:57:02.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001452432 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775996+0000", 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2283999999999999e-05 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.776100+0000", 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010429699999999999 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.581 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2714 3.16 3:696d6af6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7282176040000001, 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018296902, 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2714 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.582 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789592+0000", 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4199999999999999e-06 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793519+0000", 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039268360000000004 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793560+0000", 2024-09-10T05:57:02.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1078000000000002e-05 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793578+0000", 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793710+0000", 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013122899999999999 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793970+0000", 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025991600000000001 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.794207+0000", 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023692299999999999 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.806549+0000", 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012342671 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807674+0000", 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001124702 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807774+0000", 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9987000000000003e-05 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807886+0000", 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111753 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.587 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.590157112, 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.588 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:57:02.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:02.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.510459971, 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:57:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:57:02.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:57:02.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2747 3.2a 3:56df8694:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.391178335, 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336575999999999, 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2747 2024-09-10T05:57:02.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126632+0000", 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130540+0000", 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003907794 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130580+0000", 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0194000000000002e-05 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130602+0000", 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2169999999999999e-05 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130776+0000", 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174005 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131200+0000", 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042367199999999999 2024-09-10T05:57:02.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131649+0000", 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000449171 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.146739+0000", 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01508959 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150675+0000", 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003936419 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150810+0000", 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135162 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150965+0000", 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015443299999999999 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.606 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2749 3.16 3:6b50c908:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.372394892, 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020765693000000002, 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.607 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2749 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145415+0000", 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149511+0000", 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040962409999999996 2024-09-10T05:57:02.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149539+0000", 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7231000000000001e-05 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149552+0000", 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3771000000000001e-05 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149708+0000", 2024-09-10T05:57:02.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155174 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150116+0000", 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040834600000000002 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150545+0000", 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000428641 2024-09-10T05:57:02.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.158644+0000", 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080993990000000002 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.165933+0000", 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072888739999999999 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166073+0000", 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013972499999999999 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166177+0000", 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104597 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2751 3.21 e74/24 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:02.613 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.350041917, 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017265005, 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167766+0000", 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0590000000000001e-06 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172413+0000", 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046462359999999998 2024-09-10T05:57:02.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172447+0000", 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4731999999999999e-05 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172469+0000", 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1460000000000001e-05 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172598+0000", 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128646 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172642+0000", 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4274999999999999e-05 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.184906+0000", 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012264353 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.185029+0000", 2024-09-10T05:57:02.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123244 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2753 3.21 e74/24 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.329964999, 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016969758000000001, 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.619 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187844+0000", 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2970000000000002e-06 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193441+0000", 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055969189999999997 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193476+0000", 2024-09-10T05:57:02.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5748999999999999e-05 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193493+0000", 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6762999999999999e-05 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193634+0000", 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014096599999999999 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193677+0000", 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3305e-05 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204633+0000", 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010955761 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204811+0000", 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017799800000000001 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.623 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.322109124, 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.624 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:57:02.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2761 3.3c 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.252961676, 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018127095999999999, 2024-09-10T05:57:02.630 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2761 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264849+0000", 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3309999999999997e-06 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270094+0000", 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005245464 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270134+0000", 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9926999999999999e-05 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270157+0000", 2024-09-10T05:57:02.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824999999999999e-05 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270325+0000", 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016784699999999999 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270580+0000", 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025531600000000001 2024-09-10T05:57:02.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270912+0000", 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033126999999999999 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.280570+0000", 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096586569999999993 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282695+0000", 2024-09-10T05:57:02.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021244139999999998 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282853+0000", 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015866799999999999 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282972+0000", 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118377 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2763 3.28 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.2365328950000001, 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019948423, 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2763 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:02.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281276+0000", 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0599999999999999e-06 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286026+0000", 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047498289999999997 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286074+0000", 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7994999999999997e-05 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286099+0000", 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.51e-05 2024-09-10T05:57:02.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286290+0000", 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019037500000000001 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286698+0000", 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000408651 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.287116+0000", 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041778300000000002 2024-09-10T05:57:02.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300422+0000", 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013306226000000001 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300973+0000", 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055055100000000004 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301131+0000", 2024-09-10T05:57:02.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015752100000000001 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301222+0000", 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1331999999999999e-05 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:02.642 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:02.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:02.644 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:02.640+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:02.645 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:02.744 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:02.740+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:02.775 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:02.776 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:02.776 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:02.776 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:02.790 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:02.799 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:02.799 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:02.816 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:02.816 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:02.833 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:02.833 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:02.845 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:02.840+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:02.850 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:02.850 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:02.870 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:02.870 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:02.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:57:02.888 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:02.889 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:02.909 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:02.909 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:02.913 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:02.914 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:02.928 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:02.929 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:02.929 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:02.946 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:02.940+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:03.047 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:03.044+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:03.052 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:03.052 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:03.067 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:03.147 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:03.145+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:03.190 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:03.191 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:03.205 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:03.248 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:03.244+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:03.349 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:03.345+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:03.366 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:03.366 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:03.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:03.471 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:03.469+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:03.550 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:03.550 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:03.551 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:03.549+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:03.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:03.651 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:03.648+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:03.686 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:03.686 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:03.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:03.752 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:03.749+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:03.853 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:03.849+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:57:03.876 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:03.876 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:03.890 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:03.954 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:03.949+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:04.045 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:04.046 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:04.054 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:04.053+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:04.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:04.155 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:04.153+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:04.178 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:04.178 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:04.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:04.255 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:04.253+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:04.314 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:04.314 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:04.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:04.379 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:04.376+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:04.457 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:04.452+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:04.459 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:04.459 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:04.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:04.559 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:04.556+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:04.642 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:04.642 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:04.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:04.659 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:04.657+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:04.760 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:04.757+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:04.822 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:04.823 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:04.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:04.861 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:04.857+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:04.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:04.958 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:04.959 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:04.962 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:04.956+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:04.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:05.063 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:05.060+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:05.096 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:05.096 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:05.113 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:05.113 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:05.129 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:05.130 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:05.142 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:05.142 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:05.146 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:05.146 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:05.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:05.167 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:05.168 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:05.168 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:05.164+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:05.188 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:05.188 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:05.209 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:05.209 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:05.230 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:05.231 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:05.265 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:05.261+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:05.285 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:05.285 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:05.285 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:05.285 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:05.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:05.387 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:05.384+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:05.463 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 91.833467474000003, 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:57:05.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:57:05.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.027945471999999, 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:05.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:57:05.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.0593673260000003, 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:57:05.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:57:05.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:05.483 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7966494490000002, 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:57:05.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:57:05.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.489 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7413508100000001, 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:57:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7120398420000003, 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:57:05.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:57:05.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:05.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:57:05.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6902846680000003, 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.504 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:57:05.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:05.510 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5847051289999996, 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:57:05.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:57:05.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:57:05.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5738972520000001, 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.518 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.519 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:57:05.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:57:05.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:57:05.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:57:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:57:05.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4395278210000004, 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:57:05.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:57:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:57:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:57:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3548144669999997, 2024-09-10T05:57:05.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:57:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.532 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:57:05.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:57:05.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.538 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2852931329999997, 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:57:05.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:05.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:57:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1890802819999999, 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1889339239999996, 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:57:05.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:57:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:57:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:57:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:57:05.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1727954350000003, 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:57:05.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:57:05.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1679544919999998, 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:57:05.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:57:05.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0568781029999998, 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:57:05.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:57:05.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:05.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0051147540000001, 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:57:05.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:57:05.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.979315052, 2024-09-10T05:57:05.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:05.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:57:05.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.93731403, 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:05.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:57:05.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:57:05.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:05.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:05.601 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:05.602 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:05.603 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:05.597+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:05.703 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:05.701+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:05.735 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:05.735 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:05.736 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:05.750 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:05.804 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:05.804+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:05.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:57:05.905 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:05.901+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:05.910 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:05.911 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:05.911 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:05.911 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:05.911 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:05.925 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:06.006 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:06.004+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:06.096 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:06.096 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 97.534768005000004, 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:57:06.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.102 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.631221359000001, 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:06.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:57:06.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:57:06.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:57:06.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:57:06.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:57:06.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:57:06.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1947 3.3 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:06.110 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.69485912, 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018605588999999999, 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1947 2024-09-10T05:57:06.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.112 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:06.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397906+0000", 2024-09-10T05:57:06.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402321+0000", 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044157889999999998 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402355+0000", 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3744000000000001e-05 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402371+0000", 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6135999999999999e-05 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402469+0000", 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7844999999999996e-05 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402634+0000", 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000164644 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402772+0000", 2024-09-10T05:57:06.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137768 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.412200+0000", 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094282930000000008 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416386+0000", 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041860109999999999 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416443+0000", 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6884e-05 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416494+0000", 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0831000000000002e-05 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.119 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2686 3.3 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.119 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:06.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.6133084950000001, 2024-09-10T05:57:06.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015526295000000001, 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2686 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.120 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479442+0000", 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2370000000000001e-06 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483270+0000", 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038281890000000001 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483292+0000", 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2232999999999999e-05 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483303+0000", 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0641e-05 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483406+0000", 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102905 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483629+0000", 2024-09-10T05:57:06.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022338699999999999 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483850+0000", 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022084700000000001 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.492245+0000", 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083952639999999995 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494655+0000", 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024096769999999998 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494835+0000", 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179798 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494965+0000", 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013011699999999999 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2697 3.a e73/24 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4731715210000003, 2024-09-10T05:57:06.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016453567999999998, 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619579+0000", 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9189999999999999e-06 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622839+0000", 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032599949999999999 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622882+0000", 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3118999999999998e-05 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622905+0000", 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3232999999999999e-05 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623007+0000", 2024-09-10T05:57:06.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101598 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623035+0000", 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8772000000000002e-05 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.635939+0000", 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012903694 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636029+0000", 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0237999999999999e-05 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2706 3.1d e73/24 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3827855390000003, 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01721114, 2024-09-10T05:57:06.131 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:06.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709964+0000", 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6690000000000002e-06 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712686+0000", 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027220600000000001 2024-09-10T05:57:06.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712724+0000", 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7376000000000003e-05 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712745+0000", 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0786000000000001e-05 2024-09-10T05:57:06.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712899+0000", 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015498199999999999 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712957+0000", 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7889000000000001e-05 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727050+0000", 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014093114 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727173+0000", 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012226399999999999 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.137 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2719 3.1b e73/24 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head v 73'3, mlcod=65'1)", 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.247195864, 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018608657000000001, 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845553+0000", 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849483+0000", 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039301420000000002 2024-09-10T05:57:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849521+0000", 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849543+0000", 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1869e-05 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849706+0000", 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163132 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849769+0000", 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3162000000000003e-05 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864021+0000", 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014252117 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864160+0000", 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013903599999999999 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2720 3.9 3:90160a04:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2384090390000004, 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016834844000000002, 2024-09-10T05:57:06.142 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2720 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854342+0000", 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0430000000000001e-06 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859157+0000", 2024-09-10T05:57:06.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048145640000000003 2024-09-10T05:57:06.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859195+0000", 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8609000000000003e-05 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859221+0000", 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6086000000000001e-05 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859430+0000", 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020873800000000001 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859733+0000", 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030246400000000001 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859961+0000", 2024-09-10T05:57:06.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022790700000000001 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.870502+0000", 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010541889 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871010+0000", 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050712499999999998 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871106+0000", 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6220999999999999e-05 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871173+0000", 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7198000000000003e-05 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.149 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2721 3.9 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2264412829999998, 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021537937, 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2721 2024-09-10T05:57:06.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866311+0000", 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7260000000000002e-06 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872270+0000", 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059589939999999996 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872300+0000", 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0023e-05 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872321+0000", 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1005999999999998e-05 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872492+0000", 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017168500000000001 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872729+0000", 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236357 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872962+0000", 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023289299999999999 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883222+0000", 2024-09-10T05:57:06.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010260607 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887676+0000", 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044541950000000002 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887772+0000", 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6089999999999996e-05 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887844+0000", 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1360999999999997e-05 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2727 3.1c e74/24 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1558062390000003, 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020405939000000001, 2024-09-10T05:57:06.156 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936942+0000", 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6300000000000004e-07 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940348+0000", 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034059559999999999 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940389+0000", 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1173e-05 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940411+0000", 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2546000000000001e-05 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940673+0000", 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026151599999999999 2024-09-10T05:57:06.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940736+0000", 2024-09-10T05:57:06.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2707999999999997e-05 2024-09-10T05:57:06.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957202+0000", 2024-09-10T05:57:06.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016466524999999999 2024-09-10T05:57:06.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957347+0000", 2024-09-10T05:57:06.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:06.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.162 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.163 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.163 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:06.163 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1556257380000003, 2024-09-10T05:57:06.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:57:06.163 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.164 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.164 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.164 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:57:06.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.165 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:06.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:06.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:57:06.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:57:06.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:57:06.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:57:06.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:57:06.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:57:06.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:57:06.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:57:06.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:57:06.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:57:06.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:57:06.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:57:06.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:06.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:57:06.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:57:06.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:57:06.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:57:06.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:57:06.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:57:06.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:57:06.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:57:06.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:57:06.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:57:06.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.179 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.180 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:06.180 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1466310760000002, 2024-09-10T05:57:06.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:57:06.180 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.181 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.181 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.181 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.181 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:57:06.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.182 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:06.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:06.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:57:06.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:06.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:57:06.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:57:06.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:57:06.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:57:06.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:57:06.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:57:06.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:57:06.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:57:06.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:57:06.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.191 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2737 3.e e74/24 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.0621538299999997, 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019750409, 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030594+0000", 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035304+0000", 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047101030000000002 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035338+0000", 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3969e-05 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035355+0000", 2024-09-10T05:57:06.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6747000000000001e-05 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035496+0000", 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014153599999999999 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035533+0000", 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6675999999999999e-05 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050221+0000", 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014687973999999999 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050344+0000", 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012263000000000001 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.197 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2743 3.34 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.0068521260000001, 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020245447999999999, 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2743 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085897+0000", 2024-09-10T05:57:06.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.243e-06 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091156+0000", 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052584149999999998 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091186+0000", 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0648999999999997e-05 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091206+0000", 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9415999999999998e-05 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091331+0000", 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012479 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091576+0000", 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024558300000000001 2024-09-10T05:57:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091810+0000", 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023423000000000001 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.104889+0000", 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013079084 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105976+0000", 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010860659999999999 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106070+0000", 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4810999999999997e-05 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106140+0000", 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0160999999999995e-05 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2755 3.11 e74/24 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head v 74'8, mlcod=73'6)", 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8807195270000001, 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021403122, 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212031+0000", 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:57:06.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218661+0000", 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066300990000000004 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218698+0000", 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7109e-05 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218716+0000", 2024-09-10T05:57:06.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7776000000000001e-05 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218848+0000", 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013285 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218898+0000", 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9561999999999997e-05 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233312+0000", 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014414009 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233431+0000", 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001187 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.208 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2756 3.1a 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.878668148, 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021135549, 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2756 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214082+0000", 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:57:06.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218251+0000", 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041687790000000001 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218292+0000", 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0602000000000002e-05 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218318+0000", 2024-09-10T05:57:06.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5701999999999999e-05 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218474+0000", 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015660000000000001 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218952+0000", 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047828600000000002 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.219315+0000", 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036209600000000001 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233050+0000", 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013735041999999999 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234930+0000", 2024-09-10T05:57:06.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018799870000000001 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235091+0000", 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016182499999999999 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235215+0000", 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012318999999999999 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2758 3.14 3:2b3c5956:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8586732059999997, 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020489027999999999, 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2758 2024-09-10T05:57:06.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234084+0000", 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0288999999999999e-05 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239117+0000", 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050329579999999997 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239150+0000", 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2391999999999998e-05 2024-09-10T05:57:06.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239168+0000", 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8122999999999999e-05 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239346+0000", 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017855200000000001 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239754+0000", 2024-09-10T05:57:06.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040791800000000001 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.240162+0000", 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040800899999999998 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249324+0000", 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091615710000000003 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254280+0000", 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049566990000000002 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254445+0000", 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016484599999999999 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254563+0000", 2024-09-10T05:57:06.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011767100000000001 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2759 3.3 3:c2c35e3f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.849723666, 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015920593, 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.221 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2759 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:06.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243026+0000", 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.463e-06 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248521+0000", 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054947249999999998 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248562+0000", 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152999999999997e-05 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248585+0000", 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3252e-05 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248713+0000", 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012798700000000001 2024-09-10T05:57:06.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248967+0000", 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025380900000000002 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249206+0000", 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000239433 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258753+0000", 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009546433 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258778+0000", 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5199999999999999e-05 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258865+0000", 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6784000000000001e-05 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258944+0000", 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9354e-05 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2776 3.31 e74/24 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6630472010000004, 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016659686, 2024-09-10T05:57:06.227 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429703+0000", 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9730000000000002e-06 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435067+0000", 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053637779999999996 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435100+0000", 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3473000000000003e-05 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435116+0000", 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6053e-05 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435324+0000", 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020727699999999999 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435367+0000", 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3019000000000003e-05 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446249+0000", 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010882106000000001 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446360+0000", 2024-09-10T05:57:06.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111007 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2777 3.1b e74/24 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6529457929999998, 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016908191999999999, 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.232 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439804+0000", 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7530000000000002e-06 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444587+0000", 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047832309999999998 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444632+0000", 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4502999999999997e-05 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444656+0000", 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3748999999999999e-05 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444878+0000", 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022217 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444944+0000", 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5811999999999999e-05 2024-09-10T05:57:06.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456502+0000", 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011558406 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456710+0000", 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020756799999999999 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.237 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.237 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:06.238 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:06.239 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:06.236+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:06.339 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:06.340+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:06.365 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:06.366 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:06.366 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:06.366 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:06.381 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:06.441 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:06.440+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:06.498 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:06.498 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:06.499 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:06.499 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:06.499 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:06.513 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:06.559 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:06.556+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:06.643 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:06.643 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:06.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:06.643 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.077897242999999, 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:06.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:57:06.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:06.650 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.051086455, 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:57:06.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:57:06.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.219241662000002, 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1812 3.30 3:0f16d871:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:06.662 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.211163268, 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017116908, 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1812 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428955+0000", 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6700000000000001e-06 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431687+0000", 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002732342 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431712+0000", 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5114e-05 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431725+0000", 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2976000000000001e-05 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431862+0000", 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013720799999999999 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432067+0000", 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205028 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432272+0000", 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205105 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.439520+0000", 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072476550000000004 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445702+0000", 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061817640000000002 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445898+0000", 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195928 2024-09-10T05:57:06.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446070+0000", 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017211799999999999 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2704 3.16 3:6b2c0ee3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9572345369999997, 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022182810000000001, 2024-09-10T05:57:06.668 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2704 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682886+0000", 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4429999999999996e-06 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686829+0000", 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039425720000000001 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686867+0000", 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8466000000000001e-05 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686887+0000", 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9629000000000001e-05 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687049+0000", 2024-09-10T05:57:06.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161619 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687342+0000", 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029348500000000001 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687579+0000", 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023733000000000001 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.696533+0000", 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089536040000000004 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704753+0000", 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082205669999999998 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704929+0000", 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017553499999999999 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.705065+0000", 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013556000000000001 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2706 3.1d 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9365347689999997, 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024374384999999998, 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2706 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.675 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703585+0000", 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.287e-06 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709069+0000", 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005484432 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709101+0000", 2024-09-10T05:57:06.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2063000000000001e-05 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709117+0000", 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709221+0000", 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103867 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709490+0000", 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269053 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709739+0000", 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024859600000000002 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.724317+0000", 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014578512 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727648+0000", 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033310420000000002 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727824+0000", 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017585100000000001 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727956+0000", 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013196 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.680 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2707 3.5 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9271287910000003, 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016855370000000001, 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.681 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2707 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712991+0000", 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5700000000000001e-06 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717888+0000", 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048966290000000004 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717925+0000", 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7404999999999998e-05 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717946+0000", 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0662999999999999e-05 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718163+0000", 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021718400000000001 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718403+0000", 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240196 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:06.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718611+0000", 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208161 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728002+0000", 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093903579999999997 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729567+0000", 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001565005 2024-09-10T05:57:06.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729711+0000", 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014411599999999999 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729843+0000", 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013208299999999999 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2708 3.2a 3:546514ef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9170992900000003, 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021062501000000001, 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.688 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2708 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723020+0000", 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6259999999999999e-06 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727965+0000", 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049453429999999996 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727991+0000", 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6083000000000001e-05 2024-09-10T05:57:06.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728016+0000", 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728170+0000", 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015342900000000001 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728472+0000", 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030251099999999999 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728707+0000", 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023466700000000001 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739602+0000", 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010895083 2024-09-10T05:57:06.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743763+0000", 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041615360000000004 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743947+0000", 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018321400000000001 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744080+0000", 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013281999999999999 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2709 3.36 e73/24 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head v 73'5, mlcod=72'3)", 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8995764660000001, 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015622295, 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740542+0000", 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744345+0000", 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038023129999999999 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744379+0000", 2024-09-10T05:57:06.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4224999999999998e-05 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744404+0000", 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4586000000000001e-05 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744558+0000", 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000154146 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744622+0000", 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4491000000000003e-05 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756023+0000", 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011401262000000001 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756162+0000", 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013869199999999999 2024-09-10T05:57:06.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2711 3.3c 3:3f29615d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8796646419999998, 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015648141000000001, 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2711 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:06.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760456+0000", 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2869999999999998e-06 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764614+0000", 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041582520000000003 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764651+0000", 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6439000000000001e-05 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764670+0000", 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9536000000000001e-05 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764820+0000", 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974300000000001 2024-09-10T05:57:06.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765073+0000", 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025336599999999999 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765314+0000", 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024024300000000001 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.774451+0000", 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091372620000000002 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775903+0000", 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001452432 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775996+0000", 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2283999999999999e-05 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.776100+0000", 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010429699999999999 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2714 3.16 3:696d6af6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.850527595, 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018296902, 2024-09-10T05:57:06.705 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2714 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789592+0000", 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4199999999999999e-06 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793519+0000", 2024-09-10T05:57:06.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039268360000000004 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793560+0000", 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1078000000000002e-05 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793578+0000", 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793710+0000", 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013122899999999999 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793970+0000", 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025991600000000001 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.794207+0000", 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023692299999999999 2024-09-10T05:57:06.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.806549+0000", 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012342671 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807674+0000", 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001124702 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807774+0000", 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9987000000000003e-05 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807886+0000", 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111753 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.711 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7124671029999998, 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:06.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:57:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:57:06.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.6327699620000002, 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.718 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:57:06.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:57:06.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2747 3.2a 3:56df8694:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5134883260000001, 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336575999999999, 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2747 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126632+0000", 2024-09-10T05:57:06.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130540+0000", 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003907794 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130580+0000", 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0194000000000002e-05 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130602+0000", 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2169999999999999e-05 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130776+0000", 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174005 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131200+0000", 2024-09-10T05:57:06.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042367199999999999 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131649+0000", 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000449171 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.146739+0000", 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01508959 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150675+0000", 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003936419 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150810+0000", 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135162 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150965+0000", 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015443299999999999 2024-09-10T05:57:06.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2749 3.16 3:6b50c908:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4947048829999998, 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020765693000000002, 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2749 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:06.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145415+0000", 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149511+0000", 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040962409999999996 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149539+0000", 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7231000000000001e-05 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149552+0000", 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3771000000000001e-05 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149708+0000", 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155174 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150116+0000", 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040834600000000002 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150545+0000", 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000428641 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.158644+0000", 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080993990000000002 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.165933+0000", 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072888739999999999 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166073+0000", 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013972499999999999 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166177+0000", 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104597 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2751 3.21 e74/24 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4723519080000003, 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017265005, 2024-09-10T05:57:06.738 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167766+0000", 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0590000000000001e-06 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172413+0000", 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046462359999999998 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172447+0000", 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4731999999999999e-05 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172469+0000", 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1460000000000001e-05 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172598+0000", 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128646 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172642+0000", 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4274999999999999e-05 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.184906+0000", 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012264353 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.185029+0000", 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123244 2024-09-10T05:57:06.742 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2753 3.21 e74/24 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4522749900000003, 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016969758000000001, 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.743 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187844+0000", 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2970000000000002e-06 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193441+0000", 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055969189999999997 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193476+0000", 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5748999999999999e-05 2024-09-10T05:57:06.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193493+0000", 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6762999999999999e-05 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193634+0000", 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014096599999999999 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193677+0000", 2024-09-10T05:57:06.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3305e-05 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204633+0000", 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010955761 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204811+0000", 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017799800000000001 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4444191149999996, 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.748 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:57:06.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2761 3.3c 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3752716669999998, 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018127095999999999, 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2761 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264849+0000", 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3309999999999997e-06 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270094+0000", 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005245464 2024-09-10T05:57:06.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270134+0000", 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9926999999999999e-05 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270157+0000", 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824999999999999e-05 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270325+0000", 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016784699999999999 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270580+0000", 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025531600000000001 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270912+0000", 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033126999999999999 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.280570+0000", 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096586569999999993 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282695+0000", 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021244139999999998 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282853+0000", 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015866799999999999 2024-09-10T05:57:06.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282972+0000", 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118377 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2763 3.28 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3588428859999997, 2024-09-10T05:57:06.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019948423, 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2763 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:06.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281276+0000", 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0599999999999999e-06 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286026+0000", 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047498289999999997 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286074+0000", 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7994999999999997e-05 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286099+0000", 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.51e-05 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286290+0000", 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019037500000000001 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286698+0000", 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000408651 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:06.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.287116+0000", 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041778300000000002 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300422+0000", 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013306226000000001 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300973+0000", 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055055100000000004 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301131+0000", 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015752100000000001 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301222+0000", 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1331999999999999e-05 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:06.766 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:06.767 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:06.640+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:06.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:06.769 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:06.768+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:57:06.869 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:06.864+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:06.939 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:06.939 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:06.940 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:06.940 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:06.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:06.995 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:06.992+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:07.072 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:07.068+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:07.117 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:07.118 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:07.131 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:07.175 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:07.172+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:07.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:07.295 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:07.296+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:07.298 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:07.298 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:07.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:07.298 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 96.705837723000002, 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:57:07.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:57:07.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:57:07.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:57:07.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:57:07.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:57:07.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1667 3.3f e66/24 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.729726420999999, 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020534329, 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565034+0000", 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4400000000000001e-07 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569603+0000", 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045689320000000004 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569639+0000", 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-10T05:57:07.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569658+0000", 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9582999999999999e-05 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569788+0000", 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129395 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569843+0000", 2024-09-10T05:57:07.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4701999999999999e-05 2024-09-10T05:57:07.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585439+0000", 2024-09-10T05:57:07.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015596765 2024-09-10T05:57:07.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585568+0000", 2024-09-10T05:57:07.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128288 2024-09-10T05:57:07.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.314 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.314 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2687 3.10 3:0bdf9def:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:07.315 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:07.315 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.802945373, 2024-09-10T05:57:07.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015293677, 2024-09-10T05:57:07.315 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.315 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.315 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.316 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2687 2024-09-10T05:57:07.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.316 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:07.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:07.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491818+0000", 2024-09-10T05:57:07.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:07.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495801+0000", 2024-09-10T05:57:07.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039831700000000003 2024-09-10T05:57:07.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495836+0000", 2024-09-10T05:57:07.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4986e-05 2024-09-10T05:57:07.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495853+0000", 2024-09-10T05:57:07.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7082999999999999e-05 2024-09-10T05:57:07.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496003+0000", 2024-09-10T05:57:07.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149946 2024-09-10T05:57:07.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496248+0000", 2024-09-10T05:57:07.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024488999999999999 2024-09-10T05:57:07.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:07.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496481+0000", 2024-09-10T05:57:07.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023332299999999999 2024-09-10T05:57:07.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.503197+0000", 2024-09-10T05:57:07.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006716039 2024-09-10T05:57:07.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.506985+0000", 2024-09-10T05:57:07.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037875700000000001 2024-09-10T05:57:07.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507052+0000", 2024-09-10T05:57:07.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7014000000000006e-05 2024-09-10T05:57:07.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507108+0000", 2024-09-10T05:57:07.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6378999999999997e-05 2024-09-10T05:57:07.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.328 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.329 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.329 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2690 3.20 3:0621a9df:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:07.329 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:07.329 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.7628470189999996, 2024-09-10T05:57:07.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013809238, 2024-09-10T05:57:07.330 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.330 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.330 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.331 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.331 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2690 2024-09-10T05:57:07.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.332 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531915+0000", 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6529999999999998e-06 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535839+0000", 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003923569 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535872+0000", 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2892000000000003e-05 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535889+0000", 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946e-05 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535955+0000", 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6314000000000002e-05 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536068+0000", 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011280100000000001 2024-09-10T05:57:07.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536160+0000", 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1886999999999996e-05 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.542293+0000", 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061327559999999996 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545600+0000", 2024-09-10T05:57:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033079699999999999 2024-09-10T05:57:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545663+0000", 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2299999999999996e-05 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545722+0000", 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9150000000000001e-05 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.339 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2697 3.a 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:07.339 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:07.339 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.6800916949999998, 2024-09-10T05:57:07.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021976678999999999, 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2697 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:07.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614672+0000", 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9570000000000004e-06 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618642+0000", 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003970215 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618682+0000", 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0241999999999999e-05 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618702+0000", 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9259e-05 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618865+0000", 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162893 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619114+0000", 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024920299999999998 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619366+0000", 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025260899999999999 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.633958+0000", 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014591695 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636314+0000", 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023562790000000002 2024-09-10T05:57:07.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636498+0000", 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018343799999999999 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636645+0000", 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014688900000000001 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2702 3.33 e73/57 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head v 73'6, mlcod=72'4)", 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.6290280509999997, 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011423348, 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:07.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665735+0000", 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0730000000000001e-06 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670171+0000", 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044365059999999998 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670193+0000", 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2195999999999999e-05 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670205+0000", 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1248e-05 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670278+0000", 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3145000000000005e-05 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670297+0000", 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9145000000000001e-05 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677061+0000", 2024-09-10T05:57:07.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067644940000000002 2024-09-10T05:57:07.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677155+0000", 2024-09-10T05:57:07.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3541000000000004e-05 2024-09-10T05:57:07.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.351 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2709 3.36 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:07.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:07.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.5596427510000002, 2024-09-10T05:57:07.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021772117000000001, 2024-09-10T05:57:07.352 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2709 2024-09-10T05:57:07.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.353 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:07.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:07.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735123+0000", 2024-09-10T05:57:07.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2024-09-10T05:57:07.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739149+0000", 2024-09-10T05:57:07.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040258899999999999 2024-09-10T05:57:07.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739195+0000", 2024-09-10T05:57:07.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6238e-05 2024-09-10T05:57:07.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739226+0000", 2024-09-10T05:57:07.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0756000000000002e-05 2024-09-10T05:57:07.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739431+0000", 2024-09-10T05:57:07.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020536799999999999 2024-09-10T05:57:07.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739867+0000", 2024-09-10T05:57:07.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043582799999999997 2024-09-10T05:57:07.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:07.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740323+0000", 2024-09-10T05:57:07.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045658999999999999 2024-09-10T05:57:07.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750593+0000", 2024-09-10T05:57:07.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010269215999999999 2024-09-10T05:57:07.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756560+0000", 2024-09-10T05:57:07.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059669450000000004 2024-09-10T05:57:07.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756768+0000", 2024-09-10T05:57:07.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020802799999999999 2024-09-10T05:57:07.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756889+0000", 2024-09-10T05:57:07.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012152200000000001 2024-09-10T05:57:07.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.364 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2710 3.1e e73/57 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head v 73'2, mlcod=0'0)", 2024-09-10T05:57:07.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:07.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.543907549, 2024-09-10T05:57:07.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016219428000000001, 2024-09-10T05:57:07.365 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.365 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.366 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:07.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:07.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750855+0000", 2024-09-10T05:57:07.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:07.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755688+0000", 2024-09-10T05:57:07.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048322399999999998 2024-09-10T05:57:07.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755736+0000", 2024-09-10T05:57:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8925999999999999e-05 2024-09-10T05:57:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755761+0000", 2024-09-10T05:57:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4598999999999999e-05 2024-09-10T05:57:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755935+0000", 2024-09-10T05:57:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017345500000000001 2024-09-10T05:57:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755979+0000", 2024-09-10T05:57:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4385000000000003e-05 2024-09-10T05:57:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.766931+0000", 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010952051000000001 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.767072+0000", 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014061600000000001 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2712 3.1e e73/57 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.5221161219999999, 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015148445, 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:07.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772653+0000", 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.02e-06 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778513+0000", 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058600609999999997 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778542+0000", 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9411999999999999e-05 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778557+0000", 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5359999999999999e-05 2024-09-10T05:57:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778655+0000", 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7146999999999997e-05 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778698+0000", 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3659000000000003e-05 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787711+0000", 2024-09-10T05:57:07.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090123990000000008 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787792+0000", 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1386999999999999e-05 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2722 3.1e e73/57 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:07.379 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.4168075480000004, 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014888180000000001, 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877955+0000", 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.27e-06 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883040+0000", 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050841430000000002 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883073+0000", 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3506000000000001e-05 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883090+0000", 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6966e-05 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883250+0000", 2024-09-10T05:57:07.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015971599999999999 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883296+0000", 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5785000000000003e-05 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892725+0000", 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094290840000000008 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892840+0000", 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011571 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2728 3.34 e74/24 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head v 74'3, mlcod=72'1)", 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3454663570000003, 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020234839000000001, 2024-09-10T05:57:07.384 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949294+0000", 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3600000000000002e-07 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952508+0000", 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032136700000000001 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952549+0000", 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1118000000000002e-05 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952573+0000", 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4017000000000001e-05 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952750+0000", 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017677799999999999 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952815+0000", 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4788000000000004e-05 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969436+0000", 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016621585000000001 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969528+0000", 2024-09-10T05:57:07.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1947000000000006e-05 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2739 3.a 3:50ecfca4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.2503662740000001, 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018342160999999999, 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.389 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2739 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044398+0000", 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0570000000000003e-06 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048829+0000", 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044313640000000001 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048880+0000", 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0667000000000001e-05 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048905+0000", 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5636e-05 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049094+0000", 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189106 2024-09-10T05:57:07.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049502+0000", 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040768500000000002 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049904+0000", 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040155200000000001 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.058896+0000", 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089927700000000006 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062570+0000", 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003673272 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062659+0000", 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9221000000000005e-05 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062736+0000", 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6830999999999997e-05 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2741 3.26 3:6709f12d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.2311074450000001, 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017830538999999999, 2024-09-10T05:57:07.395 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2741 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:07.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063654+0000", 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.187e-06 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067623+0000", 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039688650000000002 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067651+0000", 2024-09-10T05:57:07.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7637e-05 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067664+0000", 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3497e-05 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067771+0000", 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106457 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068031+0000", 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026004000000000001 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068262+0000", 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230829 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.080068+0000", 2024-09-10T05:57:07.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011806291 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081260+0000", 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001191819 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081407+0000", 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014721299999999999 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081483+0000", 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5704000000000006e-05 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2743 3.34 e74/24 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.2027311909999998, 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013595565, 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092032+0000", 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0910000000000001e-06 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094626+0000", 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025944179999999998 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094669+0000", 2024-09-10T05:57:07.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2982000000000003e-05 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094698+0000", 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8951000000000001e-05 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094824+0000", 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012603000000000001 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094862+0000", 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7524999999999997e-05 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105528+0000", 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010666556000000001 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105624+0000", 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6012000000000002e-05 2024-09-10T05:57:07.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2757 3.2e e74/24 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0690391650000004, 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018393152999999999, 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3e-07 2024-09-10T05:57:07.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231370+0000", 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056484719999999999 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231401+0000", 2024-09-10T05:57:07.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1139000000000001e-05 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231417+0000", 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231573+0000", 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015524399999999999 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231613+0000", 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0725000000000001e-05 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243986+0000", 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012372342 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.244114+0000", 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128016 2024-09-10T05:57:07.411 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2766 3.a 3:53b220aa:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9797209520000001, 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02050532, 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.412 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2766 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:07.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315042+0000", 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320520+0000", 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054777819999999996 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320561+0000", 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1309e-05 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320580+0000", 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9225999999999999e-05 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320754+0000", 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017325500000000001 2024-09-10T05:57:07.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321183+0000", 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042883500000000002 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321607+0000", 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042457500000000001 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333931+0000", 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012323831 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335304+0000", 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001373211 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335422+0000", 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011828999999999999 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335544+0000", 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121623 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2770 3.a 3:5300e91c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9308686289999999, 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019665727000000001, 2024-09-10T05:57:07.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2770 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363896+0000", 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8389999999999997e-06 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368218+0000", 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043216349999999999 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368257+0000", 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9641999999999998e-05 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368276+0000", 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.914e-05 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368444+0000", 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016791199999999999 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368700+0000", 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025589900000000002 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368939+0000", 2024-09-10T05:57:07.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023926700000000001 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.382054+0000", 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013114139 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383331+0000", 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012779040000000001 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383434+0000", 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010233700000000001 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383557+0000", 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2773 3.3f e74/24 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head v 74'4, mlcod=71'2)", 2024-09-10T05:57:07.424 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8942660939999998, 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011963965, 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400496+0000", 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8200000000000001e-06 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404258+0000", 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003761707 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404300+0000", 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1742000000000001e-05 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404318+0000", 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7989999999999999e-05 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404480+0000", 2024-09-10T05:57:07.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162378 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404551+0000", 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0462000000000004e-05 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412290+0000", 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077389110000000002 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412458+0000", 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016795499999999999 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2774 3.1e e74/57 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8890717180000003, 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016469788999999999, 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405690+0000", 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3539999999999998e-06 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412675+0000", 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069848089999999998 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412710+0000", 2024-09-10T05:57:07.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5015999999999998e-05 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412735+0000", 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5272000000000001e-05 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412912+0000", 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017682599999999999 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412970+0000", 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8017999999999999e-05 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422024+0000", 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090533639999999995 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422158+0000", 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013412999999999999 2024-09-10T05:57:07.433 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2779 3.36 3:6deaa553:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8352735649999996, 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014954103, 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:07.434 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2779 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:07.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459490+0000", 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7620000000000001e-06 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463585+0000", 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040951779999999997 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:07.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463622+0000", 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6748000000000001e-05 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463641+0000", 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8685000000000002e-05 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463728+0000", 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7354000000000004e-05 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463858+0000", 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130464 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463967+0000", 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108853 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.473175+0000", 2024-09-10T05:57:07.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092074819999999995 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474264+0000", 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001089759 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474369+0000", 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104374 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:07.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474440+0000", 2024-09-10T05:57:07.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1444000000000002e-05 2024-09-10T05:57:07.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:07.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:07.440 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:07.441 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:07.442 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:07.442 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:07.443 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:07.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:07.444 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:07.440+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:07.444 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:07.444 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:07.458 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:07.458 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:07.477 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:07.477 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:07.496 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:07.496 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:07.515 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:07.515 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:07.536 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:07.536 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:07.542 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:07.536+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:07.575 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:07.575 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:07.589 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:07.675 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:07.672+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:07.744 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:07.740+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:07.758 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:07.758 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:07.773 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:07.845 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:07.844+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:07.942 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:07.943 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:07.945 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:07.940+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:07.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:08.046 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:08.040+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:08.088 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:08.089 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:08.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:08.147 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:08.144+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:08.219 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:08.219 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:08.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:08.283 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:08.284+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:08.349 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:08.348+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:08.356 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:08.356 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:08.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:08.451 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:08.444+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:08.535 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:08.536 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:08.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:08.552 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:08.548+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:08.653 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:08.652+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:08.673 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:08.673 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:08.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:08.753 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:08.748+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:08.850 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:08.850 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:08.854 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:08.848+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:08.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:08.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:57:08.955 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:08.952+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:08.988 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:08.988 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:09.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:09.056 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:09.056+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:09.125 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:09.125 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:09.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:09.157 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:09.152+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:09.258 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:09.256+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:09.307 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:09.307 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:09.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:09.364 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:09.364+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:09.459 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:09.460+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:09.485 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:09.485 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:09.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:09.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:09.583 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:09.584+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:09.661 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:09.661 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:09.661 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:09.660+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:09.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:09.721 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:09.721 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:09.737 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:09.738 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:09.754 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:09.754 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:09.762 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:09.756+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:09.771 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:09.771 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:09.791 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:09.792 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:09.812 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:09.812 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 96.204163868999998, 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:57:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:57:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:57:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:57:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:57:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:57:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 22.398641866999998, 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:57:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:57:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:57:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:57:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:57:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:57:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:57:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4300637209999998, 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1673458439999997, 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:57:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:57:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.1120472049999996, 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0827362370000007, 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0609810629999998, 2024-09-10T05:57:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:57:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9554015239999991, 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:57:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:57:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.9445936469999996, 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.8102242159999999, 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:57:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:57:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:57:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:57:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:57:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:57:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:57:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7255108620000001, 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:57:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:57:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6559895279999992, 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:57:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:57:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:57:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5597766770000003, 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:57:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.559630319, 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:57:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:57:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5434918300000007, 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5386508869999993, 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:57:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:57:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4275744980000002, 2024-09-10T05:57:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:57:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:57:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.3758111490000005, 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:57:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.350011447, 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:57:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.3080104249999991, 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:57:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:09.972 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:09.973 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:09.974 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:09.975 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:57:09.977 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:09.972+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:10.078 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:10.072+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:10.107 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:10.108 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:10.108 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:10.108 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:10.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:10.179 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:10.175+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:10.280 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:10.279+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:10.287 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:10.287 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:10.287 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:10.302 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:10.381 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:10.379+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:10.420 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:57:10.420 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 101.860139117, 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:57:10.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.956592471, 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:10.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:57:10.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:57:10.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:57:10.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:57:10.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1947 3.3 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:10.432 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.020230231999999, 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018605588999999999, 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1947 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397906+0000", 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-10T05:57:10.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402321+0000", 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044157889999999998 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402355+0000", 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3744000000000001e-05 2024-09-10T05:57:10.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402371+0000", 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6135999999999999e-05 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402469+0000", 2024-09-10T05:57:10.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7844999999999996e-05 2024-09-10T05:57:10.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402634+0000", 2024-09-10T05:57:10.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000164644 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402772+0000", 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137768 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.412200+0000", 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094282930000000008 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416386+0000", 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041860109999999999 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416443+0000", 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6884e-05 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416494+0000", 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0831000000000002e-05 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.440 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2686 3.3 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.9386796069999992, 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015526295000000001, 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2686 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479442+0000", 2024-09-10T05:57:10.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2370000000000001e-06 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483270+0000", 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038281890000000001 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483292+0000", 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2232999999999999e-05 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483303+0000", 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0641e-05 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483406+0000", 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102905 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483629+0000", 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022338699999999999 2024-09-10T05:57:10.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483850+0000", 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022084700000000001 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.492245+0000", 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083952639999999995 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494655+0000", 2024-09-10T05:57:10.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024096769999999998 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494835+0000", 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179798 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494965+0000", 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013011699999999999 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2697 3.a e73/24 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7985426330000003, 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016453567999999998, 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619579+0000", 2024-09-10T05:57:10.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9189999999999999e-06 2024-09-10T05:57:10.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622839+0000", 2024-09-10T05:57:10.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032599949999999999 2024-09-10T05:57:10.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622882+0000", 2024-09-10T05:57:10.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3118999999999998e-05 2024-09-10T05:57:10.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622905+0000", 2024-09-10T05:57:10.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3232999999999999e-05 2024-09-10T05:57:10.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623007+0000", 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101598 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623035+0000", 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8772000000000002e-05 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.635939+0000", 2024-09-10T05:57:10.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012903694 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636029+0000", 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0237999999999999e-05 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2706 3.1d e73/24 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:10.454 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7081566509999995, 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01721114, 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709964+0000", 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6690000000000002e-06 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712686+0000", 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027220600000000001 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712724+0000", 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7376000000000003e-05 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712745+0000", 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0786000000000001e-05 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712899+0000", 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015498199999999999 2024-09-10T05:57:10.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712957+0000", 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7889000000000001e-05 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727050+0000", 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014093114 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727173+0000", 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012226399999999999 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2719 3.1b e73/24 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head v 73'3, mlcod=65'1)", 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5725669759999992, 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018608657000000001, 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845553+0000", 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849483+0000", 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039301420000000002 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849521+0000", 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849543+0000", 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1869e-05 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849706+0000", 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163132 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849769+0000", 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3162000000000003e-05 2024-09-10T05:57:10.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864021+0000", 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014252117 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864160+0000", 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013903599999999999 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2720 3.9 3:90160a04:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5637801509999996, 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016834844000000002, 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2720 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.464 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854342+0000", 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0430000000000001e-06 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859157+0000", 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048145640000000003 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859195+0000", 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8609000000000003e-05 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859221+0000", 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6086000000000001e-05 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859430+0000", 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020873800000000001 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859733+0000", 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030246400000000001 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859961+0000", 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022790700000000001 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.870502+0000", 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010541889 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871010+0000", 2024-09-10T05:57:10.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050712499999999998 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871106+0000", 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6220999999999999e-05 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871173+0000", 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7198000000000003e-05 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2721 3.9 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5518123950000007, 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021537937, 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2721 2024-09-10T05:57:10.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866311+0000", 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7260000000000002e-06 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872270+0000", 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059589939999999996 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872300+0000", 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0023e-05 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872321+0000", 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1005999999999998e-05 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872492+0000", 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017168500000000001 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872729+0000", 2024-09-10T05:57:10.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236357 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872962+0000", 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023289299999999999 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883222+0000", 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010260607 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887676+0000", 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044541950000000002 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887772+0000", 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6089999999999996e-05 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887844+0000", 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1360999999999997e-05 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.475 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2727 3.1c e74/24 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.4811773509999995, 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020405939000000001, 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936942+0000", 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6300000000000004e-07 2024-09-10T05:57:10.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940348+0000", 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034059559999999999 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940389+0000", 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1173e-05 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940411+0000", 2024-09-10T05:57:10.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2546000000000001e-05 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940673+0000", 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026151599999999999 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940736+0000", 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2707999999999997e-05 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957202+0000", 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016466524999999999 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957347+0000", 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:10.480 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.4809968500000004, 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:57:10.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.486 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.4720021879999994, 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:57:10.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:10.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.492 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2737 3.e e74/24 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.3875249420000006, 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019750409, 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030594+0000", 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035304+0000", 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047101030000000002 2024-09-10T05:57:10.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035338+0000", 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3969e-05 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035355+0000", 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6747000000000001e-05 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035496+0000", 2024-09-10T05:57:10.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014153599999999999 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035533+0000", 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6675999999999999e-05 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050221+0000", 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014687973999999999 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050344+0000", 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012263000000000001 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2743 3.34 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.3322232379999992, 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020245447999999999, 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2743 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085897+0000", 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.243e-06 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091156+0000", 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052584149999999998 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091186+0000", 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0648999999999997e-05 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091206+0000", 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9415999999999998e-05 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091331+0000", 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012479 2024-09-10T05:57:10.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091576+0000", 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024558300000000001 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091810+0000", 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023423000000000001 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.104889+0000", 2024-09-10T05:57:10.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013079084 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105976+0000", 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010860659999999999 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106070+0000", 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4810999999999997e-05 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106140+0000", 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0160999999999995e-05 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2755 3.11 e74/24 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head v 74'8, mlcod=73'6)", 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.2060906389999992, 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021403122, 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.503 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212031+0000", 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218661+0000", 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066300990000000004 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218698+0000", 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7109e-05 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218716+0000", 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7776000000000001e-05 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218848+0000", 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013285 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218898+0000", 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9561999999999997e-05 2024-09-10T05:57:10.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233312+0000", 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014414009 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233431+0000", 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001187 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2756 3.1a 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.2040392600000001, 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021135549, 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2756 2024-09-10T05:57:10.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214082+0000", 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218251+0000", 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041687790000000001 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218292+0000", 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0602000000000002e-05 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218318+0000", 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5701999999999999e-05 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218474+0000", 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015660000000000001 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218952+0000", 2024-09-10T05:57:10.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047828600000000002 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.219315+0000", 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036209600000000001 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233050+0000", 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013735041999999999 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234930+0000", 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018799870000000001 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235091+0000", 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016182499999999999 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235215+0000", 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012318999999999999 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.513 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2758 3.14 3:2b3c5956:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.1840443179999998, 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020489027999999999, 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.514 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2758 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234084+0000", 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0288999999999999e-05 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239117+0000", 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050329579999999997 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239150+0000", 2024-09-10T05:57:10.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2391999999999998e-05 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239168+0000", 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8122999999999999e-05 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239346+0000", 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017855200000000001 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239754+0000", 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040791800000000001 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.240162+0000", 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040800899999999998 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249324+0000", 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091615710000000003 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254280+0000", 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049566990000000002 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254445+0000", 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016484599999999999 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254563+0000", 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011767100000000001 2024-09-10T05:57:10.519 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2759 3.3 3:c2c35e3f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.1750947780000001, 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015920593, 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:10.520 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2759 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243026+0000", 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.463e-06 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248521+0000", 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054947249999999998 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248562+0000", 2024-09-10T05:57:10.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152999999999997e-05 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248585+0000", 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3252e-05 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248713+0000", 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012798700000000001 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248967+0000", 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025380900000000002 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249206+0000", 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000239433 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258753+0000", 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009546433 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258778+0000", 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5199999999999999e-05 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258865+0000", 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6784000000000001e-05 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258944+0000", 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9354e-05 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2776 3.31 e74/24 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9884183130000004, 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016659686, 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.526 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429703+0000", 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9730000000000002e-06 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435067+0000", 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053637779999999996 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435100+0000", 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3473000000000003e-05 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435116+0000", 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6053e-05 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435324+0000", 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020727699999999999 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435367+0000", 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3019000000000003e-05 2024-09-10T05:57:10.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446249+0000", 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010882106000000001 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446360+0000", 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111007 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2777 3.1b e74/24 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9783169049999998, 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016908191999999999, 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439804+0000", 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7530000000000002e-06 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444587+0000", 2024-09-10T05:57:10.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047832309999999998 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444632+0000", 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4502999999999997e-05 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444656+0000", 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3748999999999999e-05 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444878+0000", 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022217 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444944+0000", 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5811999999999999e-05 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456502+0000", 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011558406 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:10.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456710+0000", 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020756799999999999 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:10.535 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:10.537 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:10.537 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:10.536+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:10.637 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:10.632+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:10.701 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:10.702 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:10.702 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:10.702 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:10.715 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:10.760 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:10.756+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:10.839 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:10.839+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:10.887 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:10.887 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:10.887 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:10.887 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:10.888 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:10.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:10.940 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:10.939+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:11.029 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:11.029 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:11.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:11.029 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.463193334, 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.030 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:57:11.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:57:11.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:57:11.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.036 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.436382546000001, 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.037 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:57:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:57:11.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.604537752999999, 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:57:11.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:57:11.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:57:11.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:57:11.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:57:11.050 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.050 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.050 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1812 3.30 3:0f16d871:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.596459359000001, 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017116908, 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.051 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1812 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428955+0000", 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6700000000000001e-06 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431687+0000", 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002732342 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431712+0000", 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5114e-05 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431725+0000", 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2976000000000001e-05 2024-09-10T05:57:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431862+0000", 2024-09-10T05:57:11.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013720799999999999 2024-09-10T05:57:11.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432067+0000", 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205028 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432272+0000", 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205105 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.439520+0000", 2024-09-10T05:57:11.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072476550000000004 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445702+0000", 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061817640000000002 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445898+0000", 2024-09-10T05:57:11.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195928 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446070+0000", 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017211799999999999 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2704 3.16 3:6b2c0ee3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.058 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.342530628, 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022182810000000001, 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2704 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682886+0000", 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4429999999999996e-06 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686829+0000", 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039425720000000001 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686867+0000", 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8466000000000001e-05 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686887+0000", 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9629000000000001e-05 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687049+0000", 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161619 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687342+0000", 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029348500000000001 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687579+0000", 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023733000000000001 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.696533+0000", 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089536040000000004 2024-09-10T05:57:11.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704753+0000", 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082205669999999998 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704929+0000", 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017553499999999999 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.705065+0000", 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013556000000000001 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.065 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2706 3.1d 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.32183086, 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024374384999999998, 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.066 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2706 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703585+0000", 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.287e-06 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709069+0000", 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005484432 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709101+0000", 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2063000000000001e-05 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709117+0000", 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709221+0000", 2024-09-10T05:57:11.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103867 2024-09-10T05:57:11.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709490+0000", 2024-09-10T05:57:11.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269053 2024-09-10T05:57:11.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709739+0000", 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024859600000000002 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.724317+0000", 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014578512 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727648+0000", 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033310420000000002 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727824+0000", 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017585100000000001 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727956+0000", 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013196 2024-09-10T05:57:11.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2707 3.5 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.312424882, 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016855370000000001, 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.073 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2707 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:11.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712991+0000", 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5700000000000001e-06 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717888+0000", 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048966290000000004 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717925+0000", 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7404999999999998e-05 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717946+0000", 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0662999999999999e-05 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718163+0000", 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021718400000000001 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718403+0000", 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240196 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718611+0000", 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208161 2024-09-10T05:57:11.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728002+0000", 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093903579999999997 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729567+0000", 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001565005 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729711+0000", 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014411599999999999 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729843+0000", 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013208299999999999 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.080 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2708 3.2a 3:546514ef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.302395381, 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021062501000000001, 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2708 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723020+0000", 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6259999999999999e-06 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727965+0000", 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049453429999999996 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727991+0000", 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6083000000000001e-05 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728016+0000", 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728170+0000", 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015342900000000001 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728472+0000", 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030251099999999999 2024-09-10T05:57:11.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728707+0000", 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023466700000000001 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739602+0000", 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010895083 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743763+0000", 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041615360000000004 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743947+0000", 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018321400000000001 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744080+0000", 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013281999999999999 2024-09-10T05:57:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2709 3.36 e73/24 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head v 73'5, mlcod=72'3)", 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.284872557, 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015622295, 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740542+0000", 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744345+0000", 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038023129999999999 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744379+0000", 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4224999999999998e-05 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744404+0000", 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4586000000000001e-05 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744558+0000", 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000154146 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744622+0000", 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4491000000000003e-05 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756023+0000", 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011401262000000001 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756162+0000", 2024-09-10T05:57:11.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013869199999999999 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2711 3.3c 3:3f29615d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.264960733000001, 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015648141000000001, 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2711 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760456+0000", 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2869999999999998e-06 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764614+0000", 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041582520000000003 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764651+0000", 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6439000000000001e-05 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764670+0000", 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9536000000000001e-05 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764820+0000", 2024-09-10T05:57:11.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974300000000001 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765073+0000", 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025336599999999999 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765314+0000", 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024024300000000001 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.774451+0000", 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091372620000000002 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775903+0000", 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001452432 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775996+0000", 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2283999999999999e-05 2024-09-10T05:57:11.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.776100+0000", 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010429699999999999 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2714 3.16 3:696d6af6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:11.098 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.235823686, 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018296902, 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2714 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789592+0000", 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4199999999999999e-06 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793519+0000", 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039268360000000004 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793560+0000", 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1078000000000002e-05 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793578+0000", 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-10T05:57:11.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793710+0000", 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013122899999999999 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793970+0000", 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025991600000000001 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.794207+0000", 2024-09-10T05:57:11.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023692299999999999 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.806549+0000", 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012342671 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807674+0000", 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001124702 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807774+0000", 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9987000000000003e-05 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807886+0000", 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111753 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.104 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.097763194000001, 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:11.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:57:11.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:57:11.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.111 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.018066053, 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.112 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:57:11.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:57:11.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2747 3.2a 3:56df8694:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.8987844169999999, 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336575999999999, 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2747 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.118 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:11.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126632+0000", 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130540+0000", 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003907794 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130580+0000", 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0194000000000002e-05 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130602+0000", 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2169999999999999e-05 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130776+0000", 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174005 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131200+0000", 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042367199999999999 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131649+0000", 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000449171 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.146739+0000", 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01508959 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150675+0000", 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003936419 2024-09-10T05:57:11.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150810+0000", 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135162 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150965+0000", 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015443299999999999 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2749 3.16 3:6b50c908:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.8800009739999997, 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020765693000000002, 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2749 2024-09-10T05:57:11.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145415+0000", 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149511+0000", 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040962409999999996 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149539+0000", 2024-09-10T05:57:11.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7231000000000001e-05 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149552+0000", 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3771000000000001e-05 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149708+0000", 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155174 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150116+0000", 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040834600000000002 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150545+0000", 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000428641 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.158644+0000", 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080993990000000002 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.165933+0000", 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072888739999999999 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166073+0000", 2024-09-10T05:57:11.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013972499999999999 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166177+0000", 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104597 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2751 3.21 e74/24 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:11.131 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.8576479989999992, 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017265005, 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167766+0000", 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0590000000000001e-06 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172413+0000", 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046462359999999998 2024-09-10T05:57:11.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172447+0000", 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4731999999999999e-05 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172469+0000", 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1460000000000001e-05 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172598+0000", 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128646 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172642+0000", 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4274999999999999e-05 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.184906+0000", 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012264353 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.185029+0000", 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123244 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.136 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2753 3.21 e74/24 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.8375710810000001, 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016969758000000001, 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187844+0000", 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2970000000000002e-06 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193441+0000", 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055969189999999997 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193476+0000", 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5748999999999999e-05 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193493+0000", 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6762999999999999e-05 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193634+0000", 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014096599999999999 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193677+0000", 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3305e-05 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204633+0000", 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010955761 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204811+0000", 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017799800000000001 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.141 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.8297152059999995, 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:57:11.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:57:11.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.148 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2761 3.3c 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7605677580000005, 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018127095999999999, 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.149 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2761 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264849+0000", 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3309999999999997e-06 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270094+0000", 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005245464 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270134+0000", 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9926999999999999e-05 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270157+0000", 2024-09-10T05:57:11.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824999999999999e-05 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270325+0000", 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016784699999999999 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270580+0000", 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025531600000000001 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270912+0000", 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033126999999999999 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.280570+0000", 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096586569999999993 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282695+0000", 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021244139999999998 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282853+0000", 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015866799999999999 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282972+0000", 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118377 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.155 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.156 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2763 3.28 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.156 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:11.156 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7441389770000004, 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019948423, 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2763 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281276+0000", 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0599999999999999e-06 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286026+0000", 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047498289999999997 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286074+0000", 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7994999999999997e-05 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286099+0000", 2024-09-10T05:57:11.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.51e-05 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286290+0000", 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019037500000000001 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286698+0000", 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000408651 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:11.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.287116+0000", 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041778300000000002 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300422+0000", 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013306226000000001 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300973+0000", 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055055100000000004 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301131+0000", 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015752100000000001 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301222+0000", 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1331999999999999e-05 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.163 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.163 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:11.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:11.165 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:11.163+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:11.264 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:11.263+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:11.291 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:11.292 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:11.292 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:11.292 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:11.307 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:11.365 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:11.363+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:11.423 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:11.424 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:11.424 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:11.424 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:11.424 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:11.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:11.466 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:11.463+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:11.563 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:57:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 100.970906208, 2024-09-10T05:57:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:57:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:57:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:57:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:57:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:57:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:57:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:57:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:57:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:57:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:57:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:57:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:57:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:57:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:57:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:57:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:57:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:57:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:57:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:57:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:57:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:57:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:57:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1667 3.3f e66/24 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.994794905999999, 2024-09-10T05:57:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020534329, 2024-09-10T05:57:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565034+0000", 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4400000000000001e-07 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569603+0000", 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045689320000000004 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569639+0000", 2024-09-10T05:57:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569658+0000", 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9582999999999999e-05 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569788+0000", 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129395 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569843+0000", 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4701999999999999e-05 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585439+0000", 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015596765 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585568+0000", 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128288 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2687 3.10 3:0bdf9def:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.068013858, 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015293677, 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2687 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491818+0000", 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495801+0000", 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039831700000000003 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495836+0000", 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4986e-05 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495853+0000", 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7082999999999999e-05 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496003+0000", 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149946 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496248+0000", 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024488999999999999 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496481+0000", 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023332299999999999 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.503197+0000", 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006716039 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.506985+0000", 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037875700000000001 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507052+0000", 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7014000000000006e-05 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507108+0000", 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6378999999999997e-05 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2690 3.20 3:0621a9df:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.027915503999999, 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013809238, 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2690 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531915+0000", 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6529999999999998e-06 2024-09-10T05:57:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535839+0000", 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003923569 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535872+0000", 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2892000000000003e-05 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535889+0000", 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946e-05 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535955+0000", 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6314000000000002e-05 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536068+0000", 2024-09-10T05:57:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011280100000000001 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536160+0000", 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1886999999999996e-05 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.542293+0000", 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061327559999999996 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545600+0000", 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033079699999999999 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545663+0000", 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2299999999999996e-05 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545722+0000", 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9150000000000001e-05 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2697 3.a 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.94516018, 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021976678999999999, 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2697 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614672+0000", 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9570000000000004e-06 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618642+0000", 2024-09-10T05:57:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003970215 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618682+0000", 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0241999999999999e-05 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618702+0000", 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9259e-05 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618865+0000", 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162893 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619114+0000", 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024920299999999998 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619366+0000", 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025260899999999999 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.633958+0000", 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014591695 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636314+0000", 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023562790000000002 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636498+0000", 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018343799999999999 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636645+0000", 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014688900000000001 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2702 3.33 e73/57 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head v 73'6, mlcod=72'4)", 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.894096535999999, 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011423348, 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665735+0000", 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0730000000000001e-06 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670171+0000", 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044365059999999998 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670193+0000", 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2195999999999999e-05 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670205+0000", 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1248e-05 2024-09-10T05:57:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670278+0000", 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3145000000000005e-05 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670297+0000", 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9145000000000001e-05 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677061+0000", 2024-09-10T05:57:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067644940000000002 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677155+0000", 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3541000000000004e-05 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2709 3.36 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.824711236000001, 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021772117000000001, 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2709 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735123+0000", 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739149+0000", 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040258899999999999 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739195+0000", 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6238e-05 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739226+0000", 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0756000000000002e-05 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739431+0000", 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020536799999999999 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739867+0000", 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043582799999999997 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740323+0000", 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045658999999999999 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750593+0000", 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010269215999999999 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756560+0000", 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059669450000000004 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756768+0000", 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020802799999999999 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756889+0000", 2024-09-10T05:57:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012152200000000001 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2710 3.1e e73/57 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head v 73'2, mlcod=0'0)", 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.808976034000001, 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016219428000000001, 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750855+0000", 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755688+0000", 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048322399999999998 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755736+0000", 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8925999999999999e-05 2024-09-10T05:57:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755761+0000", 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4598999999999999e-05 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755935+0000", 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017345500000000001 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755979+0000", 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4385000000000003e-05 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.766931+0000", 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010952051000000001 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.767072+0000", 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014061600000000001 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2712 3.1e e73/57 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.787184607, 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015148445, 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772653+0000", 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.02e-06 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778513+0000", 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058600609999999997 2024-09-10T05:57:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778542+0000", 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9411999999999999e-05 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778557+0000", 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5359999999999999e-05 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778655+0000", 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7146999999999997e-05 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778698+0000", 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3659000000000003e-05 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787711+0000", 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090123990000000008 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787792+0000", 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1386999999999999e-05 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2722 3.1e e73/57 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.681876033, 2024-09-10T05:57:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014888180000000001, 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877955+0000", 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.27e-06 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883040+0000", 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050841430000000002 2024-09-10T05:57:11.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883073+0000", 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3506000000000001e-05 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883090+0000", 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6966e-05 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883250+0000", 2024-09-10T05:57:11.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015971599999999999 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883296+0000", 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5785000000000003e-05 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892725+0000", 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094290840000000008 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892840+0000", 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011571 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2728 3.34 e74/24 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head v 74'3, mlcod=72'1)", 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.610534842, 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020234839000000001, 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949294+0000", 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3600000000000002e-07 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952508+0000", 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032136700000000001 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952549+0000", 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1118000000000002e-05 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952573+0000", 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4017000000000001e-05 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952750+0000", 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017677799999999999 2024-09-10T05:57:11.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952815+0000", 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4788000000000004e-05 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969436+0000", 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016621585000000001 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969528+0000", 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1947000000000006e-05 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2739 3.a 3:50ecfca4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.515434759, 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018342160999999999, 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2739 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044398+0000", 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0570000000000003e-06 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048829+0000", 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044313640000000001 2024-09-10T05:57:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048880+0000", 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0667000000000001e-05 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048905+0000", 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5636e-05 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049094+0000", 2024-09-10T05:57:11.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189106 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049502+0000", 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040768500000000002 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049904+0000", 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040155200000000001 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.058896+0000", 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089927700000000006 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062570+0000", 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003673272 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062659+0000", 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9221000000000005e-05 2024-09-10T05:57:11.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062736+0000", 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6830999999999997e-05 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2741 3.26 3:6709f12d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:11.643 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.49617593, 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017830538999999999, 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2741 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.644 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063654+0000", 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.187e-06 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067623+0000", 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039688650000000002 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067651+0000", 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7637e-05 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067664+0000", 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3497e-05 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067771+0000", 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106457 2024-09-10T05:57:11.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068031+0000", 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026004000000000001 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068262+0000", 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230829 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.080068+0000", 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011806291 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081260+0000", 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001191819 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081407+0000", 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014721299999999999 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081483+0000", 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5704000000000006e-05 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2743 3.34 e74/24 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.467799676, 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013595565, 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.650 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092032+0000", 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0910000000000001e-06 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094626+0000", 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025944179999999998 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094669+0000", 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2982000000000003e-05 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094698+0000", 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8951000000000001e-05 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094824+0000", 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012603000000000001 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094862+0000", 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7524999999999997e-05 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105528+0000", 2024-09-10T05:57:11.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010666556000000001 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105624+0000", 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6012000000000002e-05 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2757 3.2e e74/24 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.33410765, 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018393152999999999, 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3e-07 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231370+0000", 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056484719999999999 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231401+0000", 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1139000000000001e-05 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231417+0000", 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-10T05:57:11.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231573+0000", 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015524399999999999 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231613+0000", 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0725000000000001e-05 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243986+0000", 2024-09-10T05:57:11.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012372342 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.244114+0000", 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128016 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2766 3.a 3:53b220aa:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:11.660 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.244789437, 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02050532, 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2766 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315042+0000", 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320520+0000", 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054777819999999996 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320561+0000", 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1309e-05 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320580+0000", 2024-09-10T05:57:11.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9225999999999999e-05 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320754+0000", 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017325500000000001 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321183+0000", 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042883500000000002 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321607+0000", 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042457500000000001 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333931+0000", 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012323831 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335304+0000", 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001373211 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335422+0000", 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011828999999999999 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335544+0000", 2024-09-10T05:57:11.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121623 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2770 3.a 3:5300e91c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.195937113999999, 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019665727000000001, 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2770 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363896+0000", 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8389999999999997e-06 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368218+0000", 2024-09-10T05:57:11.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043216349999999999 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368257+0000", 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9641999999999998e-05 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368276+0000", 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.914e-05 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368444+0000", 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016791199999999999 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368700+0000", 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025589900000000002 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368939+0000", 2024-09-10T05:57:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023926700000000001 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.382054+0000", 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013114139 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383331+0000", 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012779040000000001 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383434+0000", 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010233700000000001 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383557+0000", 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2773 3.3f e74/24 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head v 74'4, mlcod=71'2)", 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.159334578999999, 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011963965, 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400496+0000", 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8200000000000001e-06 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404258+0000", 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003761707 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404300+0000", 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1742000000000001e-05 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404318+0000", 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7989999999999999e-05 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404480+0000", 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162378 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404551+0000", 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0462000000000004e-05 2024-09-10T05:57:11.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412290+0000", 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077389110000000002 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412458+0000", 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016795499999999999 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2774 3.1e e74/57 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.154140203000001, 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016469788999999999, 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:11.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405690+0000", 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3539999999999998e-06 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412675+0000", 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069848089999999998 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412710+0000", 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5015999999999998e-05 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412735+0000", 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5272000000000001e-05 2024-09-10T05:57:11.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412912+0000", 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017682599999999999 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412970+0000", 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8017999999999999e-05 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422024+0000", 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090533639999999995 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422158+0000", 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013412999999999999 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2779 3.36 3:6deaa553:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:11.683 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.10034205, 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014954103, 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2779 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459490+0000", 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7620000000000001e-06 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463585+0000", 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040951779999999997 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463622+0000", 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6748000000000001e-05 2024-09-10T05:57:11.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463641+0000", 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8685000000000002e-05 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463728+0000", 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7354000000000004e-05 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463858+0000", 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130464 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463967+0000", 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108853 2024-09-10T05:57:11.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.473175+0000", 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092074819999999995 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474264+0000", 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001089759 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:11.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474369+0000", 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104374 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474440+0000", 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1444000000000002e-05 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:11.690 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:11.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:11.692 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:11.691+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:11.793 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:11.791+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:11.820 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:11.820 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:11.820 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:11.820 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:11.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:11.894 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:11.888+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:11.957 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:11.958 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:11.972 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:11.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:11.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:57:12.024 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:12.023+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:12.095 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:12.095+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:12.128 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:12.129 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:12.144 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:12.144 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:12.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 125.157990911, 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:57:12.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:57:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 123.202446376, 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:57:12.153 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.154 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:57:12.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.160 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.582834746, 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.161 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:57:12.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:57:12.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.686222487999999, 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:57:12.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:57:12.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:57:12.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1950 3.11 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.718573136, 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020018444999999999, 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.175 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1950 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422209+0000", 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.419e-06 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426537+0000", 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043276149999999999 2024-09-10T05:57:12.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426567+0000", 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0301999999999999e-05 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426580+0000", 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2917e-05 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426672+0000", 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2218000000000004e-05 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426843+0000", 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017047699999999999 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427340+0000", 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049682899999999996 2024-09-10T05:57:12.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442068+0000", 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01472853 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442088+0000", 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442160+0000", 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2138000000000006e-05 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442225+0000", 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5186999999999998e-05 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.181 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2698 3.d 3:b2e26eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.517169702, 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019089317000000001, 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2698 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:12.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623614+0000", 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.614e-06 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628427+0000", 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048128399999999997 2024-09-10T05:57:12.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628456+0000", 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9379000000000001e-05 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628473+0000", 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436e-05 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628541+0000", 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8375999999999997e-05 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628668+0000", 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012706699999999999 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628770+0000", 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102012 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636407+0000", 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076366639999999996 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642629+0000", 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062227059999999997 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642670+0000", 2024-09-10T05:57:12.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0228999999999997e-05 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642700+0000", 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9994000000000001e-05 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2715 3.3b 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.341172636, 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024491215, 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2715 2024-09-10T05:57:12.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799611+0000", 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4740000000000001e-06 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803674+0000", 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040627750000000002 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803699+0000", 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4998999999999999e-05 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803716+0000", 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.713e-05 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803861+0000", 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:12.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804271+0000", 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000410782 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804670+0000", 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039885499999999999 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823762+0000", 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01909168 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823814+0000", 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2293000000000002e-05 2024-09-10T05:57:12.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823978+0000", 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016379799999999999 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.824099+0000", 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120677 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2716 3.3b 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.331216960000001, 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021381936000000001, 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.196 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2716 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809566+0000", 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4700000000000001e-06 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814350+0000", 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047846349999999998 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814391+0000", 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0881999999999999e-05 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814417+0000", 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.816891+0000", 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024744400000000001 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817142+0000", 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025102600000000001 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817376+0000", 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234267 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.826993+0000", 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096162609999999992 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830661+0000", 2024-09-10T05:57:12.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036685229999999999 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830823+0000", 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016209899999999999 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830945+0000", 2024-09-10T05:57:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012169 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2736 3.15 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.125900229000001, 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021012902999999999, 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.203 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2736 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014883+0000", 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019463+0000", 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045800299999999997 2024-09-10T05:57:12.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019510+0000", 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7361999999999998e-05 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019530+0000", 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.997e-05 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019681+0000", 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015094500000000001 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019911+0000", 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022981400000000001 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020130+0000", 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021882 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.032856+0000", 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012725670999999999 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035613+0000", 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027571359999999999 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035768+0000", 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015560199999999999 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035893+0000", 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012442599999999999 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2735 3.2a e74/24 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head v 74'7, mlcod=73'5)", 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.124968356, 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018481485999999998, 2024-09-10T05:57:12.209 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015813+0000", 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1699999999999997e-07 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020431+0000", 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046181900000000003 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020481+0000", 2024-09-10T05:57:12.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0204999999999998e-05 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020504+0000", 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3193e-05 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020625+0000", 2024-09-10T05:57:12.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012044600000000001 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020660+0000", 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034217+0000", 2024-09-10T05:57:12.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013556558 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034293+0000", 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6211000000000006e-05 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.214 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.116513599999999, 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:57:12.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:57:12.220 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2738 3.39 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.104009387, 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439545999999999, 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2738 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036773+0000", 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5000000000000002e-06 2024-09-10T05:57:12.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042338+0000", 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055647520000000001 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042369+0000", 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1009000000000001e-05 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042388+0000", 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8612999999999999e-05 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042526+0000", 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138806 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042842+0000", 2024-09-10T05:57:12.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000315295 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.043126+0000", 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028447800000000001 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.052457+0000", 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093312510000000005 2024-09-10T05:57:12.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.056914+0000", 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044569600000000003 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057087+0000", 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017276499999999999 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057210+0000", 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012311700000000001 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2754 3.2a e74/24 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head v 74'9, mlcod=74'7)", 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.939181311, 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020956794000000001, 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201602+0000", 2024-09-10T05:57:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1130000000000001e-06 2024-09-10T05:57:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204828+0000", 2024-09-10T05:57:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032265219999999999 2024-09-10T05:57:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204882+0000", 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3205000000000003e-05 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204909+0000", 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7138999999999999e-05 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205102+0000", 2024-09-10T05:57:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019347099999999999 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205161+0000", 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8291999999999997e-05 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222429+0000", 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017268480999999999 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222556+0000", 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012657099999999999 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.936035004000001, 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.234 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:57:12.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:57:12.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.240 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2760 3.37 3:ee0dd768:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.887340516, 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021061340000000001, 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.241 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2760 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253444+0000", 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6229999999999996e-06 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258934+0000", 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005489524 2024-09-10T05:57:12.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258985+0000", 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0986000000000003e-05 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259001+0000", 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259120+0000", 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118564 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259374+0000", 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025416600000000001 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259600+0000", 2024-09-10T05:57:12.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225563 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.269405+0000", 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098055409999999992 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274344+0000", 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049393040000000003 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274432+0000", 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7616999999999998e-05 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274501+0000", 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8910000000000003e-05 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.247 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.866459002999999, 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:57:12.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:57:12.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2765 3.e 3:7051b691:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.835831899, 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019300435000000001, 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.253 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2765 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:12.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304951+0000", 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8169999999999999e-06 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308937+0000", 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039864169999999999 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308970+0000", 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2965e-05 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308987+0000", 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6710000000000001e-05 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309116+0000", 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012852800000000001 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309342+0000", 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225942 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309553+0000", 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021175999999999999 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320354+0000", 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010800535999999999 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.323937+0000", 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035836290000000001 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324118+0000", 2024-09-10T05:57:12.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000180695 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324249+0000", 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130436 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2767 3.37 3:ef27b18b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.811745667, 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019966886, 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2767 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.261 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329038+0000", 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3299999999999999e-06 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333904+0000", 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048659869999999996 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333944+0000", 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0735000000000002e-05 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333964+0000", 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9443e-05 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334121+0000", 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015721499999999999 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334365+0000", 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024407000000000001 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334588+0000", 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022284 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.346368+0000", 2024-09-10T05:57:12.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011780255 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348673+0000", 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023048080000000002 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348858+0000", 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184904 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.349001+0000", 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143299 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2773 3.3f 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.745928412, 2024-09-10T05:57:12.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018274233000000001, 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2773 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394855+0000", 2024-09-10T05:57:12.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4630000000000001e-06 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399567+0000", 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047114490000000004 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399609+0000", 2024-09-10T05:57:12.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2082999999999997e-05 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399627+0000", 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8532000000000001e-05 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399768+0000", 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141216 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400014+0000", 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000245947 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400243+0000", 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022854 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.408899+0000", 2024-09-10T05:57:12.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086558520000000003 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412825+0000", 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039261599999999997 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412993+0000", 2024-09-10T05:57:12.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016819099999999999 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.413126+0000", 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001328 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2780 3.15 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.664275614999999, 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020859142000000001, 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2780 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476525+0000", 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669000000000001e-05 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480305+0000", 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037793739999999998 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480340+0000", 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5082000000000001e-05 2024-09-10T05:57:12.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480356+0000", 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5985999999999999e-05 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480444+0000", 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8898000000000002e-05 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:12.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480600+0000", 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155685 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480746+0000", 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014611 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.487929+0000", 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071829750000000003 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497194+0000", 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092649140000000008 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497294+0000", 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100134 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:12.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497364+0000", 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9314999999999996e-05 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:12.281 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:12.282 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:12.283 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:12.283 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:12.284 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:12.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:12.284 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:12.285 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:12.285 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:12.285 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:12.286 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:12.286 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:12.286 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:12.286 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:12.287 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:12.287 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:12.288 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:12.279+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:12.384 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:12.383+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:12.458 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:12.458 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:12.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:12.516 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:12.515+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:12.586 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:12.580+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:12.643 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:12.643 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:12.657 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:12.686 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:12.680+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:12.781 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:12.782 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:12.787 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:12.784+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:12.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:12.888 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:12.884+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:12.907 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:57:12.937 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:12.937 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:12.953 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:12.989 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:12.984+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:13.090 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:13.087+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:13.118 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:13.119 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:13.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:13.226 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:13.223+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:13.292 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:13.288+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:13.299 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:13.299 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:13.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:13.404 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:13.403+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:13.486 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:13.486 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:13.493 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:13.488+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:13.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:13.594 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:13.588+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:13.666 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:13.667 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:13.681 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:13.695 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:13.692+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:13.796 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:13.795+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:13.802 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:13.802 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:13.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:13.904 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:13.903+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:13.984 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:13.985 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:13.998 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:13.992+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:13.999 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:14.099 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:14.095+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:14.169 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:14.169 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:14.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:14.200 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:14.196+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:14.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:14.300 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:14.296+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:14.354 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:14.354 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:14.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:14.401 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:14.399+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:14.429 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:14.429 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:14.446 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:14.446 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:14.462 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:14.463 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:14.480 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:14.480 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:14.501 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:14.501 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:14.502 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:14.499+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:14.502 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:14.502 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:14.502 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:14.502 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:14.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:14.520 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:14.520 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:14.539 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:14.539 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:14.557 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:14.557 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:14.602 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:14.596+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:14.640 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:14.641 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:14.641 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:14.641 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:14.641 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:14.655 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:14.703 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:14.703+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:14.805 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:14.803+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:14.828 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:57:14.828 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 106.266893772, 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:57:14.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:57:14.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.363347126000001, 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:14.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:57:14.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:57:14.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1947 3.3 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.426984887, 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018605588999999999, 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1947 2024-09-10T05:57:14.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397888+0000", 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.397906+0000", 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402321+0000", 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044157889999999998 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402355+0000", 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3744000000000001e-05 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402371+0000", 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6135999999999999e-05 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402469+0000", 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7844999999999996e-05 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402634+0000", 2024-09-10T05:57:14.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000164644 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.402772+0000", 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137768 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.412200+0000", 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094282930000000008 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416386+0000", 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041860109999999999 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416443+0000", 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6884e-05 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.416494+0000", 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0831000000000002e-05 2024-09-10T05:57:14.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2686 3.3 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.345434261999999, 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015526295000000001, 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2686 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479439+0000", 2024-09-10T05:57:14.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.479442+0000", 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2370000000000001e-06 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483270+0000", 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038281890000000001 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483292+0000", 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2232999999999999e-05 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483303+0000", 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0641e-05 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483406+0000", 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102905 2024-09-10T05:57:14.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483629+0000", 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022338699999999999 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.483850+0000", 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022084700000000001 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.492245+0000", 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083952639999999995 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494655+0000", 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024096769999999998 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494835+0000", 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179798 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.494965+0000", 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013011699999999999 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2697 3.a e73/24 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.205297288000001, 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016453567999999998, 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619576+0000", 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619579+0000", 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9189999999999999e-06 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622839+0000", 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032599949999999999 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622882+0000", 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3118999999999998e-05 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.622905+0000", 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3232999999999999e-05 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623007+0000", 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101598 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623035+0000", 2024-09-10T05:57:14.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8772000000000002e-05 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.635939+0000", 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012903694 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636029+0000", 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0237999999999999e-05 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2706 3.1d e73/24 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.114911306, 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01721114, 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:14.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709962+0000", 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709964+0000", 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6690000000000002e-06 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712686+0000", 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027220600000000001 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712724+0000", 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7376000000000003e-05 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712745+0000", 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0786000000000001e-05 2024-09-10T05:57:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712899+0000", 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015498199999999999 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712957+0000", 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7889000000000001e-05 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727050+0000", 2024-09-10T05:57:14.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014093114 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727173+0000", 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012226399999999999 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2719 3.1b e73/24 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head v 73'3, mlcod=65'1)", 2024-09-10T05:57:14.860 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.979321630999999, 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018608657000000001, 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845551+0000", 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.845553+0000", 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5e-06 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849483+0000", 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039301420000000002 2024-09-10T05:57:14.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849521+0000", 2024-09-10T05:57:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7698999999999999e-05 2024-09-10T05:57:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849543+0000", 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1869e-05 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849706+0000", 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163132 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.849769+0000", 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3162000000000003e-05 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864021+0000", 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014252117 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.864160+0000", 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013903599999999999 2024-09-10T05:57:14.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2720 3.9 3:90160a04:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.970534806, 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016834844000000002, 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2720 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854338+0000", 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.854342+0000", 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0430000000000001e-06 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859157+0000", 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048145640000000003 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859195+0000", 2024-09-10T05:57:14.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8609000000000003e-05 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859221+0000", 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6086000000000001e-05 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859430+0000", 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020873800000000001 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859733+0000", 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030246400000000001 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.859961+0000", 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022790700000000001 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.870502+0000", 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010541889 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871010+0000", 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050712499999999998 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871106+0000", 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6220999999999999e-05 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.871173+0000", 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7198000000000003e-05 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.871 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2721 3.9 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.958567049999999, 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021537937, 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2721 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866311+0000", 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7260000000000002e-06 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872270+0000", 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059589939999999996 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872300+0000", 2024-09-10T05:57:14.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0023e-05 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872321+0000", 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1005999999999998e-05 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872492+0000", 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017168500000000001 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872729+0000", 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236357 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872962+0000", 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023289299999999999 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883222+0000", 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010260607 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887676+0000", 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044541950000000002 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887772+0000", 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6089999999999996e-05 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887844+0000", 2024-09-10T05:57:14.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1360999999999997e-05 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2727 3.1c e74/24 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.887932006, 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020405939000000001, 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936942+0000", 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6300000000000004e-07 2024-09-10T05:57:14.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940348+0000", 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034059559999999999 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940389+0000", 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1173e-05 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940411+0000", 2024-09-10T05:57:14.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2546000000000001e-05 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940673+0000", 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026151599999999999 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940736+0000", 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2707999999999997e-05 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957202+0000", 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016466524999999999 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957347+0000", 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:14.882 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.887751505000001, 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:57:14.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:14.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.888 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.878756843, 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:14.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:57:14.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2737 3.e e74/24 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.794279596999999, 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019750409, 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030593+0000", 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030594+0000", 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035304+0000", 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047101030000000002 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035338+0000", 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3969e-05 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035355+0000", 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6747000000000001e-05 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035496+0000", 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014153599999999999 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035533+0000", 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6675999999999999e-05 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050221+0000", 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014687973999999999 2024-09-10T05:57:14.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050344+0000", 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012263000000000001 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2743 3.34 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.738977892999999, 2024-09-10T05:57:14.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020245447999999999, 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2743 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085897+0000", 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.243e-06 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091156+0000", 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052584149999999998 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091186+0000", 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0648999999999997e-05 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091206+0000", 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9415999999999998e-05 2024-09-10T05:57:14.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091331+0000", 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012479 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091576+0000", 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024558300000000001 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:14.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091810+0000", 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023423000000000001 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.104889+0000", 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013079084 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105976+0000", 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010860659999999999 2024-09-10T05:57:14.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106070+0000", 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4810999999999997e-05 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106140+0000", 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0160999999999995e-05 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2755 3.11 e74/24 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head v 74'8, mlcod=73'6)", 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.612845294, 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021403122, 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:14.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212031+0000", 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218661+0000", 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066300990000000004 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218698+0000", 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7109e-05 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218716+0000", 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7776000000000001e-05 2024-09-10T05:57:14.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218848+0000", 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013285 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218898+0000", 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9561999999999997e-05 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233312+0000", 2024-09-10T05:57:14.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014414009 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233431+0000", 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001187 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2756 3.1a 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:14.910 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.610793915, 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021135549, 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2756 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214082+0000", 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218251+0000", 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041687790000000001 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218292+0000", 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0602000000000002e-05 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218318+0000", 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5701999999999999e-05 2024-09-10T05:57:14.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218474+0000", 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015660000000000001 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218952+0000", 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047828600000000002 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:14.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.219315+0000", 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036209600000000001 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233050+0000", 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013735041999999999 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234930+0000", 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018799870000000001 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235091+0000", 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016182499999999999 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235215+0000", 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012318999999999999 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2758 3.14 3:2b3c5956:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.590798973, 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020489027999999999, 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2758 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234084+0000", 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0288999999999999e-05 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239117+0000", 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050329579999999997 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239150+0000", 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2391999999999998e-05 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239168+0000", 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8122999999999999e-05 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239346+0000", 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017855200000000001 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239754+0000", 2024-09-10T05:57:14.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040791800000000001 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.240162+0000", 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040800899999999998 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249324+0000", 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091615710000000003 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254280+0000", 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049566990000000002 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254445+0000", 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016484599999999999 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254563+0000", 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011767100000000001 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.922 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2759 3.3 3:c2c35e3f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.581849433, 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015920593, 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2759 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243023+0000", 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243026+0000", 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.463e-06 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248521+0000", 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054947249999999998 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248562+0000", 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152999999999997e-05 2024-09-10T05:57:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248585+0000", 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3252e-05 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248713+0000", 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012798700000000001 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.248967+0000", 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025380900000000002 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249206+0000", 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000239433 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258753+0000", 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009546433 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258778+0000", 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5199999999999999e-05 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258865+0000", 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6784000000000001e-05 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258944+0000", 2024-09-10T05:57:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9354e-05 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2776 3.31 e74/24 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.395172968000001, 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016659686, 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429700+0000", 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.429703+0000", 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9730000000000002e-06 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435067+0000", 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053637779999999996 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435100+0000", 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3473000000000003e-05 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435116+0000", 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6053e-05 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435324+0000", 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020727699999999999 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.435367+0000", 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3019000000000003e-05 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446249+0000", 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010882106000000001 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.446360+0000", 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111007 2024-09-10T05:57:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2777 3.1b e74/24 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.38507156, 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016908191999999999, 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439801+0000", 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.439804+0000", 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7530000000000002e-06 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444587+0000", 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047832309999999998 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444632+0000", 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4502999999999997e-05 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444656+0000", 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3748999999999999e-05 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444878+0000", 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022217 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.444944+0000", 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5811999999999999e-05 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456502+0000", 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011558406 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.456710+0000", 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020756799999999999 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:14.939 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:14.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:57:14.940 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:14.939+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:14.941 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:15.041 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:15.036+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:15.069 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:15.070 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:15.070 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:15.070 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:15.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:15.171 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:15.168+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:15.242 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:15.239+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:15.249 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:15.249 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:15.263 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:15.355 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:15.352+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:15.439 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:15.439 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:15.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:15.439 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.87357896, 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.440 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:57:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.445 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.846768172000001, 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.446 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:57:15.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:15.451 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.014923378999999, 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:57:15.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:15.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1812 3.30 3:0f16d871:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:15.457 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.006844985000001, 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017116908, 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1812 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:15.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428955+0000", 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6700000000000001e-06 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431687+0000", 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002732342 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431712+0000", 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5114e-05 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431725+0000", 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2976000000000001e-05 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431862+0000", 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013720799999999999 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432067+0000", 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205028 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432272+0000", 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205105 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.439520+0000", 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072476550000000004 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445702+0000", 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061817640000000002 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445898+0000", 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195928 2024-09-10T05:57:15.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446070+0000", 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017211799999999999 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2704 3.16 3:6b2c0ee3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.752916254000001, 2024-09-10T05:57:15.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022182810000000001, 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2704 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:15.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682886+0000", 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4429999999999996e-06 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686829+0000", 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039425720000000001 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686867+0000", 2024-09-10T05:57:15.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8466000000000001e-05 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686887+0000", 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9629000000000001e-05 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687049+0000", 2024-09-10T05:57:15.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161619 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687342+0000", 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029348500000000001 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687579+0000", 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023733000000000001 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.696533+0000", 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089536040000000004 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704753+0000", 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082205669999999998 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704929+0000", 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017553499999999999 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.705065+0000", 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013556000000000001 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2706 3.1d 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.732216486, 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024374384999999998, 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.470 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2706 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:15.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703585+0000", 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.287e-06 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709069+0000", 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005484432 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709101+0000", 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2063000000000001e-05 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709117+0000", 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709221+0000", 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103867 2024-09-10T05:57:15.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709490+0000", 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269053 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709739+0000", 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024859600000000002 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.724317+0000", 2024-09-10T05:57:15.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014578512 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727648+0000", 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033310420000000002 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727824+0000", 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017585100000000001 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727956+0000", 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013196 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2707 3.5 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.722810508, 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016855370000000001, 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2707 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712991+0000", 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5700000000000001e-06 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717888+0000", 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048966290000000004 2024-09-10T05:57:15.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717925+0000", 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7404999999999998e-05 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717946+0000", 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0662999999999999e-05 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718163+0000", 2024-09-10T05:57:15.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021718400000000001 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718403+0000", 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240196 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718611+0000", 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208161 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728002+0000", 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093903579999999997 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729567+0000", 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001565005 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729711+0000", 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014411599999999999 2024-09-10T05:57:15.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729843+0000", 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013208299999999999 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2708 3.2a 3:546514ef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.712781007, 2024-09-10T05:57:15.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021062501000000001, 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2708 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:15.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723020+0000", 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6259999999999999e-06 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727965+0000", 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049453429999999996 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727991+0000", 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6083000000000001e-05 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728016+0000", 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728170+0000", 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015342900000000001 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728472+0000", 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030251099999999999 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728707+0000", 2024-09-10T05:57:15.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023466700000000001 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739602+0000", 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010895083 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743763+0000", 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041615360000000004 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743947+0000", 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018321400000000001 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744080+0000", 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013281999999999999 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.488 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2709 3.36 e73/24 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head v 73'5, mlcod=72'3)", 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.695258183, 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015622295, 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740542+0000", 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744345+0000", 2024-09-10T05:57:15.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038023129999999999 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744379+0000", 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4224999999999998e-05 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744404+0000", 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4586000000000001e-05 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744558+0000", 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000154146 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744622+0000", 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4491000000000003e-05 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756023+0000", 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011401262000000001 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756162+0000", 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013869199999999999 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2711 3.3c 3:3f29615d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.675346359000001, 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015648141000000001, 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2711 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760456+0000", 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2869999999999998e-06 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764614+0000", 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041582520000000003 2024-09-10T05:57:15.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764651+0000", 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6439000000000001e-05 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764670+0000", 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9536000000000001e-05 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764820+0000", 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974300000000001 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765073+0000", 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025336599999999999 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765314+0000", 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024024300000000001 2024-09-10T05:57:15.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.774451+0000", 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091372620000000002 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775903+0000", 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001452432 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775996+0000", 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2283999999999999e-05 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.776100+0000", 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010429699999999999 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2714 3.16 3:696d6af6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:15.499 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.646209312, 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018296902, 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2714 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:15.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789592+0000", 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4199999999999999e-06 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793519+0000", 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039268360000000004 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793560+0000", 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1078000000000002e-05 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793578+0000", 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793710+0000", 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013122899999999999 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793970+0000", 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025991600000000001 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.794207+0000", 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023692299999999999 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.806549+0000", 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012342671 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807674+0000", 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001124702 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807774+0000", 2024-09-10T05:57:15.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9987000000000003e-05 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807886+0000", 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111753 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.508148820000001, 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:57:15.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:57:15.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:57:15.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:15.511 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.428451679, 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:57:15.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2747 3.2a 3:56df8694:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.309170043, 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336575999999999, 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2747 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126632+0000", 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130540+0000", 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003907794 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130580+0000", 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0194000000000002e-05 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130602+0000", 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2169999999999999e-05 2024-09-10T05:57:15.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130776+0000", 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174005 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131200+0000", 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042367199999999999 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131649+0000", 2024-09-10T05:57:15.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000449171 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.146739+0000", 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01508959 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150675+0000", 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003936419 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150810+0000", 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135162 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150965+0000", 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015443299999999999 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2749 3.16 3:6b50c908:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:15.523 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.2903866, 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020765693000000002, 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2749 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145415+0000", 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149511+0000", 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040962409999999996 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149539+0000", 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7231000000000001e-05 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149552+0000", 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3771000000000001e-05 2024-09-10T05:57:15.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149708+0000", 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155174 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150116+0000", 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040834600000000002 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:15.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150545+0000", 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000428641 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.158644+0000", 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080993990000000002 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.165933+0000", 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072888739999999999 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166073+0000", 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013972499999999999 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166177+0000", 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104597 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2751 3.21 e74/24 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:15.529 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.268033624999999, 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017265005, 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167766+0000", 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0590000000000001e-06 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172413+0000", 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046462359999999998 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172447+0000", 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4731999999999999e-05 2024-09-10T05:57:15.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172469+0000", 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1460000000000001e-05 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172598+0000", 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128646 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172642+0000", 2024-09-10T05:57:15.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4274999999999999e-05 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.184906+0000", 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012264353 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.185029+0000", 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123244 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2753 3.21 e74/24 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.247956707, 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016969758000000001, 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187844+0000", 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2970000000000002e-06 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193441+0000", 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055969189999999997 2024-09-10T05:57:15.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193476+0000", 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5748999999999999e-05 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193493+0000", 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6762999999999999e-05 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193634+0000", 2024-09-10T05:57:15.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014096599999999999 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193677+0000", 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3305e-05 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204633+0000", 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010955761 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204811+0000", 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017799800000000001 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.240100832, 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.538 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:57:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2761 3.3c 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.170953384000001, 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018127095999999999, 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2761 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264849+0000", 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3309999999999997e-06 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270094+0000", 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005245464 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270134+0000", 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9926999999999999e-05 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270157+0000", 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824999999999999e-05 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270325+0000", 2024-09-10T05:57:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016784699999999999 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270580+0000", 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025531600000000001 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270912+0000", 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033126999999999999 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.280570+0000", 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096586569999999993 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282695+0000", 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021244139999999998 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282853+0000", 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015866799999999999 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282972+0000", 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118377 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2763 3.28 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.154524603, 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019948423, 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2763 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281276+0000", 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0599999999999999e-06 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286026+0000", 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047498289999999997 2024-09-10T05:57:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286074+0000", 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7994999999999997e-05 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286099+0000", 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.51e-05 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286290+0000", 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019037500000000001 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286698+0000", 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000408651 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.287116+0000", 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041778300000000002 2024-09-10T05:57:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300422+0000", 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013306226000000001 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300973+0000", 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055055100000000004 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301131+0000", 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015752100000000001 2024-09-10T05:57:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301222+0000", 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1331999999999999e-05 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:15.556 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:15.557 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:15.558 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:15.552+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:15.658 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:15.652+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:15.725 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:15.725 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:15.725 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:15.725 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:15.739 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:15.783 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:15.780+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:15.860 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:15.859+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:15.899 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:15.899 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:15.899 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:15.899 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:15.899 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:15.913 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:15.938 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:57:15.960 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:15.959+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:16.034 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:16.034 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 105.442206922, 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:57:16.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1667 3.3f e66/24 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.466095620000001, 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020534329, 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565034+0000", 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4400000000000001e-07 2024-09-10T05:57:16.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569603+0000", 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045689320000000004 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569639+0000", 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569658+0000", 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9582999999999999e-05 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569788+0000", 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129395 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569843+0000", 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4701999999999999e-05 2024-09-10T05:57:16.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585439+0000", 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015596765 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585568+0000", 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128288 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2687 3.10 3:0bdf9def:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.539314572, 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015293677, 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2687 2024-09-10T05:57:16.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491818+0000", 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495801+0000", 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039831700000000003 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495836+0000", 2024-09-10T05:57:16.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4986e-05 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495853+0000", 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7082999999999999e-05 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496003+0000", 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149946 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496248+0000", 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024488999999999999 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496481+0000", 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023332299999999999 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.503197+0000", 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006716039 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.506985+0000", 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037875700000000001 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507052+0000", 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7014000000000006e-05 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507108+0000", 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6378999999999997e-05 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2690 3.20 3:0621a9df:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.499216218000001, 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013809238, 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.054 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2690 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531915+0000", 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6529999999999998e-06 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535839+0000", 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003923569 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535872+0000", 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2892000000000003e-05 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535889+0000", 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946e-05 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535955+0000", 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6314000000000002e-05 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536068+0000", 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011280100000000001 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536160+0000", 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1886999999999996e-05 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.542293+0000", 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061327559999999996 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545600+0000", 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033079699999999999 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545663+0000", 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2299999999999996e-05 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545722+0000", 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9150000000000001e-05 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.059 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2697 3.a 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.416460894, 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021976678999999999, 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.060 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2697 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614672+0000", 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9570000000000004e-06 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618642+0000", 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003970215 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618682+0000", 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0241999999999999e-05 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618702+0000", 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9259e-05 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618865+0000", 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162893 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619114+0000", 2024-09-10T05:57:16.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024920299999999998 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619366+0000", 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025260899999999999 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.633958+0000", 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014591695 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636314+0000", 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023562790000000002 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636498+0000", 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018343799999999999 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636645+0000", 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014688900000000001 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.065 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2702 3.33 e73/57 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head v 73'6, mlcod=72'4)", 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.365397250000001, 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011423348, 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665735+0000", 2024-09-10T05:57:16.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0730000000000001e-06 2024-09-10T05:57:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670171+0000", 2024-09-10T05:57:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044365059999999998 2024-09-10T05:57:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670193+0000", 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2195999999999999e-05 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670205+0000", 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1248e-05 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670278+0000", 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3145000000000005e-05 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670297+0000", 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9145000000000001e-05 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677061+0000", 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067644940000000002 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677155+0000", 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3541000000000004e-05 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2709 3.36 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.29601195, 2024-09-10T05:57:16.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021772117000000001, 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2709 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735123+0000", 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2024-09-10T05:57:16.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739149+0000", 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040258899999999999 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739195+0000", 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6238e-05 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739226+0000", 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0756000000000002e-05 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739431+0000", 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020536799999999999 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739867+0000", 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043582799999999997 2024-09-10T05:57:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740323+0000", 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045658999999999999 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750593+0000", 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010269215999999999 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756560+0000", 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059669450000000004 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756768+0000", 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020802799999999999 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756889+0000", 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012152200000000001 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.077 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2710 3.1e e73/57 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head v 73'2, mlcod=0'0)", 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.280276748, 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016219428000000001, 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750855+0000", 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755688+0000", 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048322399999999998 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755736+0000", 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8925999999999999e-05 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755761+0000", 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4598999999999999e-05 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755935+0000", 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017345500000000001 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755979+0000", 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4385000000000003e-05 2024-09-10T05:57:16.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.766931+0000", 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010952051000000001 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.767072+0000", 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014061600000000001 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2712 3.1e e73/57 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.258485321, 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015148445, 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772653+0000", 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.02e-06 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778513+0000", 2024-09-10T05:57:16.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058600609999999997 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778542+0000", 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9411999999999999e-05 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778557+0000", 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5359999999999999e-05 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778655+0000", 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7146999999999997e-05 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778698+0000", 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3659000000000003e-05 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787711+0000", 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090123990000000008 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787792+0000", 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1386999999999999e-05 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2722 3.1e e73/57 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.153176747, 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014888180000000001, 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877955+0000", 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.27e-06 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883040+0000", 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050841430000000002 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883073+0000", 2024-09-10T05:57:16.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3506000000000001e-05 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883090+0000", 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6966e-05 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883250+0000", 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015971599999999999 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883296+0000", 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5785000000000003e-05 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892725+0000", 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094290840000000008 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892840+0000", 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011571 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2728 3.34 e74/24 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head v 74'3, mlcod=72'1)", 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.081835556, 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020234839000000001, 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949294+0000", 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3600000000000002e-07 2024-09-10T05:57:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952508+0000", 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032136700000000001 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952549+0000", 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1118000000000002e-05 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952573+0000", 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4017000000000001e-05 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952750+0000", 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017677799999999999 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952815+0000", 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4788000000000004e-05 2024-09-10T05:57:16.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969436+0000", 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016621585000000001 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969528+0000", 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1947000000000006e-05 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2739 3.a 3:50ecfca4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.986735473, 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018342160999999999, 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2739 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.097 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044398+0000", 2024-09-10T05:57:16.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0570000000000003e-06 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048829+0000", 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044313640000000001 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048880+0000", 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0667000000000001e-05 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048905+0000", 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5636e-05 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049094+0000", 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189106 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049502+0000", 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040768500000000002 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049904+0000", 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040155200000000001 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.058896+0000", 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089927700000000006 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062570+0000", 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003673272 2024-09-10T05:57:16.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062659+0000", 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9221000000000005e-05 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062736+0000", 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6830999999999997e-05 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2741 3.26 3:6709f12d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.967476644, 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017830538999999999, 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2741 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.103 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063654+0000", 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.187e-06 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067623+0000", 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039688650000000002 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067651+0000", 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7637e-05 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067664+0000", 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3497e-05 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067771+0000", 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106457 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068031+0000", 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026004000000000001 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068262+0000", 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230829 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.080068+0000", 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011806291 2024-09-10T05:57:16.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081260+0000", 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001191819 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081407+0000", 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014721299999999999 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081483+0000", 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5704000000000006e-05 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2743 3.34 e74/24 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.93910039, 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013595565, 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.109 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092032+0000", 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0910000000000001e-06 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094626+0000", 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025944179999999998 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094669+0000", 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2982000000000003e-05 2024-09-10T05:57:16.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094698+0000", 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8951000000000001e-05 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094824+0000", 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012603000000000001 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094862+0000", 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7524999999999997e-05 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105528+0000", 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010666556000000001 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105624+0000", 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6012000000000002e-05 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.113 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2757 3.2e e74/24 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.805408364, 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018393152999999999, 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3e-07 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231370+0000", 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056484719999999999 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231401+0000", 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1139000000000001e-05 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231417+0000", 2024-09-10T05:57:16.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231573+0000", 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015524399999999999 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231613+0000", 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0725000000000001e-05 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243986+0000", 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012372342 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.244114+0000", 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128016 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2766 3.a 3:53b220aa:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:16.118 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.716090151, 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02050532, 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2766 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:16.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315042+0000", 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320520+0000", 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054777819999999996 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320561+0000", 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1309e-05 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320580+0000", 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9225999999999999e-05 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320754+0000", 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017325500000000001 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321183+0000", 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042883500000000002 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321607+0000", 2024-09-10T05:57:16.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042457500000000001 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333931+0000", 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012323831 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335304+0000", 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001373211 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335422+0000", 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011828999999999999 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335544+0000", 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121623 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2770 3.a 3:5300e91c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.667237827999999, 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019665727000000001, 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2770 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.125 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363896+0000", 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8389999999999997e-06 2024-09-10T05:57:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368218+0000", 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043216349999999999 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368257+0000", 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9641999999999998e-05 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368276+0000", 2024-09-10T05:57:16.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.914e-05 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368444+0000", 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016791199999999999 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368700+0000", 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025589900000000002 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368939+0000", 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023926700000000001 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.382054+0000", 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013114139 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383331+0000", 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012779040000000001 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383434+0000", 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010233700000000001 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383557+0000", 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2773 3.3f e74/24 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head v 74'4, mlcod=71'2)", 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.630635292999999, 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011963965, 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:16.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400496+0000", 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8200000000000001e-06 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404258+0000", 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003761707 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404300+0000", 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1742000000000001e-05 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404318+0000", 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7989999999999999e-05 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404480+0000", 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162378 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404551+0000", 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0462000000000004e-05 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412290+0000", 2024-09-10T05:57:16.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077389110000000002 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412458+0000", 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016795499999999999 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2774 3.1e e74/57 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.625440917000001, 2024-09-10T05:57:16.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016469788999999999, 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:16.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405690+0000", 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3539999999999998e-06 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412675+0000", 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069848089999999998 2024-09-10T05:57:16.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412710+0000", 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5015999999999998e-05 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412735+0000", 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5272000000000001e-05 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412912+0000", 2024-09-10T05:57:16.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017682599999999999 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412970+0000", 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8017999999999999e-05 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422024+0000", 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090533639999999995 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422158+0000", 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013412999999999999 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2779 3.36 3:6deaa553:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.571642764, 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014954103, 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2779 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459490+0000", 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7620000000000001e-06 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463585+0000", 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040951779999999997 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463622+0000", 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6748000000000001e-05 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463641+0000", 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8685000000000002e-05 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463728+0000", 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7354000000000004e-05 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463858+0000", 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130464 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463967+0000", 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108853 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.473175+0000", 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092074819999999995 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474264+0000", 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001089759 2024-09-10T05:57:16.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474369+0000", 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104374 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474440+0000", 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1444000000000002e-05 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.147 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.147 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:16.148 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:16.149 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:16.144+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:16.249 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:16.247+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:16.320 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:16.320 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:16.320 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:16.320 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:16.335 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:16.379 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:16.376+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:16.452 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:16.451+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:16.453 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:16.454 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:16.454 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:16.468 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:16.553 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:16.551+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:16.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:16.642 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:16.642 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:16.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:16.642 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:16.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 129.65598260300001, 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.643 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:57:16.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:57:16.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:57:16.650 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 127.700438068, 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:57:16.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.080826437999999, 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:57:16.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:57:16.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.662 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.184214180000001, 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.663 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:57:16.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:57:16.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1950 3.11 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.216564827999999, 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020018444999999999, 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.670 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1950 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:16.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422209+0000", 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.419e-06 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426537+0000", 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043276149999999999 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426567+0000", 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0301999999999999e-05 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426580+0000", 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2917e-05 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426672+0000", 2024-09-10T05:57:16.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2218000000000004e-05 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426843+0000", 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017047699999999999 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427340+0000", 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049682899999999996 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442068+0000", 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01472853 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442088+0000", 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442160+0000", 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2138000000000006e-05 2024-09-10T05:57:16.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442225+0000", 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5186999999999998e-05 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2698 3.d 3:b2e26eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:16.676 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.015161394, 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019089317000000001, 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2698 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623614+0000", 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.614e-06 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628427+0000", 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048128399999999997 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628456+0000", 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9379000000000001e-05 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628473+0000", 2024-09-10T05:57:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436e-05 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628541+0000", 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8375999999999997e-05 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628668+0000", 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012706699999999999 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628770+0000", 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102012 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636407+0000", 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076366639999999996 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642629+0000", 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062227059999999997 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642670+0000", 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0228999999999997e-05 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642700+0000", 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9994000000000001e-05 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.682 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2715 3.3b 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.839164328000001, 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024491215, 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2715 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799611+0000", 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4740000000000001e-06 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803674+0000", 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040627750000000002 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803699+0000", 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4998999999999999e-05 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803716+0000", 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.713e-05 2024-09-10T05:57:16.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803861+0000", 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804271+0000", 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000410782 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804670+0000", 2024-09-10T05:57:16.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039885499999999999 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823762+0000", 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01909168 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823814+0000", 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2293000000000002e-05 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823978+0000", 2024-09-10T05:57:16.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016379799999999999 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.824099+0000", 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120677 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2716 3.3b 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.829208652, 2024-09-10T05:57:16.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021381936000000001, 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2716 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:16.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809566+0000", 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4700000000000001e-06 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814350+0000", 2024-09-10T05:57:16.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047846349999999998 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814391+0000", 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0881999999999999e-05 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814417+0000", 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.816891+0000", 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024744400000000001 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817142+0000", 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025102600000000001 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817376+0000", 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234267 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.826993+0000", 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096162609999999992 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830661+0000", 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036685229999999999 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830823+0000", 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016209899999999999 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830945+0000", 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012169 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2736 3.15 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.694 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.623891921, 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021012902999999999, 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2736 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014883+0000", 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019463+0000", 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045800299999999997 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019510+0000", 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7361999999999998e-05 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019530+0000", 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.997e-05 2024-09-10T05:57:16.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019681+0000", 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015094500000000001 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019911+0000", 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022981400000000001 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020130+0000", 2024-09-10T05:57:16.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021882 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.032856+0000", 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012725670999999999 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035613+0000", 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027571359999999999 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035768+0000", 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015560199999999999 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035893+0000", 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012442599999999999 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2735 3.2a e74/24 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head v 74'7, mlcod=73'5)", 2024-09-10T05:57:16.700 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.622960047999999, 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018481485999999998, 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015813+0000", 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1699999999999997e-07 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020431+0000", 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046181900000000003 2024-09-10T05:57:16.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020481+0000", 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0204999999999998e-05 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020504+0000", 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3193e-05 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020625+0000", 2024-09-10T05:57:16.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012044600000000001 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020660+0000", 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034217+0000", 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013556558 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034293+0000", 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6211000000000006e-05 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.614505292, 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:57:16.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2738 3.39 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.602001079000001, 2024-09-10T05:57:16.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439545999999999, 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2738 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036773+0000", 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5000000000000002e-06 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042338+0000", 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055647520000000001 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042369+0000", 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1009000000000001e-05 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042388+0000", 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8612999999999999e-05 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042526+0000", 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138806 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042842+0000", 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000315295 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.043126+0000", 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028447800000000001 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.052457+0000", 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093312510000000005 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.056914+0000", 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044569600000000003 2024-09-10T05:57:16.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057087+0000", 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017276499999999999 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057210+0000", 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012311700000000001 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2754 3.2a e74/24 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head v 74'9, mlcod=74'7)", 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.437173003, 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020956794000000001, 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201602+0000", 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1130000000000001e-06 2024-09-10T05:57:16.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204828+0000", 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032265219999999999 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204882+0000", 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3205000000000003e-05 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204909+0000", 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7138999999999999e-05 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205102+0000", 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019347099999999999 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205161+0000", 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8291999999999997e-05 2024-09-10T05:57:16.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222429+0000", 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017268480999999999 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222556+0000", 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012657099999999999 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.434026696, 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:57:16.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.728 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2760 3.37 3:ee0dd768:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.385332207999999, 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021061340000000001, 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2760 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.729 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253444+0000", 2024-09-10T05:57:16.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6229999999999996e-06 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258934+0000", 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005489524 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258985+0000", 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0986000000000003e-05 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259001+0000", 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259120+0000", 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118564 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259374+0000", 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025416600000000001 2024-09-10T05:57:16.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259600+0000", 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225563 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.269405+0000", 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098055409999999992 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274344+0000", 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049393040000000003 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274432+0000", 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7616999999999998e-05 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274501+0000", 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8910000000000003e-05 2024-09-10T05:57:16.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.364450695, 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:57:16.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2765 3.e 3:7051b691:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.333823591, 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019300435000000001, 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.740 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2765 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304951+0000", 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8169999999999999e-06 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308937+0000", 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039864169999999999 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308970+0000", 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2965e-05 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308987+0000", 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6710000000000001e-05 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309116+0000", 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012852800000000001 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309342+0000", 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225942 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309553+0000", 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021175999999999999 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320354+0000", 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010800535999999999 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.323937+0000", 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035836290000000001 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324118+0000", 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000180695 2024-09-10T05:57:16.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324249+0000", 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130436 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2767 3.37 3:ef27b18b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.309737359, 2024-09-10T05:57:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019966886, 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2767 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:16.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329038+0000", 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3299999999999999e-06 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333904+0000", 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048659869999999996 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333944+0000", 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0735000000000002e-05 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333964+0000", 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9443e-05 2024-09-10T05:57:16.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334121+0000", 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015721499999999999 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334365+0000", 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024407000000000001 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:16.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334588+0000", 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022284 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.346368+0000", 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011780255 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348673+0000", 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023048080000000002 2024-09-10T05:57:16.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348858+0000", 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184904 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.349001+0000", 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143299 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2773 3.3f 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.243920104000001, 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018274233000000001, 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2773 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.753 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394855+0000", 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4630000000000001e-06 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399567+0000", 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047114490000000004 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399609+0000", 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2082999999999997e-05 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399627+0000", 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8532000000000001e-05 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399768+0000", 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141216 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400014+0000", 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000245947 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400243+0000", 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022854 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.408899+0000", 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086558520000000003 2024-09-10T05:57:16.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412825+0000", 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039261599999999997 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412993+0000", 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016819099999999999 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.413126+0000", 2024-09-10T05:57:16.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001328 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2780 3.15 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.162267307, 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020859142000000001, 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:16.759 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2780 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476525+0000", 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669000000000001e-05 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480305+0000", 2024-09-10T05:57:16.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037793739999999998 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480340+0000", 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5082000000000001e-05 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480356+0000", 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5985999999999999e-05 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480444+0000", 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8898000000000002e-05 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480600+0000", 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155685 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480746+0000", 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014611 2024-09-10T05:57:16.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.487929+0000", 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071829750000000003 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497194+0000", 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092649140000000008 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497294+0000", 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100134 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497364+0000", 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9314999999999996e-05 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:16.766 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:16.766 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:16.767 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:16.764+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:16.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:16.821 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:16.839 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:16.839 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:16.856 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:16.857 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:16.868 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:16.867+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:16.874 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:16.874 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:16.894 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:16.895 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:16.900 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:16.900 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:16.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:16.915 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:16.916 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:16.938 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:16.938 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:16.958 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:16.958 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:16.969 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:16.964+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:17.031 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:17.031 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:17.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:17.070 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:17.064+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:17.167 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:17.167 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:17.171 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:17.164+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:17.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:17.272 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:17.271+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:17.299 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:17.299 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:17.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:17.373 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:17.368+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:17.474 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:17.472+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:17.478 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:17.478 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:17.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:17.575 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:17.572+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:17.613 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:17.613 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:17.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:17.676 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:17.675+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:17.752 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:17.752 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:17.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:17.812 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:17.811+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:17.877 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:17.872+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:17.939 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:17.939 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:17.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:17.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:57:18.000 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:17.999+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:18.072 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:18.072 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:18.079 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:18.075+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:18.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:18.180 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:18.179+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:18.249 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:18.250 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:18.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:18.309 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:18.307+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:18.381 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:18.376+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:18.424 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:18.424 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:18.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:18.482 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:18.476+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:18.555 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:18.555 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:18.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:18.582 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:18.579+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:18.683 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:18.683+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:18.700 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:18.700 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:18.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:18.784 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:18.780+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:18.839 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:18.840 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:18.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:18.885 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:18.883+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:18.940 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:57:18.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:18.986 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:18.980+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:19.021 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:19.021 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:19.036 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:19.127 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:19.124+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:19.150 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:19.165 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:19.181 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:19.181 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:19.188 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:19.184+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:19.198 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:19.205 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:19.205 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:19.218 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:19.219 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:19.220 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:19.238 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:19.239 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:19.256 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:19.256 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:19.276 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:19.276 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:19.289 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:19.287+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:19.385 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:19.386 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:19.390 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:19.387+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:19.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:19.491 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:19.488+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:19.524 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.524 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.958281413000002, 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.525 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:57:19.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:57:19.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.530 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.931470625000003, 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.531 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:57:19.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:57:19.536 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.099625832000001, 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.537 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:57:19.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1812 3.30 3:0f16d871:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.091547437999999, 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017116908, 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1812 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428953+0000", 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428955+0000", 2024-09-10T05:57:19.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6700000000000001e-06 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431687+0000", 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002732342 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431712+0000", 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5114e-05 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431725+0000", 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2976000000000001e-05 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.431862+0000", 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013720799999999999 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432067+0000", 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205028 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.432272+0000", 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000205105 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.439520+0000", 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072476550000000004 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445702+0000", 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061817640000000002 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.445898+0000", 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195928 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446070+0000", 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017211799999999999 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2704 3.16 3:6b2c0ee3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.837618707000001, 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022182810000000001, 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2704 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682886+0000", 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4429999999999996e-06 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686829+0000", 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039425720000000001 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686867+0000", 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8466000000000001e-05 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686887+0000", 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9629000000000001e-05 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687049+0000", 2024-09-10T05:57:19.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161619 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687342+0000", 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029348500000000001 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687579+0000", 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023733000000000001 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.696533+0000", 2024-09-10T05:57:19.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089536040000000004 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704753+0000", 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082205669999999998 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704929+0000", 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017553499999999999 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.705065+0000", 2024-09-10T05:57:19.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013556000000000001 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2706 3.1d 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.816918939000001, 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024374384999999998, 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.556 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2706 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703585+0000", 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.287e-06 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709069+0000", 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005484432 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709101+0000", 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2063000000000001e-05 2024-09-10T05:57:19.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709117+0000", 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709221+0000", 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103867 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709490+0000", 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269053 2024-09-10T05:57:19.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709739+0000", 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024859600000000002 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.724317+0000", 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014578512 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727648+0000", 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033310420000000002 2024-09-10T05:57:19.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727824+0000", 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017585100000000001 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727956+0000", 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013196 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2707 3.5 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.807512961, 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016855370000000001, 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2707 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712988+0000", 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.712991+0000", 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5700000000000001e-06 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717888+0000", 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048966290000000004 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717925+0000", 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7404999999999998e-05 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.717946+0000", 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0662999999999999e-05 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718163+0000", 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021718400000000001 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718403+0000", 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240196 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.718611+0000", 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000208161 2024-09-10T05:57:19.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728002+0000", 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093903579999999997 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729567+0000", 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001565005 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729711+0000", 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014411599999999999 2024-09-10T05:57:19.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.729843+0000", 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013208299999999999 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2708 3.2a 3:546514ef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.797483459999999, 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021062501000000001, 2024-09-10T05:57:19.567 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2708 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723020+0000", 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6259999999999999e-06 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727965+0000", 2024-09-10T05:57:19.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049453429999999996 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727991+0000", 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6083000000000001e-05 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728016+0000", 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728170+0000", 2024-09-10T05:57:19.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015342900000000001 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728472+0000", 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030251099999999999 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728707+0000", 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023466700000000001 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739602+0000", 2024-09-10T05:57:19.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010895083 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743763+0000", 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041615360000000004 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743947+0000", 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018321400000000001 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744080+0000", 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013281999999999999 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2709 3.36 e73/24 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head v 73'5, mlcod=72'3)", 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.779960635999998, 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015622295, 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.573 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740540+0000", 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740542+0000", 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5799999999999999e-06 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744345+0000", 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038023129999999999 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744379+0000", 2024-09-10T05:57:19.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4224999999999998e-05 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744404+0000", 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4586000000000001e-05 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744558+0000", 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000154146 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744622+0000", 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4491000000000003e-05 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756023+0000", 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011401262000000001 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756162+0000", 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013869199999999999 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.577 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2711 3.3c 3:3f29615d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.760048812000001, 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015648141000000001, 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.578 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2711 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760452+0000", 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.760456+0000", 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2869999999999998e-06 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764614+0000", 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041582520000000003 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764651+0000", 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6439000000000001e-05 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764670+0000", 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9536000000000001e-05 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.764820+0000", 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974300000000001 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765073+0000", 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025336599999999999 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.765314+0000", 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024024300000000001 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.774451+0000", 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091372620000000002 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775903+0000", 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001452432 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.775996+0000", 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2283999999999999e-05 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.776100+0000", 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010429699999999999 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2714 3.16 3:696d6af6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.730911764999998, 2024-09-10T05:57:19.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018296902, 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2714 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:19.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789592+0000", 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4199999999999999e-06 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793519+0000", 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039268360000000004 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793560+0000", 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1078000000000002e-05 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793578+0000", 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793710+0000", 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013122899999999999 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793970+0000", 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025991600000000001 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:19.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.794207+0000", 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023692299999999999 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.806549+0000", 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012342671 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807674+0000", 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001124702 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807774+0000", 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9987000000000003e-05 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807886+0000", 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111753 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.592851273000001, 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.591 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:57:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:57:19.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.513154132, 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:57:19.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.602 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2747 3.2a 3:56df8694:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.393872496, 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336575999999999, 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2747 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126632+0000", 2024-09-10T05:57:19.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130540+0000", 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003907794 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130580+0000", 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0194000000000002e-05 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130602+0000", 2024-09-10T05:57:19.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2169999999999999e-05 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130776+0000", 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174005 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131200+0000", 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042367199999999999 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131649+0000", 2024-09-10T05:57:19.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000449171 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.146739+0000", 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01508959 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150675+0000", 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003936419 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150810+0000", 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135162 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150965+0000", 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015443299999999999 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2749 3.16 3:6b50c908:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:19.608 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.375089053, 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020765693000000002, 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2749 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:19.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145415+0000", 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149511+0000", 2024-09-10T05:57:19.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040962409999999996 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149539+0000", 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7231000000000001e-05 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149552+0000", 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3771000000000001e-05 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149708+0000", 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155174 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150116+0000", 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040834600000000002 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150545+0000", 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000428641 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.158644+0000", 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080993990000000002 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.165933+0000", 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072888739999999999 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166073+0000", 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013972499999999999 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166177+0000", 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104597 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2751 3.21 e74/24 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.352736078, 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017265005, 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.614 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167766+0000", 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0590000000000001e-06 2024-09-10T05:57:19.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172413+0000", 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046462359999999998 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172447+0000", 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4731999999999999e-05 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172469+0000", 2024-09-10T05:57:19.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1460000000000001e-05 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172598+0000", 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128646 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172642+0000", 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4274999999999999e-05 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.184906+0000", 2024-09-10T05:57:19.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012264353 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.185029+0000", 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123244 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2753 3.21 e74/24 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.332659159999999, 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016969758000000001, 2024-09-10T05:57:19.618 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187841+0000", 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.187844+0000", 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2970000000000002e-06 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193441+0000", 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055969189999999997 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193476+0000", 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5748999999999999e-05 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193493+0000", 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6762999999999999e-05 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193634+0000", 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014096599999999999 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.193677+0000", 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3305e-05 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204633+0000", 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010955761 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204811+0000", 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017799800000000001 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:19.622 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.324803285000002, 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:19.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2761 3.3c 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.255655836999999, 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018127095999999999, 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.628 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2761 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264849+0000", 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3309999999999997e-06 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270094+0000", 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005245464 2024-09-10T05:57:19.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270134+0000", 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9926999999999999e-05 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270157+0000", 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824999999999999e-05 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270325+0000", 2024-09-10T05:57:19.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016784699999999999 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270580+0000", 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025531600000000001 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270912+0000", 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033126999999999999 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.280570+0000", 2024-09-10T05:57:19.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096586569999999993 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282695+0000", 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021244139999999998 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282853+0000", 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015866799999999999 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282972+0000", 2024-09-10T05:57:19.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118377 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2763 3.28 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.239227056000001, 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019948423, 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:19.634 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2763 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281276+0000", 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0599999999999999e-06 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286026+0000", 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047498289999999997 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286074+0000", 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7994999999999997e-05 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286099+0000", 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.51e-05 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286290+0000", 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019037500000000001 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286698+0000", 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000408651 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.287116+0000", 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041778300000000002 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300422+0000", 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013306226000000001 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300973+0000", 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055055100000000004 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301131+0000", 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015752100000000001 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301222+0000", 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1331999999999999e-05 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:19.639 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:19.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:19.641 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:19.636+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:19.742 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:19.739+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:19.808 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:19.808 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:19.809 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:19.809 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:19.823 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:19.867 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:19.864+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:19.941 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:19.941 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:19.942 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:19.942 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:19.942 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:19.945 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:19.939+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:19.959 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:20.047 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:20.044+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:20.126 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 109.536417637, 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.127 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:57:20.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:20.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1667 3.3f e66/24 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.560306335, 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020534329, 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565034+0000", 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4400000000000001e-07 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569603+0000", 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045689320000000004 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569639+0000", 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569658+0000", 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9582999999999999e-05 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569788+0000", 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129395 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569843+0000", 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4701999999999999e-05 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585439+0000", 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015596765 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585568+0000", 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128288 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2687 3.10 3:0bdf9def:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:20.138 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.633525287000001, 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015293677, 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2687 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:20.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491818+0000", 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495801+0000", 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039831700000000003 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495836+0000", 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4986e-05 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495853+0000", 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7082999999999999e-05 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496003+0000", 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149946 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496248+0000", 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024488999999999999 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496481+0000", 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023332299999999999 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.503197+0000", 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006716039 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.506985+0000", 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037875700000000001 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507052+0000", 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7014000000000006e-05 2024-09-10T05:57:20.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507108+0000", 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6378999999999997e-05 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2690 3.20 3:0621a9df:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.593426933, 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013809238, 2024-09-10T05:57:20.144 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2690 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531915+0000", 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6529999999999998e-06 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535839+0000", 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003923569 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535872+0000", 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2892000000000003e-05 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535889+0000", 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946e-05 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535955+0000", 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6314000000000002e-05 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536068+0000", 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011280100000000001 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536160+0000", 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1886999999999996e-05 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.542293+0000", 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061327559999999996 2024-09-10T05:57:20.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545600+0000", 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033079699999999999 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545663+0000", 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2299999999999996e-05 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545722+0000", 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9150000000000001e-05 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.149 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2697 3.a 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.510671608999999, 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021976678999999999, 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2697 2024-09-10T05:57:20.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614672+0000", 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9570000000000004e-06 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618642+0000", 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003970215 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618682+0000", 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0241999999999999e-05 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618702+0000", 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9259e-05 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618865+0000", 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162893 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619114+0000", 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024920299999999998 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619366+0000", 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025260899999999999 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.633958+0000", 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014591695 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636314+0000", 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023562790000000002 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636498+0000", 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018343799999999999 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636645+0000", 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014688900000000001 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.155 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2702 3.33 e73/57 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head v 73'6, mlcod=72'4)", 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.459607965, 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011423348, 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665735+0000", 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0730000000000001e-06 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670171+0000", 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044365059999999998 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670193+0000", 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2195999999999999e-05 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670205+0000", 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1248e-05 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670278+0000", 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3145000000000005e-05 2024-09-10T05:57:20.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670297+0000", 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9145000000000001e-05 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677061+0000", 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067644940000000002 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677155+0000", 2024-09-10T05:57:20.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3541000000000004e-05 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2709 3.36 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.390222665, 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021772117000000001, 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.160 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2709 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735123+0000", 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739149+0000", 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040258899999999999 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739195+0000", 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6238e-05 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739226+0000", 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0756000000000002e-05 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739431+0000", 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020536799999999999 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739867+0000", 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043582799999999997 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740323+0000", 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045658999999999999 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750593+0000", 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010269215999999999 2024-09-10T05:57:20.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756560+0000", 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059669450000000004 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756768+0000", 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020802799999999999 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756889+0000", 2024-09-10T05:57:20.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012152200000000001 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2710 3.1e e73/57 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head v 73'2, mlcod=0'0)", 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.374487463000001, 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016219428000000001, 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750855+0000", 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:20.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755688+0000", 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048322399999999998 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755736+0000", 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8925999999999999e-05 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755761+0000", 2024-09-10T05:57:20.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4598999999999999e-05 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755935+0000", 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017345500000000001 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755979+0000", 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4385000000000003e-05 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.766931+0000", 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010952051000000001 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.767072+0000", 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014061600000000001 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2712 3.1e e73/57 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:20.170 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.352696036000001, 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015148445, 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:20.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772653+0000", 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.02e-06 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778513+0000", 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058600609999999997 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778542+0000", 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9411999999999999e-05 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778557+0000", 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5359999999999999e-05 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778655+0000", 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7146999999999997e-05 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778698+0000", 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3659000000000003e-05 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787711+0000", 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090123990000000008 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787792+0000", 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1386999999999999e-05 2024-09-10T05:57:20.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2722 3.1e e73/57 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.247387461999999, 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014888180000000001, 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877955+0000", 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.27e-06 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883040+0000", 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050841430000000002 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883073+0000", 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3506000000000001e-05 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883090+0000", 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6966e-05 2024-09-10T05:57:20.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883250+0000", 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015971599999999999 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883296+0000", 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5785000000000003e-05 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892725+0000", 2024-09-10T05:57:20.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094290840000000008 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892840+0000", 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011571 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2728 3.34 e74/24 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head v 74'3, mlcod=72'1)", 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.176046271000001, 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020234839000000001, 2024-09-10T05:57:20.179 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:20.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949294+0000", 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3600000000000002e-07 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952508+0000", 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032136700000000001 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952549+0000", 2024-09-10T05:57:20.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1118000000000002e-05 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952573+0000", 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4017000000000001e-05 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952750+0000", 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017677799999999999 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952815+0000", 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4788000000000004e-05 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969436+0000", 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016621585000000001 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969528+0000", 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1947000000000006e-05 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.183 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2739 3.a 3:50ecfca4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.080946187999999, 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018342160999999999, 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.184 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2739 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:20.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044398+0000", 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0570000000000003e-06 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048829+0000", 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044313640000000001 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048880+0000", 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0667000000000001e-05 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048905+0000", 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5636e-05 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049094+0000", 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189106 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049502+0000", 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040768500000000002 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049904+0000", 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040155200000000001 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.058896+0000", 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089927700000000006 2024-09-10T05:57:20.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062570+0000", 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003673272 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062659+0000", 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9221000000000005e-05 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062736+0000", 2024-09-10T05:57:20.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6830999999999997e-05 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2741 3.26 3:6709f12d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.061687359, 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017830538999999999, 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2741 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063654+0000", 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.187e-06 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067623+0000", 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039688650000000002 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067651+0000", 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7637e-05 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067664+0000", 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3497e-05 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067771+0000", 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106457 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068031+0000", 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026004000000000001 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068262+0000", 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230829 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.080068+0000", 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011806291 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081260+0000", 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001191819 2024-09-10T05:57:20.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081407+0000", 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014721299999999999 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081483+0000", 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5704000000000006e-05 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2743 3.34 e74/24 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.033311104999999, 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013595565, 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092032+0000", 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0910000000000001e-06 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094626+0000", 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025944179999999998 2024-09-10T05:57:20.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094669+0000", 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2982000000000003e-05 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094698+0000", 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8951000000000001e-05 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094824+0000", 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012603000000000001 2024-09-10T05:57:20.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094862+0000", 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7524999999999997e-05 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105528+0000", 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010666556000000001 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105624+0000", 2024-09-10T05:57:20.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6012000000000002e-05 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2757 3.2e e74/24 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.899619079000001, 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018393152999999999, 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3e-07 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231370+0000", 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056484719999999999 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231401+0000", 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1139000000000001e-05 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231417+0000", 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231573+0000", 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015524399999999999 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231613+0000", 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0725000000000001e-05 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243986+0000", 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012372342 2024-09-10T05:57:20.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.244114+0000", 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128016 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2766 3.a 3:53b220aa:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.810300865999999, 2024-09-10T05:57:20.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02050532, 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2766 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:20.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315042+0000", 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320520+0000", 2024-09-10T05:57:20.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054777819999999996 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320561+0000", 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1309e-05 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320580+0000", 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9225999999999999e-05 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320754+0000", 2024-09-10T05:57:20.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017325500000000001 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321183+0000", 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042883500000000002 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321607+0000", 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042457500000000001 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333931+0000", 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012323831 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335304+0000", 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001373211 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335422+0000", 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011828999999999999 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335544+0000", 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121623 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2770 3.a 3:5300e91c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.761448543, 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019665727000000001, 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2770 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363896+0000", 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8389999999999997e-06 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368218+0000", 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043216349999999999 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368257+0000", 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9641999999999998e-05 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368276+0000", 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.914e-05 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368444+0000", 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016791199999999999 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368700+0000", 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025589900000000002 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368939+0000", 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023926700000000001 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.382054+0000", 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013114139 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383331+0000", 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012779040000000001 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383434+0000", 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010233700000000001 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383557+0000", 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2024-09-10T05:57:20.215 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2773 3.3f e74/24 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head v 74'4, mlcod=71'2)", 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.724846008, 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011963965, 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400496+0000", 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8200000000000001e-06 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404258+0000", 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003761707 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404300+0000", 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1742000000000001e-05 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404318+0000", 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7989999999999999e-05 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404480+0000", 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162378 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404551+0000", 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0462000000000004e-05 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412290+0000", 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077389110000000002 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412458+0000", 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016795499999999999 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2774 3.1e e74/57 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.719651632000001, 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016469788999999999, 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.220 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405690+0000", 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3539999999999998e-06 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412675+0000", 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069848089999999998 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412710+0000", 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5015999999999998e-05 2024-09-10T05:57:20.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412735+0000", 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5272000000000001e-05 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412912+0000", 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017682599999999999 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412970+0000", 2024-09-10T05:57:20.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8017999999999999e-05 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422024+0000", 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090533639999999995 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422158+0000", 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013412999999999999 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.224 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2779 3.36 3:6deaa553:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.665853478999999, 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014954103, 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2779 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459490+0000", 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7620000000000001e-06 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463585+0000", 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040951779999999997 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463622+0000", 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6748000000000001e-05 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463641+0000", 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8685000000000002e-05 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463728+0000", 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7354000000000004e-05 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463858+0000", 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130464 2024-09-10T05:57:20.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463967+0000", 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108853 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.473175+0000", 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092074819999999995 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474264+0000", 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001089759 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474369+0000", 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104374 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474440+0000", 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1444000000000002e-05 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.231 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.231 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:20.232 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:20.232 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:20.228+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:20.333 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:20.328+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:20.404 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:20.404 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:20.404 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:20.405 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:20.418 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:20.434 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:20.431+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:20.535 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:20.531+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:20.587 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:20.587 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:20.587 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:20.587 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:20.587 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:20.601 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:20.636 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:20.635+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:20.723 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:57:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 133.73659623200001, 2024-09-10T05:57:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:57:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:57:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:57:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:57:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:57:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:57:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:57:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:57:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:57:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:57:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:57:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:57:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:57:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:57:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:57:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:57:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 131.78105169700001, 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:57:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:57:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.161440067000001, 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:57:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:57:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.264827809000003, 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:57:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:57:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:57:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:57:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:57:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:57:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:57:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:57:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:57:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:57:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1950 3.11 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.297178457000001, 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020018444999999999, 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1950 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422209+0000", 2024-09-10T05:57:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.419e-06 2024-09-10T05:57:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426537+0000", 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043276149999999999 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426567+0000", 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0301999999999999e-05 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426580+0000", 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2917e-05 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426672+0000", 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2218000000000004e-05 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426843+0000", 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017047699999999999 2024-09-10T05:57:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427340+0000", 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049682899999999996 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442068+0000", 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01472853 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442088+0000", 2024-09-10T05:57:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442160+0000", 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2138000000000006e-05 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442225+0000", 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5186999999999998e-05 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2698 3.d 3:b2e26eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.095775023000002, 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019089317000000001, 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2698 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623614+0000", 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.614e-06 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628427+0000", 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048128399999999997 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628456+0000", 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9379000000000001e-05 2024-09-10T05:57:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628473+0000", 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436e-05 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628541+0000", 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8375999999999997e-05 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628668+0000", 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012706699999999999 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628770+0000", 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102012 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636407+0000", 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076366639999999996 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642629+0000", 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062227059999999997 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642670+0000", 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0228999999999997e-05 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642700+0000", 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9994000000000001e-05 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2715 3.3b 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.919777957000001, 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024491215, 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2715 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799611+0000", 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4740000000000001e-06 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803674+0000", 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040627750000000002 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803699+0000", 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4998999999999999e-05 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803716+0000", 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.713e-05 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803861+0000", 2024-09-10T05:57:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804271+0000", 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000410782 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804670+0000", 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039885499999999999 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823762+0000", 2024-09-10T05:57:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01909168 2024-09-10T05:57:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823814+0000", 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2293000000000002e-05 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823978+0000", 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016379799999999999 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.824099+0000", 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120677 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2716 3.3b 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.909822281, 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021381936000000001, 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2716 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809566+0000", 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4700000000000001e-06 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814350+0000", 2024-09-10T05:57:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047846349999999998 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814391+0000", 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0881999999999999e-05 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814417+0000", 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.816891+0000", 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024744400000000001 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817142+0000", 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025102600000000001 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817376+0000", 2024-09-10T05:57:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234267 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.826993+0000", 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096162609999999992 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830661+0000", 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036685229999999999 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830823+0000", 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016209899999999999 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830945+0000", 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012169 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2736 3.15 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.70450555, 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021012902999999999, 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2736 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014883+0000", 2024-09-10T05:57:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019463+0000", 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045800299999999997 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019510+0000", 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7361999999999998e-05 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019530+0000", 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.997e-05 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019681+0000", 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015094500000000001 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019911+0000", 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022981400000000001 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020130+0000", 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021882 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.032856+0000", 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012725670999999999 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035613+0000", 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027571359999999999 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035768+0000", 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015560199999999999 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035893+0000", 2024-09-10T05:57:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012442599999999999 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2735 3.2a e74/24 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head v 74'7, mlcod=73'5)", 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.703573677000001, 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018481485999999998, 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015813+0000", 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1699999999999997e-07 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020431+0000", 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046181900000000003 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020481+0000", 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0204999999999998e-05 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020504+0000", 2024-09-10T05:57:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3193e-05 2024-09-10T05:57:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020625+0000", 2024-09-10T05:57:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012044600000000001 2024-09-10T05:57:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020660+0000", 2024-09-10T05:57:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:57:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034217+0000", 2024-09-10T05:57:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013556558 2024-09-10T05:57:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034293+0000", 2024-09-10T05:57:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6211000000000006e-05 2024-09-10T05:57:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:20.807 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.695118920999999, 2024-09-10T05:57:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:57:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:57:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:57:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:57:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:57:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:57:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:57:20.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:57:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:57:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:57:20.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:57:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:57:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:57:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:57:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:57:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:57:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:57:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:57:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:57:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:57:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:57:20.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:57:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:57:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:57:20.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2738 3.39 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.821 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.682614707999999, 2024-09-10T05:57:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439545999999999, 2024-09-10T05:57:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2738 2024-09-10T05:57:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.823 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036773+0000", 2024-09-10T05:57:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5000000000000002e-06 2024-09-10T05:57:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042338+0000", 2024-09-10T05:57:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055647520000000001 2024-09-10T05:57:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042369+0000", 2024-09-10T05:57:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1009000000000001e-05 2024-09-10T05:57:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042388+0000", 2024-09-10T05:57:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8612999999999999e-05 2024-09-10T05:57:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042526+0000", 2024-09-10T05:57:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138806 2024-09-10T05:57:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042842+0000", 2024-09-10T05:57:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000315295 2024-09-10T05:57:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:20.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.043126+0000", 2024-09-10T05:57:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028447800000000001 2024-09-10T05:57:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.052457+0000", 2024-09-10T05:57:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093312510000000005 2024-09-10T05:57:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.056914+0000", 2024-09-10T05:57:20.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044569600000000003 2024-09-10T05:57:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057087+0000", 2024-09-10T05:57:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017276499999999999 2024-09-10T05:57:20.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057210+0000", 2024-09-10T05:57:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012311700000000001 2024-09-10T05:57:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.835 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2754 3.2a e74/24 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head v 74'9, mlcod=74'7)", 2024-09-10T05:57:20.836 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.517786632, 2024-09-10T05:57:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020956794000000001, 2024-09-10T05:57:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.837 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201602+0000", 2024-09-10T05:57:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1130000000000001e-06 2024-09-10T05:57:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204828+0000", 2024-09-10T05:57:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032265219999999999 2024-09-10T05:57:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204882+0000", 2024-09-10T05:57:20.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3205000000000003e-05 2024-09-10T05:57:20.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204909+0000", 2024-09-10T05:57:20.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7138999999999999e-05 2024-09-10T05:57:20.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205102+0000", 2024-09-10T05:57:20.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019347099999999999 2024-09-10T05:57:20.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205161+0000", 2024-09-10T05:57:20.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8291999999999997e-05 2024-09-10T05:57:20.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222429+0000", 2024-09-10T05:57:20.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017268480999999999 2024-09-10T05:57:20.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222556+0000", 2024-09-10T05:57:20.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012657099999999999 2024-09-10T05:57:20.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.846 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.847 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.847 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.847 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:20.847 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.514640324999998, 2024-09-10T05:57:20.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:57:20.848 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.848 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.848 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.848 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.849 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.849 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:57:20.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.849 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:20.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:20.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:57:20.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2760 3.37 3:ee0dd768:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.465945837, 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021061340000000001, 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2760 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253444+0000", 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6229999999999996e-06 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258934+0000", 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005489524 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258985+0000", 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0986000000000003e-05 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259001+0000", 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259120+0000", 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118564 2024-09-10T05:57:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259374+0000", 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025416600000000001 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259600+0000", 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225563 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.269405+0000", 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098055409999999992 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274344+0000", 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049393040000000003 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274432+0000", 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7616999999999998e-05 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274501+0000", 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8910000000000003e-05 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.445064324000001, 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.862 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.866 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2765 3.e 3:7051b691:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.41443722, 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019300435000000001, 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.867 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2765 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304951+0000", 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8169999999999999e-06 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308937+0000", 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039864169999999999 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308970+0000", 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2965e-05 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308987+0000", 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6710000000000001e-05 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309116+0000", 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012852800000000001 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309342+0000", 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225942 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309553+0000", 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021175999999999999 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320354+0000", 2024-09-10T05:57:20.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010800535999999999 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.323937+0000", 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035836290000000001 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324118+0000", 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000180695 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324249+0000", 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130436 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2767 3.37 3:ef27b18b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.390350988000002, 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019966886, 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.873 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2767 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329038+0000", 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3299999999999999e-06 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333904+0000", 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048659869999999996 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333944+0000", 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0735000000000002e-05 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333964+0000", 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9443e-05 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334121+0000", 2024-09-10T05:57:20.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015721499999999999 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334365+0000", 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024407000000000001 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334588+0000", 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022284 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.346368+0000", 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011780255 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348673+0000", 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023048080000000002 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348858+0000", 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184904 2024-09-10T05:57:20.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.349001+0000", 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143299 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2773 3.3f 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:20.879 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.324533732999999, 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018274233000000001, 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2773 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:20.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394855+0000", 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4630000000000001e-06 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399567+0000", 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047114490000000004 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399609+0000", 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2082999999999997e-05 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399627+0000", 2024-09-10T05:57:20.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8532000000000001e-05 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399768+0000", 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141216 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400014+0000", 2024-09-10T05:57:20.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000245947 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400243+0000", 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022854 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.408899+0000", 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086558520000000003 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412825+0000", 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039261599999999997 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412993+0000", 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016819099999999999 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.413126+0000", 2024-09-10T05:57:20.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001328 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2780 3.15 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.242880935999999, 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020859142000000001, 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:20.886 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2780 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476525+0000", 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669000000000001e-05 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480305+0000", 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037793739999999998 2024-09-10T05:57:20.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480340+0000", 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5082000000000001e-05 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480356+0000", 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5985999999999999e-05 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480444+0000", 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8898000000000002e-05 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480600+0000", 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155685 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480746+0000", 2024-09-10T05:57:20.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014611 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.487929+0000", 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071829750000000003 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497194+0000", 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092649140000000008 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:20.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497294+0000", 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100134 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497364+0000", 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9314999999999996e-05 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:20.892 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:20.893 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records in 2024-09-10T05:57:20.893 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records out 2024-09-10T05:57:20.893 INFO:tasks.workunit.client.0.smithi070.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 18.6959 s, 112 MB/s 2024-09-10T05:57:20.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:20.895 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:20.891+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:20.926 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_57_20 2024-09-10T05:57:20.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:57:21.012 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:21.011+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:21.029 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:21.029 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:21.029 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:21.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:21.096 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:21.092+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:21.196 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:21.195+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:21.210 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:21.211 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:21.211 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:21.211 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:21.211 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:21.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:21.235 INFO:tasks.workunit.client.0.smithi070.stdout:bucket quota max size set for the given user: buck_2024_08_10_05_57_20 2024-09-10T05:57:21.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:21.297 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:21.292+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:21.355 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:21.355 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:21.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:21.355 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:21.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.355 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 107.737080952, 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:57:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:21.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:57:21.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1947 3.3 e66/24 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.949385294999999, 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013054759000000001, 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404196+0000", 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:57:21.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409810+0000", 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056139830000000003 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409851+0000", 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0615000000000003e-05 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409874+0000", 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3476e-05 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409997+0000", 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122745 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.410025+0000", 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7559000000000002e-05 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417196+0000", 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071715090000000004 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417248+0000", 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2225999999999998e-05 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.367 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2675 3.1 3:808dd43d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 21.017402894, 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016454241000000001, 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2675 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336179+0000", 2024-09-10T05:57:21.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337951+0000", 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017720329999999999 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337984+0000", 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3022000000000003e-05 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337999+0000", 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4942e-05 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338081+0000", 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1463000000000003e-05 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338193+0000", 2024-09-10T05:57:21.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111705 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338294+0000", 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101019 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.347997+0000", 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097033069999999996 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352514+0000", 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045167970000000003 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352577+0000", 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3260000000000001e-05 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352630+0000", 2024-09-10T05:57:21.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3208999999999998e-05 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2681 3.3a e73/24 3:5e71f715:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_144:head v 73'5, mlcod=66'3)", 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.931582517999999, 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011684702999999999, 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.374 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421997+0000", 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6800000000000001e-07 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427043+0000", 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005046498 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427064+0000", 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1158999999999999e-05 2024-09-10T05:57:21.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427078+0000", 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3239e-05 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427168+0000", 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0364000000000004e-05 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427198+0000", 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433637+0000", 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064382279999999998 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433681+0000", 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4484000000000003e-05 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.378 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2682 3.20 e73/24 3:072f3612:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_145:head v 73'4, mlcod=72'2)", 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.919792878999999, 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010326201, 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433806+0000", 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0290999999999999e-05 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437646+0000", 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398439999999998 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437669+0000", 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3298e-05 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437684+0000", 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.438e-05 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437777+0000", 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3194000000000003e-05 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437809+0000", 2024-09-10T05:57:21.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2131000000000001e-05 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444041+0000", 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062315460000000001 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444112+0000", 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1517e-05 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2686 3.3 e73/24 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head v 73'4, mlcod=71'2)", 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.868754617, 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010201259000000001, 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484826+0000", 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.86e-06 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488806+0000", 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797879999999997 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488834+0000", 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8004000000000002e-05 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488848+0000", 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4344e-05 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488944+0000", 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5981000000000001e-05 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488975+0000", 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0510000000000001e-05 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.494982+0000", 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060074969999999997 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.495025+0000", 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3275000000000002e-05 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2700 3.1b 3:db80fad5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:21.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.710303581000002, 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503279, 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2700 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643278+0000", 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644670+0000", 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013922209999999999 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644698+0000", 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8152000000000001e-05 2024-09-10T05:57:21.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644711+0000", 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3495999999999999e-05 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644816+0000", 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010404 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644945+0000", 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129939 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645082+0000", 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013664999999999999 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.649392+0000", 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043094989999999996 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656648+0000", 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072568629999999997 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656720+0000", 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1913000000000001e-05 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656779+0000", 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8158999999999997e-05 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2701 3.3d 3:bc92f7d4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.699192279999998, 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013087995, 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2701 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654389+0000", 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655645+0000", 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012560150000000001 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655669+0000", 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3845999999999998e-05 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655679+0000", 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.004e-05 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655738+0000", 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8989000000000001e-05 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655897+0000", 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015926800000000001 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655995+0000", 2024-09-10T05:57:21.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7600000000000001e-05 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666093+0000", 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010098452000000001 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666169+0000", 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6196e-05 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666236+0000", 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7260000000000003e-05 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.667475+0000", 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012381289999999999 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2705 3.17 3:eba32b22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.661209620000001, 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017940067000000001, 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692372+0000", 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693889+0000", 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015172370000000001 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693920+0000", 2024-09-10T05:57:21.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1291999999999998e-05 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693933+0000", 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2693e-05 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694001+0000", 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830000000000006e-05 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694130+0000", 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129114 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694285+0000", 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015531599999999999 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.698265+0000", 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797950000000004 2024-09-10T05:57:21.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710231+0000", 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011966348999999999 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710272+0000", 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1193999999999999e-05 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710309+0000", 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6888000000000003e-05 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.510330907, 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:57:21.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:57:21.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.415 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2729 3.3 e74/24 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.397260103000001, 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011635193, 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962186+0000", 2024-09-10T05:57:21.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058669120000000002 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962213+0000", 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7018000000000001e-05 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962225+0000", 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1836e-05 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962541+0000", 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031584199999999999 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962569+0000", 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8175e-05 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967897+0000", 2024-09-10T05:57:21.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053282190000000004 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967954+0000", 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6950000000000002e-05 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.358161209999999, 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:57:21.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:57:21.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2738 3.39 e74/24 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.309390086000001, 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013163921, 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044191+0000", 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.396e-06 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050959+0000", 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067675360000000002 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050982+0000", 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3275999999999999e-05 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050995+0000", 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2873e-05 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051071+0000", 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5782000000000001e-05 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051099+0000", 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7895999999999999e-05 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057285+0000", 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006186067 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057353+0000", 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8095000000000004e-05 2024-09-10T05:57:21.431 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2742 3.1 3:81622134:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.278158618999999, 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016996092000000001, 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.432 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2742 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075424+0000", 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3380000000000001e-06 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077125+0000", 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001701504 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077157+0000", 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1665000000000003e-05 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077172+0000", 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379e-05 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077245+0000", 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2706000000000005e-05 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077418+0000", 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017356399999999999 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077574+0000", 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015575499999999999 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.082224+0000", 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046503439999999998 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092275+0000", 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010050738 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092356+0000", 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0822999999999995e-05 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092416+0000", 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0275999999999997e-05 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.438 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2746 3.23 3:c7325450:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.238208568000001, 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011885972999999999, 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2746 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115373+0000", 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7920000000000001e-06 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117159+0000", 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017863670000000001 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117189+0000", 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9201e-05 2024-09-10T05:57:21.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117203+0000", 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117288+0000", 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5383000000000006e-05 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117416+0000", 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012752799999999999 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117552+0000", 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013568900000000001 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.124143+0000", 2024-09-10T05:57:21.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065914249999999997 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127122+0000", 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029785509999999999 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127197+0000", 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5593000000000006e-05 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127256+0000", 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9051000000000001e-05 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2750 3.1b 3:da716242:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.197277726999999, 2024-09-10T05:57:21.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016402756000000001, 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2750 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:21.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156304+0000", 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7590000000000002e-06 2024-09-10T05:57:21.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157544+0000", 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012403900000000001 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157569+0000", 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5133000000000001e-05 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157580+0000", 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0953e-05 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157672+0000", 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1685000000000001e-05 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157859+0000", 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694499999999999 2024-09-10T05:57:21.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.158038+0000", 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017913299999999999 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.163265+0000", 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052268569999999997 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172626+0000", 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093605370000000004 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172667+0000", 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1764999999999997e-05 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172704+0000", 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6599e-05 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2771 3.23 3:c48b55d9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.980523295000001, 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010835595999999999, 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2771 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373059+0000", 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1650000000000002e-06 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374820+0000", 2024-09-10T05:57:21.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017613310000000001 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374853+0000", 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374868+0000", 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5591999999999999e-05 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374966+0000", 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7194999999999994e-05 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375153+0000", 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018719799999999999 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375332+0000", 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017948500000000001 2024-09-10T05:57:21.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.381064+0000", 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057316939999999999 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383759+0000", 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026946779999999998 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383833+0000", 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4826999999999994e-05 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383891+0000", 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7701999999999997e-05 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2777 3.1b 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.458 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.915195028999999, 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019570203000000001, 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2777 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438387+0000", 2024-09-10T05:57:21.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9009999999999998e-06 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439946+0000", 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00155905 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439975+0000", 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9311000000000001e-05 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439988+0000", 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3319000000000001e-05 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440057+0000", 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8208999999999997e-05 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440175+0000", 2024-09-10T05:57:21.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118261 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440286+0000", 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111242 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.444527+0000", 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042409800000000001 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457848+0000", 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013320702 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457903+0000", 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457954+0000", 2024-09-10T05:57:21.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1319000000000001e-05 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2781 3.6 3:62f67cea:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.866237090999999, 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012768417000000001, 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2781 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487346+0000", 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4279999999999998e-06 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489317+0000", 2024-09-10T05:57:21.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019705460000000001 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489360+0000", 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3350999999999999e-05 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489382+0000", 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1744000000000001e-05 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489504+0000", 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012243599999999999 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489754+0000", 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000249425 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489995+0000", 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000241151 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.498069+0000", 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080742499999999998 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500028+0000", 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019588600000000002 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500078+0000", 2024-09-10T05:57:21.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0157000000000001e-05 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500110+0000", 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2069000000000001e-05 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2785 3.12 3:49663187:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:21.471 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.813905661, 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015080374000000001, 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2785 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539676+0000", 2024-09-10T05:57:21.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542236+0000", 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025599830000000001 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542273+0000", 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7063000000000001e-05 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542288+0000", 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.518e-05 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542365+0000", 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7292999999999993e-05 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542494+0000", 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012883099999999999 2024-09-10T05:57:21.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542615+0000", 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012126899999999999 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.546794+0000", 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041788149999999998 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:21.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554636+0000", 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078412470000000008 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554707+0000", 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1899999999999999e-05 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554754+0000", 2024-09-10T05:57:21.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6103999999999998e-05 2024-09-10T05:57:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:21.478 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:21.478 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:21.479 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:57:21.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:21.481 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:21.481 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:21.481 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:21.482 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:21.482 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:21.482 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:21.482 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:21.475+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:21.484 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:21.484 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:21.517 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:21.518 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:21.537 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:21.558 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:21.579 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:21.579 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:21.580 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:21.576+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:21.592 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:21.592 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:21.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:21.681 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:21.680+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:21.755 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:21.756 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:21.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:21.816 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:21.815+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:21.882 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:21.876+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:21.883 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:21.883 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:21.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:21.983 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:21.980+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:22.058 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:22.058 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:22.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:22.116 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:22.115+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:22.179 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:22.180 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:22.185 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:22.183+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:22.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:22.286 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:22.284+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:22.343 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:22.343 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:22.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:22.386 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:22.380+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:22.482 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:22.482 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:22.487 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:22.483+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:22.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:22.588 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:22.584+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:22.655 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:22.655 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:22.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:22.712 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:22.711+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:22.781 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:22.782 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:22.790 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:22.784+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:22.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:22.891 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:22.887+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:22.926 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:22.926 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:22.940 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:22.992 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:22.991+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:23.058 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:23.058 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:23.072 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:23.119 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:23.116+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:23.189 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:23.189 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:23.194 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:23.191+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:23.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:23.295 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:23.291+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:23.372 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:23.372 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:23.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:23.396 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:23.395+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:23.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:57:23.509 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:23.509 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:23.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:23.527 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:23.527+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:23.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:23.598 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:23.592+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:23.644 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:23.644 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:23.658 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:23.700 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:23.695+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:23.730 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:23.748 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:23.765 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:23.785 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:23.800 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:23.799+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:23.801 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:23.801 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:23.820 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:23.820 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:23.820 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T05:57:23.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-10T05:57:23.823 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:23.823 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:23.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:23.838 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:23.839 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:23.856 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:23.856 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:23.920 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:23.919+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:23.957 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:23.957 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:23.957 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:23.957 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:23.957 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:23.971 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:24.001 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:23.999+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:24.096 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:24.096 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:24.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:24.096 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:24.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.096 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 113.503827659, 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.097 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:57:24.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:57:24.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1667 3.3f e66/24 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:24.104 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.527716357000003, 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020534329, 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565034+0000", 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4400000000000001e-07 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569603+0000", 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045689320000000004 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569639+0000", 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569658+0000", 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9582999999999999e-05 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569788+0000", 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129395 2024-09-10T05:57:24.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569843+0000", 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4701999999999999e-05 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585439+0000", 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015596765 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585568+0000", 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128288 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2687 3.10 3:0bdf9def:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.600935309, 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015293677, 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.109 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2687 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491814+0000", 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.491818+0000", 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495801+0000", 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039831700000000003 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495836+0000", 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4986e-05 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.495853+0000", 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7082999999999999e-05 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496003+0000", 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149946 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496248+0000", 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024488999999999999 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.496481+0000", 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023332299999999999 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.503197+0000", 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006716039 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.506985+0000", 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037875700000000001 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507052+0000", 2024-09-10T05:57:24.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7014000000000006e-05 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.507108+0000", 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6378999999999997e-05 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2690 3.20 3:0621a9df:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:24.115 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.560836954999999, 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013809238, 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2690 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531913+0000", 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.531915+0000", 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6529999999999998e-06 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535839+0000", 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003923569 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535872+0000", 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2892000000000003e-05 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535889+0000", 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946e-05 2024-09-10T05:57:24.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.535955+0000", 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6314000000000002e-05 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536068+0000", 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011280100000000001 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.536160+0000", 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1886999999999996e-05 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.542293+0000", 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061327559999999996 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545600+0000", 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033079699999999999 2024-09-10T05:57:24.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545663+0000", 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2299999999999996e-05 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.545722+0000", 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9150000000000001e-05 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2697 3.a 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.478081630999998, 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021976678999999999, 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.122 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2697 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614672+0000", 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9570000000000004e-06 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618642+0000", 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003970215 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618682+0000", 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0241999999999999e-05 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618702+0000", 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9259e-05 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618865+0000", 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162893 2024-09-10T05:57:24.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619114+0000", 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024920299999999998 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619366+0000", 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025260899999999999 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.633958+0000", 2024-09-10T05:57:24.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014591695 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636314+0000", 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023562790000000002 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636498+0000", 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018343799999999999 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636645+0000", 2024-09-10T05:57:24.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014688900000000001 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2702 3.33 e73/57 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head v 73'6, mlcod=72'4)", 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.427017986999999, 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011423348, 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.128 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665732+0000", 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.665735+0000", 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0730000000000001e-06 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670171+0000", 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044365059999999998 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670193+0000", 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2195999999999999e-05 2024-09-10T05:57:24.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670205+0000", 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1248e-05 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670278+0000", 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3145000000000005e-05 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.670297+0000", 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9145000000000001e-05 2024-09-10T05:57:24.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677061+0000", 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067644940000000002 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.677155+0000", 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3541000000000004e-05 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.132 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2709 3.36 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.357632686999999, 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021772117000000001, 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.133 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2709 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:24.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735123+0000", 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739149+0000", 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040258899999999999 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739195+0000", 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6238e-05 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739226+0000", 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0756000000000002e-05 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739431+0000", 2024-09-10T05:57:24.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020536799999999999 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739867+0000", 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043582799999999997 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740323+0000", 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045658999999999999 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750593+0000", 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010269215999999999 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756560+0000", 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059669450000000004 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756768+0000", 2024-09-10T05:57:24.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020802799999999999 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756889+0000", 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012152200000000001 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2710 3.1e e73/57 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head v 73'2, mlcod=0'0)", 2024-09-10T05:57:24.139 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.341897485000001, 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016219428000000001, 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750852+0000", 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750855+0000", 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755688+0000", 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048322399999999998 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755736+0000", 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8925999999999999e-05 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755761+0000", 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4598999999999999e-05 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755935+0000", 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017345500000000001 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.755979+0000", 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4385000000000003e-05 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.766931+0000", 2024-09-10T05:57:24.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010952051000000001 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.767072+0000", 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014061600000000001 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2712 3.1e e73/57 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:24.144 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.320106058, 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015148445, 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772644+0000", 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.772653+0000", 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.02e-06 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778513+0000", 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058600609999999997 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778542+0000", 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9411999999999999e-05 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778557+0000", 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5359999999999999e-05 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778655+0000", 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7146999999999997e-05 2024-09-10T05:57:24.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.778698+0000", 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3659000000000003e-05 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787711+0000", 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090123990000000008 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.787792+0000", 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1386999999999999e-05 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2722 3.1e e73/57 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.214797484000002, 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014888180000000001, 2024-09-10T05:57:24.149 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877952+0000", 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.877955+0000", 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.27e-06 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883040+0000", 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050841430000000002 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883073+0000", 2024-09-10T05:57:24.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3506000000000001e-05 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883090+0000", 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6966e-05 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883250+0000", 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015971599999999999 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883296+0000", 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5785000000000003e-05 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892725+0000", 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094290840000000008 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.892840+0000", 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011571 2024-09-10T05:57:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2728 3.34 e74/24 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head v 74'3, mlcod=72'1)", 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.143456293, 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020234839000000001, 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949293+0000", 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.949294+0000", 2024-09-10T05:57:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3600000000000002e-07 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952508+0000", 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032136700000000001 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952549+0000", 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1118000000000002e-05 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952573+0000", 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4017000000000001e-05 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952750+0000", 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017677799999999999 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.952815+0000", 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4788000000000004e-05 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969436+0000", 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016621585000000001 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969528+0000", 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1947000000000006e-05 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2739 3.a 3:50ecfca4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.048356210000001, 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018342160999999999, 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2739 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044393+0000", 2024-09-10T05:57:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.044398+0000", 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0570000000000003e-06 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048829+0000", 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044313640000000001 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048880+0000", 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0667000000000001e-05 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.048905+0000", 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5636e-05 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049094+0000", 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189106 2024-09-10T05:57:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049502+0000", 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040768500000000002 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.049904+0000", 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040155200000000001 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.058896+0000", 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089927700000000006 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062570+0000", 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003673272 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062659+0000", 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9221000000000005e-05 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.062736+0000", 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6830999999999997e-05 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2741 3.26 3:6709f12d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.029097381, 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017830538999999999, 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2741 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063652+0000", 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.063654+0000", 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.187e-06 2024-09-10T05:57:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067623+0000", 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039688650000000002 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067651+0000", 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7637e-05 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067664+0000", 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3497e-05 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.067771+0000", 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106457 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068031+0000", 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026004000000000001 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.068262+0000", 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230829 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.080068+0000", 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011806291 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081260+0000", 2024-09-10T05:57:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001191819 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081407+0000", 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014721299999999999 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.081483+0000", 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5704000000000006e-05 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2743 3.34 e74/24 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.000721126999998, 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013595565, 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092029+0000", 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.092032+0000", 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0910000000000001e-06 2024-09-10T05:57:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094626+0000", 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025944179999999998 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094669+0000", 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2982000000000003e-05 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094698+0000", 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8951000000000001e-05 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094824+0000", 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012603000000000001 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.094862+0000", 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7524999999999997e-05 2024-09-10T05:57:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105528+0000", 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010666556000000001 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105624+0000", 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6012000000000002e-05 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2757 3.2e e74/24 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.867029101, 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018393152999999999, 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.225721+0000", 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3e-07 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231370+0000", 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056484719999999999 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231401+0000", 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1139000000000001e-05 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231417+0000", 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-10T05:57:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231573+0000", 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015524399999999999 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.231613+0000", 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0725000000000001e-05 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.243986+0000", 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012372342 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.244114+0000", 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128016 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2766 3.a 3:53b220aa:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.777710888000001, 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02050532, 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2766 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315039+0000", 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.315042+0000", 2024-09-10T05:57:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320520+0000", 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054777819999999996 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320561+0000", 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1309e-05 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320580+0000", 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9225999999999999e-05 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320754+0000", 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017325500000000001 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321183+0000", 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042883500000000002 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.321607+0000", 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042457500000000001 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333931+0000", 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012323831 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335304+0000", 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001373211 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335422+0000", 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011828999999999999 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.335544+0000", 2024-09-10T05:57:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121623 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2770 3.a 3:5300e91c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.728858564999999, 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019665727000000001, 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2770 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363891+0000", 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.363896+0000", 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8389999999999997e-06 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368218+0000", 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043216349999999999 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368257+0000", 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9641999999999998e-05 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368276+0000", 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.914e-05 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368444+0000", 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016791199999999999 2024-09-10T05:57:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368700+0000", 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025589900000000002 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.368939+0000", 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023926700000000001 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.382054+0000", 2024-09-10T05:57:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013114139 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383331+0000", 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012779040000000001 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383434+0000", 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010233700000000001 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.383557+0000", 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123013 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2773 3.3f e74/24 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head v 74'4, mlcod=71'2)", 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.692256029999999, 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011963965, 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400494+0000", 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400496+0000", 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8200000000000001e-06 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404258+0000", 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003761707 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404300+0000", 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1742000000000001e-05 2024-09-10T05:57:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404318+0000", 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7989999999999999e-05 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404480+0000", 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162378 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.404551+0000", 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0462000000000004e-05 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412290+0000", 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077389110000000002 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412458+0000", 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016795499999999999 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2774 3.1e e74/57 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.687061654000001, 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016469788999999999, 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405688+0000", 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.405690+0000", 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3539999999999998e-06 2024-09-10T05:57:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412675+0000", 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069848089999999998 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412710+0000", 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5015999999999998e-05 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412735+0000", 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5272000000000001e-05 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412912+0000", 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017682599999999999 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412970+0000", 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8017999999999999e-05 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422024+0000", 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090533639999999995 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.422158+0000", 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013412999999999999 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2779 3.36 3:6deaa553:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.633263500999998, 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014954103, 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2779 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459486+0000", 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.459490+0000", 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7620000000000001e-06 2024-09-10T05:57:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463585+0000", 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040951779999999997 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463622+0000", 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6748000000000001e-05 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463641+0000", 2024-09-10T05:57:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8685000000000002e-05 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463728+0000", 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7354000000000004e-05 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463858+0000", 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130464 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:24.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.463967+0000", 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108853 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.473175+0000", 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092074819999999995 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474264+0000", 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001089759 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474369+0000", 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104374 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.474440+0000", 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1444000000000002e-05 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.210 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.210 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:24.211 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:24.212 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:24.207+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:24.312 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:24.311+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:24.338 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:24.338 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:24.338 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:24.338 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:24.352 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:24.413 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:24.411+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:24.470 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:24.470 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:24.471 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:24.484 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:24.531 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:24.528+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:24.608 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:24.608 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:24.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:24.608 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:24.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.608 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 137.621819117, 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:57:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:57:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:57:24.616 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 135.666274582, 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:57:24.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:57:24.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.622 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.046662951999998, 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.623 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:57:24.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:57:24.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.150050694000001, 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.629 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:24.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:57:24.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1950 3.11 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.182401341999999, 2024-09-10T05:57:24.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020018444999999999, 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1950 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:24.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422209+0000", 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.419e-06 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426537+0000", 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043276149999999999 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426567+0000", 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0301999999999999e-05 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426580+0000", 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2917e-05 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426672+0000", 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2218000000000004e-05 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426843+0000", 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017047699999999999 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427340+0000", 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049682899999999996 2024-09-10T05:57:24.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442068+0000", 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01472853 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442088+0000", 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442160+0000", 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2138000000000006e-05 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442225+0000", 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5186999999999998e-05 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2698 3.d 3:b2e26eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:24.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.980997907999999, 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019089317000000001, 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2698 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623614+0000", 2024-09-10T05:57:24.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.614e-06 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628427+0000", 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048128399999999997 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628456+0000", 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9379000000000001e-05 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628473+0000", 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436e-05 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628541+0000", 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8375999999999997e-05 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628668+0000", 2024-09-10T05:57:24.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012706699999999999 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628770+0000", 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102012 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636407+0000", 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076366639999999996 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642629+0000", 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062227059999999997 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642670+0000", 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0228999999999997e-05 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642700+0000", 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9994000000000001e-05 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2715 3.3b 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.805000841999998, 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024491215, 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.648 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2715 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799611+0000", 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4740000000000001e-06 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803674+0000", 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040627750000000002 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803699+0000", 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4998999999999999e-05 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803716+0000", 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.713e-05 2024-09-10T05:57:24.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803861+0000", 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804271+0000", 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000410782 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:24.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804670+0000", 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039885499999999999 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823762+0000", 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01909168 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823814+0000", 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2293000000000002e-05 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823978+0000", 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016379799999999999 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.824099+0000", 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120677 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2716 3.3b 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.795045166000001, 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021381936000000001, 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2716 2024-09-10T05:57:24.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809566+0000", 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4700000000000001e-06 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814350+0000", 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047846349999999998 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814391+0000", 2024-09-10T05:57:24.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0881999999999999e-05 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814417+0000", 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.816891+0000", 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024744400000000001 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817142+0000", 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025102600000000001 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817376+0000", 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234267 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.826993+0000", 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096162609999999992 2024-09-10T05:57:24.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830661+0000", 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036685229999999999 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830823+0000", 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016209899999999999 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830945+0000", 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012169 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2736 3.15 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.589728435000001, 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021012902999999999, 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.661 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2736 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014883+0000", 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019463+0000", 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045800299999999997 2024-09-10T05:57:24.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019510+0000", 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7361999999999998e-05 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019530+0000", 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.997e-05 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019681+0000", 2024-09-10T05:57:24.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015094500000000001 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019911+0000", 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022981400000000001 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020130+0000", 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021882 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.032856+0000", 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012725670999999999 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035613+0000", 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027571359999999999 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035768+0000", 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015560199999999999 2024-09-10T05:57:24.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035893+0000", 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012442599999999999 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2735 3.2a e74/24 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head v 74'7, mlcod=73'5)", 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.588796561999999, 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018481485999999998, 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015813+0000", 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1699999999999997e-07 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020431+0000", 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046181900000000003 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020481+0000", 2024-09-10T05:57:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0204999999999998e-05 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020504+0000", 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3193e-05 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020625+0000", 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012044600000000001 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020660+0000", 2024-09-10T05:57:24.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034217+0000", 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013556558 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034293+0000", 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6211000000000006e-05 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.580341806, 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:57:24.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:57:24.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:57:24.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2738 3.39 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.567837593, 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439545999999999, 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.678 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2738 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036773+0000", 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5000000000000002e-06 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042338+0000", 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055647520000000001 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042369+0000", 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1009000000000001e-05 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042388+0000", 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8612999999999999e-05 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042526+0000", 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138806 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042842+0000", 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000315295 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.043126+0000", 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028447800000000001 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.052457+0000", 2024-09-10T05:57:24.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093312510000000005 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.056914+0000", 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044569600000000003 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057087+0000", 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017276499999999999 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057210+0000", 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012311700000000001 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2754 3.2a e74/24 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head v 74'9, mlcod=74'7)", 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.403009517000001, 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020956794000000001, 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.684 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201602+0000", 2024-09-10T05:57:24.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1130000000000001e-06 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204828+0000", 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032265219999999999 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204882+0000", 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3205000000000003e-05 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204909+0000", 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7138999999999999e-05 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205102+0000", 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019347099999999999 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205161+0000", 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8291999999999997e-05 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222429+0000", 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017268480999999999 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222556+0000", 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012657099999999999 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:24.688 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.399863209999999, 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:57:24.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:57:24.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2760 3.37 3:ee0dd768:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:24.694 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.351168722000001, 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021061340000000001, 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2760 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:24.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253444+0000", 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6229999999999996e-06 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258934+0000", 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005489524 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258985+0000", 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0986000000000003e-05 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259001+0000", 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-10T05:57:24.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259120+0000", 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118564 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259374+0000", 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025416600000000001 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:24.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259600+0000", 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225563 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.269405+0000", 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098055409999999992 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274344+0000", 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049393040000000003 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274432+0000", 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7616999999999998e-05 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274501+0000", 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8910000000000003e-05 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.330287209000002, 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:57:24.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:57:24.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.705 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2765 3.e 3:7051b691:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.299660105000001, 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019300435000000001, 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2765 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304951+0000", 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8169999999999999e-06 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308937+0000", 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039864169999999999 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308970+0000", 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2965e-05 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308987+0000", 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6710000000000001e-05 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309116+0000", 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012852800000000001 2024-09-10T05:57:24.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309342+0000", 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225942 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309553+0000", 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021175999999999999 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320354+0000", 2024-09-10T05:57:24.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010800535999999999 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.323937+0000", 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035836290000000001 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324118+0000", 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000180695 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324249+0000", 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130436 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2767 3.37 3:ef27b18b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.275573872999999, 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019966886, 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.712 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2767 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:24.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329038+0000", 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3299999999999999e-06 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333904+0000", 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048659869999999996 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333944+0000", 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0735000000000002e-05 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333964+0000", 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9443e-05 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334121+0000", 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015721499999999999 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334365+0000", 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024407000000000001 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334588+0000", 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022284 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.346368+0000", 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011780255 2024-09-10T05:57:24.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348673+0000", 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023048080000000002 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348858+0000", 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184904 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.349001+0000", 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143299 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2773 3.3f 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.209756618, 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018274233000000001, 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.718 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2773 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394855+0000", 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4630000000000001e-06 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399567+0000", 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047114490000000004 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399609+0000", 2024-09-10T05:57:24.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2082999999999997e-05 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399627+0000", 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8532000000000001e-05 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399768+0000", 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141216 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400014+0000", 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000245947 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400243+0000", 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022854 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.408899+0000", 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086558520000000003 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412825+0000", 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039261599999999997 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412993+0000", 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016819099999999999 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.413126+0000", 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001328 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.723 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2780 3.15 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.128103821, 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020859142000000001, 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:24.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2780 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476525+0000", 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669000000000001e-05 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480305+0000", 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037793739999999998 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480340+0000", 2024-09-10T05:57:24.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5082000000000001e-05 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480356+0000", 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5985999999999999e-05 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480444+0000", 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8898000000000002e-05 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:24.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480600+0000", 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155685 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480746+0000", 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014611 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.487929+0000", 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071829750000000003 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497194+0000", 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092649140000000008 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497294+0000", 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100134 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497364+0000", 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9314999999999996e-05 2024-09-10T05:57:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:24.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:24.730 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:24.731 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:24.728+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:24.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:24.769 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:57:24.773 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-10T05:57:24.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-10T05:57:24.832 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:24.828+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:24.854 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:24.854 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:24.854 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:24.854 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:24.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:24.932 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:24.928+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:25.022 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:25.022 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:25.022 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:25.033 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:25.032+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:25.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:25.134 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:25.128+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:25.149 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:25.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 111.530640983, 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.150 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:57:25.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:57:25.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:57:25.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1947 3.3 e66/24 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.742945325999997, 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013054759000000001, 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404196+0000", 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409810+0000", 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056139830000000003 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409851+0000", 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0615000000000003e-05 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409874+0000", 2024-09-10T05:57:25.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3476e-05 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409997+0000", 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122745 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.410025+0000", 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7559000000000002e-05 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417196+0000", 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071715090000000004 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417248+0000", 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2225999999999998e-05 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.161 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2675 3.1 3:808dd43d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.810962924999998, 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016454241000000001, 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2675 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336179+0000", 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-10T05:57:25.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337951+0000", 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017720329999999999 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337984+0000", 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3022000000000003e-05 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337999+0000", 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4942e-05 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338081+0000", 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1463000000000003e-05 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338193+0000", 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111705 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338294+0000", 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101019 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.347997+0000", 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097033069999999996 2024-09-10T05:57:25.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352514+0000", 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045167970000000003 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352577+0000", 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3260000000000001e-05 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352630+0000", 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3208999999999998e-05 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2681 3.3a e73/24 3:5e71f715:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_144:head v 73'5, mlcod=66'3)", 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.725142549000001, 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011684702999999999, 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421997+0000", 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6800000000000001e-07 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427043+0000", 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005046498 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427064+0000", 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1158999999999999e-05 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427078+0000", 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3239e-05 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427168+0000", 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0364000000000004e-05 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427198+0000", 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433637+0000", 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064382279999999998 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433681+0000", 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4484000000000003e-05 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2682 3.20 e73/24 3:072f3612:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_145:head v 73'4, mlcod=72'2)", 2024-09-10T05:57:25.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.713352910000001, 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010326201, 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433806+0000", 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0290999999999999e-05 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437646+0000", 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398439999999998 2024-09-10T05:57:25.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437669+0000", 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3298e-05 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437684+0000", 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.438e-05 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437777+0000", 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3194000000000003e-05 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437809+0000", 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2131000000000001e-05 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444041+0000", 2024-09-10T05:57:25.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062315460000000001 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444112+0000", 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1517e-05 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2686 3.3 e73/24 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head v 73'4, mlcod=71'2)", 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.662314647999999, 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010201259000000001, 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484826+0000", 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.86e-06 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488806+0000", 2024-09-10T05:57:25.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797879999999997 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488834+0000", 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8004000000000002e-05 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488848+0000", 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4344e-05 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488944+0000", 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5981000000000001e-05 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488975+0000", 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0510000000000001e-05 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.494982+0000", 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060074969999999997 2024-09-10T05:57:25.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.495025+0000", 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3275000000000002e-05 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2700 3.1b 3:db80fad5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.503863612, 2024-09-10T05:57:25.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503279, 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2700 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643278+0000", 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644670+0000", 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013922209999999999 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644698+0000", 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8152000000000001e-05 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644711+0000", 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3495999999999999e-05 2024-09-10T05:57:25.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644816+0000", 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010404 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644945+0000", 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129939 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645082+0000", 2024-09-10T05:57:25.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013664999999999999 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.649392+0000", 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043094989999999996 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656648+0000", 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072568629999999997 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656720+0000", 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1913000000000001e-05 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656779+0000", 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8158999999999997e-05 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2701 3.3d 3:bc92f7d4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.188 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.492752311, 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013087995, 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2701 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654389+0000", 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655645+0000", 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012560150000000001 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655669+0000", 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3845999999999998e-05 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655679+0000", 2024-09-10T05:57:25.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.004e-05 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655738+0000", 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8989000000000001e-05 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655897+0000", 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015926800000000001 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655995+0000", 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7600000000000001e-05 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666093+0000", 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010098452000000001 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666169+0000", 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6196e-05 2024-09-10T05:57:25.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666236+0000", 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7260000000000003e-05 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.667475+0000", 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012381289999999999 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2705 3.17 3:eba32b22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.454769650999999, 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017940067000000001, 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692372+0000", 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693889+0000", 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015172370000000001 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693920+0000", 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1291999999999998e-05 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693933+0000", 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2693e-05 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694001+0000", 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830000000000006e-05 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694130+0000", 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129114 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694285+0000", 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015531599999999999 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.698265+0000", 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797950000000004 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710231+0000", 2024-09-10T05:57:25.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011966348999999999 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710272+0000", 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1193999999999999e-05 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710309+0000", 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6888000000000003e-05 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.303890937999999, 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:57:25.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.206 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2729 3.3 e74/24 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.190820133999999, 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011635193, 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962186+0000", 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058669120000000002 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962213+0000", 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7018000000000001e-05 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962225+0000", 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1836e-05 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962541+0000", 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031584199999999999 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962569+0000", 2024-09-10T05:57:25.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8175e-05 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967897+0000", 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053282190000000004 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967954+0000", 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6950000000000002e-05 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.151721241000001, 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:57:25.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:57:25.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:57:25.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2738 3.39 e74/24 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:25.220 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.102950116999999, 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013163921, 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044191+0000", 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.396e-06 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050959+0000", 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067675360000000002 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050982+0000", 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3275999999999999e-05 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050995+0000", 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2873e-05 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051071+0000", 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5782000000000001e-05 2024-09-10T05:57:25.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051099+0000", 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7895999999999999e-05 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057285+0000", 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006186067 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057353+0000", 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8095000000000004e-05 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2742 3.1 3:81622134:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.071718650000001, 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016996092000000001, 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2742 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075424+0000", 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3380000000000001e-06 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077125+0000", 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001701504 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077157+0000", 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1665000000000003e-05 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077172+0000", 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379e-05 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077245+0000", 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2706000000000005e-05 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077418+0000", 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017356399999999999 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077574+0000", 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015575499999999999 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.082224+0000", 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046503439999999998 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092275+0000", 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010050738 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092356+0000", 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0822999999999995e-05 2024-09-10T05:57:25.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092416+0000", 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0275999999999997e-05 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2746 3.23 3:c7325450:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.031768598999999, 2024-09-10T05:57:25.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011885972999999999, 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2746 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115373+0000", 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7920000000000001e-06 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117159+0000", 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017863670000000001 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117189+0000", 2024-09-10T05:57:25.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9201e-05 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117203+0000", 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117288+0000", 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5383000000000006e-05 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117416+0000", 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012752799999999999 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117552+0000", 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013568900000000001 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.124143+0000", 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065914249999999997 2024-09-10T05:57:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127122+0000", 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029785509999999999 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127197+0000", 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5593000000000006e-05 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127256+0000", 2024-09-10T05:57:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9051000000000001e-05 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2750 3.1b 3:da716242:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.990837758000001, 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016402756000000001, 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2750 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156304+0000", 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7590000000000002e-06 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157544+0000", 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012403900000000001 2024-09-10T05:57:25.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157569+0000", 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5133000000000001e-05 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157580+0000", 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0953e-05 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157672+0000", 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1685000000000001e-05 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157859+0000", 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694499999999999 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.158038+0000", 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017913299999999999 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.163265+0000", 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052268569999999997 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172626+0000", 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093605370000000004 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172667+0000", 2024-09-10T05:57:25.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1764999999999997e-05 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172704+0000", 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6599e-05 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2771 3.23 3:c48b55d9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:25.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.774083326, 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010835595999999999, 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2771 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:25.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373059+0000", 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1650000000000002e-06 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374820+0000", 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017613310000000001 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374853+0000", 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374868+0000", 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5591999999999999e-05 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374966+0000", 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7194999999999994e-05 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375153+0000", 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018719799999999999 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375332+0000", 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017948500000000001 2024-09-10T05:57:25.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.381064+0000", 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057316939999999999 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383759+0000", 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026946779999999998 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383833+0000", 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4826999999999994e-05 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383891+0000", 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7701999999999997e-05 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2777 3.1b 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:25.250 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.708755060000001, 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019570203000000001, 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2777 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:25.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438387+0000", 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9009999999999998e-06 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439946+0000", 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00155905 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439975+0000", 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9311000000000001e-05 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439988+0000", 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3319000000000001e-05 2024-09-10T05:57:25.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440057+0000", 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8208999999999997e-05 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440175+0000", 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118261 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440286+0000", 2024-09-10T05:57:25.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111242 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.444527+0000", 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042409800000000001 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457848+0000", 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013320702 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457903+0000", 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457954+0000", 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1319000000000001e-05 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2781 3.6 3:62f67cea:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.256 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.659797122000001, 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012768417000000001, 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2781 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487346+0000", 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4279999999999998e-06 2024-09-10T05:57:25.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489317+0000", 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019705460000000001 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489360+0000", 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3350999999999999e-05 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489382+0000", 2024-09-10T05:57:25.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1744000000000001e-05 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489504+0000", 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012243599999999999 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489754+0000", 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000249425 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489995+0000", 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000241151 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.498069+0000", 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080742499999999998 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500028+0000", 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019588600000000002 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500078+0000", 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0157000000000001e-05 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500110+0000", 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2069000000000001e-05 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2785 3.12 3:49663187:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.607465692000002, 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015080374000000001, 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2785 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.263 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539676+0000", 2024-09-10T05:57:25.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542236+0000", 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025599830000000001 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542273+0000", 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7063000000000001e-05 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542288+0000", 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.518e-05 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542365+0000", 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7292999999999993e-05 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542494+0000", 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012883099999999999 2024-09-10T05:57:25.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542615+0000", 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012126899999999999 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.546794+0000", 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041788149999999998 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554636+0000", 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078412470000000008 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554707+0000", 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1899999999999999e-05 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554754+0000", 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6103999999999998e-05 2024-09-10T05:57:25.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.269 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:25.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:25.271 INFO:tasks.workunit.client.0.smithi070.stdout:quota enabled for the bucket: buck_2024_08_10_05_57_20 2024-09-10T05:57:25.271 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 2Gb. 2024-09-10T05:57:25.271 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:57:25.271 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-09-10T05:57:25.271 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:57:25.271 INFO:tasks.workunit.client.0.smithi070.stdout:delete objects successful 2024-09-10T05:57:25.272 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:25.267+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:25.371 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:25.371+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:25.425 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:25.425 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:25.425 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:25.426 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:25.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:25.488 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:25.487+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:25.573 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:25.572+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:25.611 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:25.611 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:25.611 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:25.611 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:25.611 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:25.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:25.673 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:25.668+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:25.744 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 119.18572983200001, 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:57:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:57:25.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1948 3.19 3:9ae3dc4d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:25.750 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.332287684999997, 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010681995999999999, 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1948 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409648+0000", 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.411e-06 2024-09-10T05:57:25.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411596+0000", 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019481749999999999 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411627+0000", 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1130000000000002e-05 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411642+0000", 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5102e-05 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411726+0000", 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4006999999999997e-05 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411888+0000", 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016162500000000001 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412039+0000", 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151848 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417810+0000", 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057708580000000002 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420232+0000", 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024214610000000002 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420290+0000", 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8136e-05 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420326+0000", 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6242999999999998e-05 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2688 3.19 3:9a5c5cc5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.237039815999999, 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099290669999999998, 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2688 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504896+0000", 2024-09-10T05:57:25.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8249999999999998e-06 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506826+0000", 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019305049999999999 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506850+0000", 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3751999999999999e-05 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506863+0000", 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2989999999999999e-05 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506961+0000", 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8059000000000004e-05 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.507146+0000", 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018474400000000001 2024-09-10T05:57:25.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.507311+0000", 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164697 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.513952+0000", 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066411070000000003 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514712+0000", 2024-09-10T05:57:25.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076031000000000004 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514774+0000", 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1544000000000006e-05 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514821+0000", 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7534000000000003e-05 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2689 3.19 3:99575c67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.221213177999999, 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01027197, 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2689 2024-09-10T05:57:25.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520722+0000", 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3739999999999998e-06 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522419+0000", 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016969960000000001 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522441+0000", 2024-09-10T05:57:25.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1698000000000001e-05 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522455+0000", 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3828e-05 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522549+0000", 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4091000000000004e-05 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522727+0000", 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000178204 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522887+0000", 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015975200000000001 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530377+0000", 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007490493 2024-09-10T05:57:25.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530872+0000", 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049481000000000004 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530938+0000", 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6459999999999997e-05 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530991+0000", 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2264e-05 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2693 3.25 3:a7e22d13:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.568200+0000", 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.173731704000001, 2024-09-10T05:57:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098861509999999993, 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2693 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.568200+0000", 2024-09-10T05:57:25.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.568200+0000", 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.568203+0000", 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1379999999999999e-06 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569872+0000", 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016686629999999999 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569885+0000", 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.346e-05 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569897+0000", 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1653e-05 2024-09-10T05:57:25.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569988+0000", 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1402000000000003e-05 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.570154+0000", 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165728 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.570279+0000", 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124385 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.577724+0000", 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074459390000000004 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.577977+0000", 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025251800000000002 2024-09-10T05:57:25.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.578037+0000", 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.578086+0000", 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9073000000000003e-05 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2695 3.4 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.149905047000001, 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013307572, 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592030+0000", 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8650000000000001e-06 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594049+0000", 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002019449 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594078+0000", 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9376000000000001e-05 2024-09-10T05:57:25.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594092+0000", 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3505e-05 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594168+0000", 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6063999999999995e-05 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594293+0000", 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012461899999999999 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594406+0000", 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112983 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605086+0000", 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010680383999999999 2024-09-10T05:57:25.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605259+0000", 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172659 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605303+0000", 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4651000000000003e-05 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605334+0000", 2024-09-10T05:57:25.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1016999999999998e-05 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2699 3.25 3:a7585b47:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.108232033, 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011556090999999999, 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2699 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633701+0000", 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.55e-06 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635063+0000", 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001361473 2024-09-10T05:57:25.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635086+0000", 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3175000000000001e-05 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635099+0000", 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.274e-05 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635179+0000", 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0327999999999994e-05 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635295+0000", 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011636 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635412+0000", 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116941 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.640453+0000", 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050403840000000002 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645131+0000", 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046778169999999999 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645201+0000", 2024-09-10T05:57:25.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0526999999999997e-05 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645256+0000", 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4796000000000002e-05 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2717 3.25 3:a515f872:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:25.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.921960603999999, 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011604369, 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2717 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819975+0000", 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821866+0000", 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00189079 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821899+0000", 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809000000000001e-05 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821914+0000", 2024-09-10T05:57:25.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5e-05 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822002+0000", 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7892999999999993e-05 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822154+0000", 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015216200000000001 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822295+0000", 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014084899999999999 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830948+0000", 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086527919999999994 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831454+0000", 2024-09-10T05:57:25.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050560199999999996 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831520+0000", 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6017000000000002e-05 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831576+0000", 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5825000000000002e-05 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2726 3.3e 3:7ca2d2f7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.825538054999999, 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010261348, 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2726 2024-09-10T05:57:25.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916397+0000", 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0240000000000002e-06 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917892+0000", 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014948850000000001 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917917+0000", 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5622999999999998e-05 2024-09-10T05:57:25.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917930+0000", 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2567e-05 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918060+0000", 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130588 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918224+0000", 2024-09-10T05:57:25.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163585 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918309+0000", 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4944999999999994e-05 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.925501+0000", 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071920430000000004 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926533+0000", 2024-09-10T05:57:25.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010318090000000001 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926601+0000", 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8473000000000007e-05 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926655+0000", 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.800 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2730 3.19 3:99f0627c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.786565210999999, 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012565949999999999, 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2730 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955370+0000", 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3620000000000002e-06 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957409+0000", 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020391720000000001 2024-09-10T05:57:25.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957452+0000", 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2895000000000002e-05 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957466+0000", 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4311000000000001e-05 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957588+0000", 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121663 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957792+0000", 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203792 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957975+0000", 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183678 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965498+0000", 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075228700000000001 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967831+0000", 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023322590000000002 2024-09-10T05:57:25.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967882+0000", 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1598000000000003e-05 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967933+0000", 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0349999999999997e-05 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2731 3.4 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.776780358, 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013157917999999999, 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.808 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2731 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:25.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965155+0000", 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5889999999999999e-06 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966586+0000", 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001430618 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966603+0000", 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7059999999999999e-05 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966614+0000", 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1141999999999999e-05 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966689+0000", 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5574000000000005e-05 2024-09-10T05:57:25.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966819+0000", 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129558 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966944+0000", 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012527799999999999 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975490+0000", 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085459999999999998 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978216+0000", 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027259879999999999 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978268+0000", 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1493000000000003e-05 2024-09-10T05:57:25.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978309+0000", 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1618e-05 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2733 3.0 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.755509831000001, 2024-09-10T05:57:25.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012015477, 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2733 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:25.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986425+0000", 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988599+0000", 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021740489999999999 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988621+0000", 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1922000000000001e-05 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988633+0000", 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1758e-05 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988727+0000", 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3867000000000001e-05 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988922+0000", 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019508500000000001 2024-09-10T05:57:25.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989099+0000", 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017668299999999999 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.996748+0000", 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007649159 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998318+0000", 2024-09-10T05:57:25.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015705090000000001 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998382+0000", 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4036999999999997e-05 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998437+0000", 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207000000000002e-05 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2740 3.4 3:23fd3bef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.687293158999999, 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011027009000000001, 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2740 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054641+0000", 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.813e-06 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056322+0000", 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016803530000000001 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056368+0000", 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6044999999999997e-05 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056388+0000", 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0418999999999999e-05 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056451+0000", 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2236000000000005e-05 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056584+0000", 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133771 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056711+0000", 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127009 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.062350+0000", 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056391669999999996 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065551+0000", 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003200179 2024-09-10T05:57:25.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065617+0000", 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6821000000000003e-05 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065666+0000", 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8195999999999997e-05 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2756 3.1a e74/24 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:25.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.521539268000001, 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012940208, 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226300+0000", 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059069400000000003 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226316+0000", 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6509000000000001e-05 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226325+0000", 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7439999999999996e-06 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226425+0000", 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100188 2024-09-10T05:57:25.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226452+0000", 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7140000000000001e-05 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233268+0000", 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068155660000000003 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233333+0000", 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4789000000000006e-05 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2768 3.4 3:206588f5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.401390207999999, 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011512440000000001, 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.831 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2768 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340545+0000", 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3359999999999999e-06 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342133+0000", 2024-09-10T05:57:25.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001587771 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342159+0000", 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6554e-05 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342171+0000", 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1956999999999999e-05 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342248+0000", 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6791000000000004e-05 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342372+0000", 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425500000000001 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342470+0000", 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7721999999999997e-05 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351396+0000", 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089259419999999992 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351961+0000", 2024-09-10T05:57:25.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056521100000000003 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.352021+0000", 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0003999999999997e-05 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.352054+0000", 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2897e-05 2024-09-10T05:57:25.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2772 3.0 3:02cde5ff:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.358281232, 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010850436, 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2772 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:25.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383654+0000", 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.67e-06 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385466+0000", 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001811549 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385495+0000", 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9488999999999998e-05 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385510+0000", 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5116000000000001e-05 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385617+0000", 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010702299999999999 2024-09-10T05:57:25.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385796+0000", 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017860700000000001 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385950+0000", 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015417600000000001 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.391450+0000", 2024-09-10T05:57:25.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054996660000000003 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394434+0000", 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029838529999999999 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394471+0000", 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6976e-05 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394501+0000", 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0311000000000002e-05 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2776 3.31 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.313499152999999, 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019117624, 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2776 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428435+0000", 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6019999999999998e-06 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429944+0000", 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001509095 2024-09-10T05:57:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429973+0000", 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8558e-05 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429986+0000", 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3591000000000001e-05 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430053+0000", 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430167+0000", 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114243 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430257+0000", 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9386000000000001e-05 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.434734+0000", 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044769909999999996 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447370+0000", 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012636214 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447476+0000", 2024-09-10T05:57:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105844 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447550+0000", 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4622000000000005e-05 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2782 3.25 3:a5d3e292:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.239486261, 2024-09-10T05:57:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012424736, 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2782 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502448+0000", 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505248+0000", 2024-09-10T05:57:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027999470000000001 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505285+0000", 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.68e-05 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505304+0000", 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9423999999999999e-05 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505417+0000", 2024-09-10T05:57:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011298000000000001 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505608+0000", 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019085900000000001 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505785+0000", 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176832 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.511556+0000", 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057704219999999999 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514735+0000", 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031793749999999999 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514811+0000", 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6129000000000002e-05 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514870+0000", 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9250999999999999e-05 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2783 3.3e 3:7c6034eb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.228404649000002, 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503764, 2024-09-10T05:57:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2783 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513531+0000", 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1520000000000002e-06 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516867+0000", 2024-09-10T05:57:25.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033353800000000002 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516900+0000", 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3414999999999998e-05 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516917+0000", 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867999999999998e-05 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516998+0000", 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0851000000000002e-05 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517142+0000", 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144671 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517248+0000", 2024-09-10T05:57:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105319 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526098+0000", 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088501629999999994 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526838+0000", 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074033699999999998 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526948+0000", 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109647 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.527031+0000", 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2960999999999994e-05 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2786 3.19 3:994682bc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.555389+0000", 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.186542805999999, 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009839403, 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2786 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.555389+0000", 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.555389+0000", 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.555392+0000", 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6419999999999999e-06 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557092+0000", 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00170067 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557114+0000", 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2198e-05 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557125+0000", 2024-09-10T05:57:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0287e-05 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557220+0000", 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4973e-05 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557407+0000", 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018676200000000001 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557582+0000", 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017572700000000001 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.564612+0000", 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070294850000000002 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.565112+0000", 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050007199999999995 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.565178+0000", 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6507999999999994e-05 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.565228+0000", 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0078999999999999e-05 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:25.869 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:25.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-10T05:57:25.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-10T05:57:25.873 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:25.867+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:25.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:25.971 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:25.971+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:26.042 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:26.042 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:26.042 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:26.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:26.058 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:26.059 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:26.073 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:26.072+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:26.076 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:26.077 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:26.093 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:26.093 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:26.110 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:26.110 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:26.131 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:26.131 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:26.151 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:26.151 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:26.168 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:26.168 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:26.172 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:26.172 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:26.173 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:26.171+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:26.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:26.192 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:26.193 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:26.274 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:26.268+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:26.298 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:26.298 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:26.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:26.376 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:26.372+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:26.422 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:26.422 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:26.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:26.484 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:26.483+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:26.549 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:26.550 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:26.562 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:26.578 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:26.572+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:26.679 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:26.675+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:26.720 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:26.721 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:26.733 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:26.779 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:26.775+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:26.780 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-10T05:57:26.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:57:26.801 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-10T05:57:26.862 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:26.863 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:26.876 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:26.923 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:26.920+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:26.981 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:26.979+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:27.001 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:27.001 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:27.017 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:27.082 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:27.079+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:27.178 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:27.178 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:27.183 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:27.179+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:27.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:27.284 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:27.280+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:27.314 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:27.314 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:27.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:27.415 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:27.412+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:27.485 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:27.483+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:27.488 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:27.488 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:27.504 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:27.591 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:27.588+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:27.672 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:27.672 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:27.686 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:27.686 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:27.683+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:27.787 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:27.783+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:57:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-10T05:57:27.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-10T05:57:27.847 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:27.847 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:27.861 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:27.908 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:27.907+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:27.977 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:27.977 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:27.989 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:27.987+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:27.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:28.090 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:28.084+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:28.120 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:28.121 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:28.135 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:28.191 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:28.187+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:28.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:28.293 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:28.288+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:28.304 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:28.304 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:28.318 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:28.355 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:28.355 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:28.372 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:28.388 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:28.388 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:28.407 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:28.404+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:28.407 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:28.408 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:28.425 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:28.426 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:28.444 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:28.444 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:28.465 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:28.465 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:28.485 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:28.485 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:28.488 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:28.488 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:28.488 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:28.488 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:28.488 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:28.497 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:28.495+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:28.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:28.598 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:28.592+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:28.674 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 141.68762539599999, 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:57:28.675 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.676 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.676 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.676 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.676 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:28.676 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:28.676 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:57:28.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.677 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:28.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:57:28.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:57:28.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:57:28.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:57:28.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.684 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 139.73208086099999, 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:57:28.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:57:28.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:57:28.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.112469230999999, 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:57:28.691 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:57:28.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:57:28.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:57:28.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.698 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.215856973000001, 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:57:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:57:28.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1950 3.11 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:28.706 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.248207620999999, 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020018444999999999, 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1950 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.707 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422209+0000", 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.419e-06 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426537+0000", 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043276149999999999 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426567+0000", 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0301999999999999e-05 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426580+0000", 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2917e-05 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426672+0000", 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2218000000000004e-05 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426843+0000", 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017047699999999999 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427340+0000", 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049682899999999996 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442068+0000", 2024-09-10T05:57:28.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01472853 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442088+0000", 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442160+0000", 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2138000000000006e-05 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442225+0000", 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5186999999999998e-05 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2698 3.d 3:b2e26eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.046804186999999, 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019089317000000001, 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.713 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2698 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623614+0000", 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.614e-06 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628427+0000", 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048128399999999997 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628456+0000", 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9379000000000001e-05 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628473+0000", 2024-09-10T05:57:28.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436e-05 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628541+0000", 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8375999999999997e-05 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628668+0000", 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012706699999999999 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:28.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628770+0000", 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102012 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636407+0000", 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076366639999999996 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642629+0000", 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062227059999999997 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642670+0000", 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0228999999999997e-05 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642700+0000", 2024-09-10T05:57:28.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9994000000000001e-05 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2715 3.3b 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.870807120999999, 2024-09-10T05:57:28.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024491215, 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2715 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799611+0000", 2024-09-10T05:57:28.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4740000000000001e-06 2024-09-10T05:57:28.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803674+0000", 2024-09-10T05:57:28.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040627750000000002 2024-09-10T05:57:28.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803699+0000", 2024-09-10T05:57:28.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4998999999999999e-05 2024-09-10T05:57:28.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803716+0000", 2024-09-10T05:57:28.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.713e-05 2024-09-10T05:57:28.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803861+0000", 2024-09-10T05:57:28.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:28.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804271+0000", 2024-09-10T05:57:28.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000410782 2024-09-10T05:57:28.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:28.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804670+0000", 2024-09-10T05:57:28.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039885499999999999 2024-09-10T05:57:28.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823762+0000", 2024-09-10T05:57:28.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01909168 2024-09-10T05:57:28.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823814+0000", 2024-09-10T05:57:28.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2293000000000002e-05 2024-09-10T05:57:28.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823978+0000", 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016379799999999999 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.824099+0000", 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120677 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2716 3.3b 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.860851445000002, 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021381936000000001, 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2716 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:28.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809566+0000", 2024-09-10T05:57:28.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4700000000000001e-06 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814350+0000", 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047846349999999998 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814391+0000", 2024-09-10T05:57:28.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0881999999999999e-05 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814417+0000", 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.816891+0000", 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024744400000000001 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817142+0000", 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025102600000000001 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817376+0000", 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234267 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.826993+0000", 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096162609999999992 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830661+0000", 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036685229999999999 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830823+0000", 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016209899999999999 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830945+0000", 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012169 2024-09-10T05:57:28.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2736 3.15 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.655534714000002, 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021012902999999999, 2024-09-10T05:57:28.740 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2736 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014883+0000", 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019463+0000", 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045800299999999997 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019510+0000", 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7361999999999998e-05 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019530+0000", 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.997e-05 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019681+0000", 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015094500000000001 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019911+0000", 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022981400000000001 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020130+0000", 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021882 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.032856+0000", 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012725670999999999 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035613+0000", 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027571359999999999 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035768+0000", 2024-09-10T05:57:28.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015560199999999999 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035893+0000", 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012442599999999999 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2735 3.2a e74/24 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head v 74'7, mlcod=73'5)", 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.654602840999999, 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018481485999999998, 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015813+0000", 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1699999999999997e-07 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020431+0000", 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046181900000000003 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020481+0000", 2024-09-10T05:57:28.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0204999999999998e-05 2024-09-10T05:57:28.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020504+0000", 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3193e-05 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020625+0000", 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012044600000000001 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020660+0000", 2024-09-10T05:57:28.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:57:28.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034217+0000", 2024-09-10T05:57:28.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013556558 2024-09-10T05:57:28.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034293+0000", 2024-09-10T05:57:28.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6211000000000006e-05 2024-09-10T05:57:28.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.646148085, 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.755 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:57:28.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:57:28.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:57:28.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:57:28.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2738 3.39 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.633643872, 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439545999999999, 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.763 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2738 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036773+0000", 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5000000000000002e-06 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042338+0000", 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055647520000000001 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042369+0000", 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1009000000000001e-05 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042388+0000", 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8612999999999999e-05 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042526+0000", 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138806 2024-09-10T05:57:28.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042842+0000", 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000315295 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.043126+0000", 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028447800000000001 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.052457+0000", 2024-09-10T05:57:28.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093312510000000005 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.056914+0000", 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044569600000000003 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057087+0000", 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017276499999999999 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057210+0000", 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012311700000000001 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2754 3.2a e74/24 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head v 74'9, mlcod=74'7)", 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.468815796000001, 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020956794000000001, 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.769 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201602+0000", 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1130000000000001e-06 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204828+0000", 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032265219999999999 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204882+0000", 2024-09-10T05:57:28.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3205000000000003e-05 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204909+0000", 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7138999999999999e-05 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205102+0000", 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019347099999999999 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205161+0000", 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8291999999999997e-05 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222429+0000", 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017268480999999999 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222556+0000", 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012657099999999999 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.465669489, 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:57:28.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:57:28.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:57:28.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:57:28.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2760 3.37 3:ee0dd768:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.781 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.416975001000001, 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021061340000000001, 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.782 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2760 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253444+0000", 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6229999999999996e-06 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258934+0000", 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005489524 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258985+0000", 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0986000000000003e-05 2024-09-10T05:57:28.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259001+0000", 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259120+0000", 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118564 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259374+0000", 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025416600000000001 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259600+0000", 2024-09-10T05:57:28.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225563 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.269405+0000", 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098055409999999992 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274344+0000", 2024-09-10T05:57:28.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049393040000000003 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274432+0000", 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7616999999999998e-05 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274501+0000", 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8910000000000003e-05 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:28.790 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.396093487999998, 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:28.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:57:28.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2765 3.e 3:7051b691:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.795 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.365466384000001, 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019300435000000001, 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2765 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:28.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304951+0000", 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8169999999999999e-06 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308937+0000", 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039864169999999999 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308970+0000", 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2965e-05 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308987+0000", 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6710000000000001e-05 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309116+0000", 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012852800000000001 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309342+0000", 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225942 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309553+0000", 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021175999999999999 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320354+0000", 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010800535999999999 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.323937+0000", 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035836290000000001 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324118+0000", 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000180695 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324249+0000", 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130436 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.801 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2767 3.37 3:ef27b18b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.341380151999999, 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019966886, 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2767 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329038+0000", 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3299999999999999e-06 2024-09-10T05:57:28.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333904+0000", 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048659869999999996 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333944+0000", 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0735000000000002e-05 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333964+0000", 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9443e-05 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334121+0000", 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015721499999999999 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334365+0000", 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024407000000000001 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334588+0000", 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022284 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.346368+0000", 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011780255 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348673+0000", 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023048080000000002 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348858+0000", 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184904 2024-09-10T05:57:28.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.349001+0000", 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143299 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2773 3.3f 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.275562897, 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018274233000000001, 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2773 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:28.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394855+0000", 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4630000000000001e-06 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399567+0000", 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047114490000000004 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399609+0000", 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2082999999999997e-05 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399627+0000", 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8532000000000001e-05 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399768+0000", 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141216 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400014+0000", 2024-09-10T05:57:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000245947 2024-09-10T05:57:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400243+0000", 2024-09-10T05:57:28.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022854 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.408899+0000", 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086558520000000003 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412825+0000", 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039261599999999997 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412993+0000", 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016819099999999999 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.413126+0000", 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001328 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2780 3.15 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:28.817 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.1939101, 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020859142000000001, 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:28.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2780 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476525+0000", 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669000000000001e-05 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:28.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480305+0000", 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037793739999999998 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480340+0000", 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5082000000000001e-05 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480356+0000", 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5985999999999999e-05 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480444+0000", 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8898000000000002e-05 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480600+0000", 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155685 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480746+0000", 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014611 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.487929+0000", 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071829750000000003 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497194+0000", 2024-09-10T05:57:28.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092649140000000008 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497294+0000", 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100134 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497364+0000", 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9314999999999996e-05 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:28.824 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:28.825 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:28.826 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-10T05:57:28.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-10T05:57:28.827 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:28.823+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:28.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:28.927 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:28.924+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:29.001 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:29.001 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:29.001 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:29.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:29.064 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:29.063+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:29.129 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:29.124+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:29.130 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:29.130 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:29.131 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:29.131 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:29.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:29.236 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:29.235+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:29.319 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:29.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:29.319 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:29.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 115.69861734600001, 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:57:29.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:57:29.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:57:29.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:57:29.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:57:29.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:57:29.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1947 3.3 e66/24 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 40.910921688999998, 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013054759000000001, 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404196+0000", 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409810+0000", 2024-09-10T05:57:29.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056139830000000003 2024-09-10T05:57:29.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409851+0000", 2024-09-10T05:57:29.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0615000000000003e-05 2024-09-10T05:57:29.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409874+0000", 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3476e-05 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409997+0000", 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122745 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.410025+0000", 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7559000000000002e-05 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417196+0000", 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071715090000000004 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417248+0000", 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2225999999999998e-05 2024-09-10T05:57:29.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2675 3.1 3:808dd43d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.978939287999999, 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016454241000000001, 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2675 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336179+0000", 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337951+0000", 2024-09-10T05:57:29.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017720329999999999 2024-09-10T05:57:29.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337984+0000", 2024-09-10T05:57:29.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3022000000000003e-05 2024-09-10T05:57:29.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337999+0000", 2024-09-10T05:57:29.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4942e-05 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338081+0000", 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1463000000000003e-05 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338193+0000", 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111705 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338294+0000", 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101019 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.347997+0000", 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097033069999999996 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352514+0000", 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045167970000000003 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352577+0000", 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3260000000000001e-05 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352630+0000", 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3208999999999998e-05 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2681 3.3a e73/24 3:5e71f715:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_144:head v 73'5, mlcod=66'3)", 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.893118911999998, 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011684702999999999, 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421997+0000", 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6800000000000001e-07 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427043+0000", 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005046498 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427064+0000", 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1158999999999999e-05 2024-09-10T05:57:29.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427078+0000", 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3239e-05 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427168+0000", 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0364000000000004e-05 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427198+0000", 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433637+0000", 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064382279999999998 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433681+0000", 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4484000000000003e-05 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2682 3.20 e73/24 3:072f3612:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_145:head v 73'4, mlcod=72'2)", 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.881329272999999, 2024-09-10T05:57:29.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010326201, 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433806+0000", 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0290999999999999e-05 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437646+0000", 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398439999999998 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437669+0000", 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3298e-05 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437684+0000", 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.438e-05 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437777+0000", 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3194000000000003e-05 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437809+0000", 2024-09-10T05:57:29.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2131000000000001e-05 2024-09-10T05:57:29.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444041+0000", 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062315460000000001 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444112+0000", 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1517e-05 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2686 3.3 e73/24 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head v 73'4, mlcod=71'2)", 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.830291011, 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010201259000000001, 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.356 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:29.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484826+0000", 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.86e-06 2024-09-10T05:57:29.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488806+0000", 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797879999999997 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488834+0000", 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8004000000000002e-05 2024-09-10T05:57:29.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488848+0000", 2024-09-10T05:57:29.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4344e-05 2024-09-10T05:57:29.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488944+0000", 2024-09-10T05:57:29.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5981000000000001e-05 2024-09-10T05:57:29.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488975+0000", 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0510000000000001e-05 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.494982+0000", 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060074969999999997 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.495025+0000", 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3275000000000002e-05 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2700 3.1b 3:db80fad5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.671839975000001, 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503279, 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2700 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:29.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643278+0000", 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644670+0000", 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013922209999999999 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644698+0000", 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8152000000000001e-05 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644711+0000", 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3495999999999999e-05 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644816+0000", 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010404 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644945+0000", 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129939 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645082+0000", 2024-09-10T05:57:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013664999999999999 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.649392+0000", 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043094989999999996 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656648+0000", 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072568629999999997 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656720+0000", 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1913000000000001e-05 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656779+0000", 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8158999999999997e-05 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2701 3.3d 3:bc92f7d4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.660728674000001, 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013087995, 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2701 2024-09-10T05:57:29.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654389+0000", 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655645+0000", 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012560150000000001 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655669+0000", 2024-09-10T05:57:29.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3845999999999998e-05 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655679+0000", 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.004e-05 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655738+0000", 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8989000000000001e-05 2024-09-10T05:57:29.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655897+0000", 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015926800000000001 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655995+0000", 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7600000000000001e-05 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666093+0000", 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010098452000000001 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666169+0000", 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6196e-05 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666236+0000", 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7260000000000003e-05 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.667475+0000", 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012381289999999999 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.377 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2705 3.17 3:eba32b22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.622746014000001, 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017940067000000001, 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:29.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692372+0000", 2024-09-10T05:57:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-10T05:57:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693889+0000", 2024-09-10T05:57:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015172370000000001 2024-09-10T05:57:29.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693920+0000", 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1291999999999998e-05 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693933+0000", 2024-09-10T05:57:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2693e-05 2024-09-10T05:57:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694001+0000", 2024-09-10T05:57:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830000000000006e-05 2024-09-10T05:57:29.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694130+0000", 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129114 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:29.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694285+0000", 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015531599999999999 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.698265+0000", 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797950000000004 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710231+0000", 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011966348999999999 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710272+0000", 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1193999999999999e-05 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710309+0000", 2024-09-10T05:57:29.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6888000000000003e-05 2024-09-10T05:57:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.471867301, 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:29.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:57:29.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2729 3.3 e74/24 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:29.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.358796497, 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011635193, 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962186+0000", 2024-09-10T05:57:29.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058669120000000002 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962213+0000", 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7018000000000001e-05 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962225+0000", 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1836e-05 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962541+0000", 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031584199999999999 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962569+0000", 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8175e-05 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967897+0000", 2024-09-10T05:57:29.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053282190000000004 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967954+0000", 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6950000000000002e-05 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.319697604000002, 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:57:29.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2738 3.39 e74/24 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.27092648, 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013163921, 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044191+0000", 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.396e-06 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050959+0000", 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067675360000000002 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050982+0000", 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3275999999999999e-05 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050995+0000", 2024-09-10T05:57:29.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2873e-05 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051071+0000", 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5782000000000001e-05 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051099+0000", 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7895999999999999e-05 2024-09-10T05:57:29.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057285+0000", 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006186067 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057353+0000", 2024-09-10T05:57:29.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8095000000000004e-05 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2742 3.1 3:81622134:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.239695012999999, 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016996092000000001, 2024-09-10T05:57:29.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2742 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075424+0000", 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3380000000000001e-06 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077125+0000", 2024-09-10T05:57:29.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001701504 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077157+0000", 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1665000000000003e-05 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077172+0000", 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379e-05 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077245+0000", 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2706000000000005e-05 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077418+0000", 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017356399999999999 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077574+0000", 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015575499999999999 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.082224+0000", 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046503439999999998 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092275+0000", 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010050738 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092356+0000", 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0822999999999995e-05 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092416+0000", 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0275999999999997e-05 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.422 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2746 3.23 3:c7325450:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.199744962, 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011885972999999999, 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2746 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115373+0000", 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7920000000000001e-06 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117159+0000", 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017863670000000001 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117189+0000", 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9201e-05 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117203+0000", 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:29.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117288+0000", 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5383000000000006e-05 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117416+0000", 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012752799999999999 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117552+0000", 2024-09-10T05:57:29.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013568900000000001 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.124143+0000", 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065914249999999997 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127122+0000", 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029785509999999999 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127197+0000", 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5593000000000006e-05 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127256+0000", 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9051000000000001e-05 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2750 3.1b 3:da716242:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.429 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.158814120999999, 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016402756000000001, 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2750 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156304+0000", 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7590000000000002e-06 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157544+0000", 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012403900000000001 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157569+0000", 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5133000000000001e-05 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157580+0000", 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0953e-05 2024-09-10T05:57:29.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157672+0000", 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1685000000000001e-05 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157859+0000", 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694499999999999 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:29.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.158038+0000", 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017913299999999999 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.163265+0000", 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052268569999999997 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172626+0000", 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093605370000000004 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172667+0000", 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1764999999999997e-05 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172704+0000", 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6599e-05 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2771 3.23 3:c48b55d9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.942059689000001, 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010835595999999999, 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2771 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373059+0000", 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1650000000000002e-06 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374820+0000", 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017613310000000001 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374853+0000", 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374868+0000", 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5591999999999999e-05 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374966+0000", 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7194999999999994e-05 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375153+0000", 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018719799999999999 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375332+0000", 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017948500000000001 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.381064+0000", 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057316939999999999 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383759+0000", 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026946779999999998 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383833+0000", 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4826999999999994e-05 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383891+0000", 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7701999999999997e-05 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2777 3.1b 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.876731422999999, 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019570203000000001, 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2777 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438387+0000", 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9009999999999998e-06 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439946+0000", 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00155905 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439975+0000", 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9311000000000001e-05 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439988+0000", 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3319000000000001e-05 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440057+0000", 2024-09-10T05:57:29.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8208999999999997e-05 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440175+0000", 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118261 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:29.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440286+0000", 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111242 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.444527+0000", 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042409800000000001 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457848+0000", 2024-09-10T05:57:29.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013320702 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457903+0000", 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457954+0000", 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1319000000000001e-05 2024-09-10T05:57:29.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2781 3.6 3:62f67cea:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.827773485000002, 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012768417000000001, 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.452 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2781 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487346+0000", 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4279999999999998e-06 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489317+0000", 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019705460000000001 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489360+0000", 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3350999999999999e-05 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489382+0000", 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1744000000000001e-05 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489504+0000", 2024-09-10T05:57:29.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012243599999999999 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489754+0000", 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000249425 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489995+0000", 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000241151 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.456 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.498069+0000", 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080742499999999998 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500028+0000", 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019588600000000002 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500078+0000", 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0157000000000001e-05 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500110+0000", 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2069000000000001e-05 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2785 3.12 3:49663187:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 27.775442054999999, 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015080374000000001, 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2785 2024-09-10T05:57:29.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539676+0000", 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542236+0000", 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025599830000000001 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542273+0000", 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7063000000000001e-05 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542288+0000", 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.518e-05 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542365+0000", 2024-09-10T05:57:29.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7292999999999993e-05 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542494+0000", 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012883099999999999 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542615+0000", 2024-09-10T05:57:29.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012126899999999999 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.546794+0000", 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041788149999999998 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554636+0000", 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078412470000000008 2024-09-10T05:57:29.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554707+0000", 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1899999999999999e-05 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554754+0000", 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6103999999999998e-05 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.465 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.466 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.466 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:29.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:29.468 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:29.463+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:29.568 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:29.564+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:29.641 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:29.642 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:29.642 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:29.642 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:29.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:29.704 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:29.703+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:29.768 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:29.767+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:29.778 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:29.779 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:29.779 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:29.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:29.802 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-10T05:57:29.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:57:29.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-10T05:57:29.869 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:29.864+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:29.932 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 123.37361588100001, 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1948 3.19 3:9ae3dc4d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.520173733999997, 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010681995999999999, 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1948 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:29.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409648+0000", 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.411e-06 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411596+0000", 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019481749999999999 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411627+0000", 2024-09-10T05:57:29.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1130000000000002e-05 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411642+0000", 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5102e-05 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411726+0000", 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4006999999999997e-05 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411888+0000", 2024-09-10T05:57:29.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016162500000000001 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412039+0000", 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151848 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417810+0000", 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057708580000000002 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420232+0000", 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024214610000000002 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420290+0000", 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8136e-05 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420326+0000", 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6242999999999998e-05 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2688 3.19 3:9a5c5cc5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.424925864999999, 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099290669999999998, 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2688 2024-09-10T05:57:29.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504896+0000", 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8249999999999998e-06 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506826+0000", 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019305049999999999 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506850+0000", 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3751999999999999e-05 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506863+0000", 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2989999999999999e-05 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506961+0000", 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8059000000000004e-05 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.507146+0000", 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018474400000000001 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.507311+0000", 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164697 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.513952+0000", 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066411070000000003 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514712+0000", 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076031000000000004 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.948 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514774+0000", 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1544000000000006e-05 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514821+0000", 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7534000000000003e-05 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2689 3.19 3:99575c67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:29.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.409099226999999, 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01027197, 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2689 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520722+0000", 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3739999999999998e-06 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522419+0000", 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016969960000000001 2024-09-10T05:57:29.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522441+0000", 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1698000000000001e-05 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522455+0000", 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3828e-05 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522549+0000", 2024-09-10T05:57:29.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4091000000000004e-05 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522727+0000", 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000178204 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522887+0000", 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015975200000000001 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.953 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530377+0000", 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007490493 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530872+0000", 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049481000000000004 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530938+0000", 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6459999999999997e-05 2024-09-10T05:57:29.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530991+0000", 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2264e-05 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2693 3.25 3:a7e22d13:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.568200+0000", 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.361617753000001, 2024-09-10T05:57:29.955 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098861509999999993, 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2693 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.956 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.568200+0000", 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.568200+0000", 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.568203+0000", 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1379999999999999e-06 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.957 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569872+0000", 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016686629999999999 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569885+0000", 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.346e-05 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569897+0000", 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1653e-05 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.958 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.569988+0000", 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1402000000000003e-05 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.570154+0000", 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000165728 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.570279+0000", 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000124385 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.959 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.577724+0000", 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074459390000000004 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.577977+0000", 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025251800000000002 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.578037+0000", 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.960 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.578086+0000", 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9073000000000003e-05 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2695 3.4 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.337791096, 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013307572, 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.962 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592030+0000", 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8650000000000001e-06 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594049+0000", 2024-09-10T05:57:29.963 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002019449 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594078+0000", 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9376000000000001e-05 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594092+0000", 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3505e-05 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594168+0000", 2024-09-10T05:57:29.964 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6063999999999995e-05 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594293+0000", 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012461899999999999 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594406+0000", 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112983 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.965 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605086+0000", 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010680383999999999 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605259+0000", 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172659 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605303+0000", 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4651000000000003e-05 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.966 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605334+0000", 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1016999999999998e-05 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2699 3.25 3:a7585b47:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.296118082, 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011556090999999999, 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.967 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2699 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633701+0000", 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.55e-06 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635063+0000", 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001361473 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635086+0000", 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3175000000000001e-05 2024-09-10T05:57:29.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635099+0000", 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.274e-05 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635179+0000", 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0327999999999994e-05 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635295+0000", 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011636 2024-09-10T05:57:29.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635412+0000", 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116941 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.640453+0000", 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050403840000000002 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645131+0000", 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046778169999999999 2024-09-10T05:57:29.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645201+0000", 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0526999999999997e-05 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645256+0000", 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4796000000000002e-05 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.972 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2717 3.25 3:a515f872:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.109846653000002, 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011604369, 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.973 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2717 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.974 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819975+0000", 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821866+0000", 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00189079 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821899+0000", 2024-09-10T05:57:29.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809000000000001e-05 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821914+0000", 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5e-05 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822002+0000", 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7892999999999993e-05 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822154+0000", 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015216200000000001 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822295+0000", 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014084899999999999 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830948+0000", 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086527919999999994 2024-09-10T05:57:29.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831454+0000", 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050560199999999996 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831520+0000", 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6017000000000002e-05 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831576+0000", 2024-09-10T05:57:29.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5825000000000002e-05 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2726 3.3e 3:7ca2d2f7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.013424103999998, 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010261348, 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.979 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2726 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916397+0000", 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0240000000000002e-06 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917892+0000", 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014948850000000001 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917917+0000", 2024-09-10T05:57:29.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5622999999999998e-05 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917930+0000", 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2567e-05 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918060+0000", 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130588 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918224+0000", 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163585 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918309+0000", 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4944999999999994e-05 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.925501+0000", 2024-09-10T05:57:29.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071920430000000004 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926533+0000", 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010318090000000001 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926601+0000", 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8473000000000007e-05 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926655+0000", 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2730 3.19 3:99f0627c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.974451259999999, 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012565949999999999, 2024-09-10T05:57:29.985 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2730 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955370+0000", 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3620000000000002e-06 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957409+0000", 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020391720000000001 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957452+0000", 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2895000000000002e-05 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957466+0000", 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4311000000000001e-05 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957588+0000", 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121663 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957792+0000", 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203792 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957975+0000", 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183678 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965498+0000", 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075228700000000001 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967831+0000", 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023322590000000002 2024-09-10T05:57:29.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967882+0000", 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1598000000000003e-05 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967933+0000", 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0349999999999997e-05 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2731 3.4 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.964666406999999, 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013157917999999999, 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2731 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.992 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965155+0000", 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5889999999999999e-06 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966586+0000", 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001430618 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966603+0000", 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7059999999999999e-05 2024-09-10T05:57:29.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966614+0000", 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1141999999999999e-05 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966689+0000", 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5574000000000005e-05 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966819+0000", 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129558 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966944+0000", 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012527799999999999 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:29.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975490+0000", 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085459999999999998 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978216+0000", 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027259879999999999 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978268+0000", 2024-09-10T05:57:29.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1493000000000003e-05 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978309+0000", 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1618e-05 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2733 3.0 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:29.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.943395880000001, 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012015477, 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2733 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:29.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986425+0000", 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988599+0000", 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021740489999999999 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988621+0000", 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1922000000000001e-05 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988633+0000", 2024-09-10T05:57:30.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1758e-05 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988727+0000", 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3867000000000001e-05 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988922+0000", 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019508500000000001 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989099+0000", 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017668299999999999 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.996748+0000", 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007649159 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998318+0000", 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015705090000000001 2024-09-10T05:57:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998382+0000", 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4036999999999997e-05 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998437+0000", 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207000000000002e-05 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.004 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2740 3.4 3:23fd3bef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.875179207999999, 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011027009000000001, 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.005 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2740 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054641+0000", 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.813e-06 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056322+0000", 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016803530000000001 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056368+0000", 2024-09-10T05:57:30.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6044999999999997e-05 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056388+0000", 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0418999999999999e-05 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056451+0000", 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2236000000000005e-05 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056584+0000", 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133771 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056711+0000", 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127009 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.062350+0000", 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056391669999999996 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065551+0000", 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003200179 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065617+0000", 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6821000000000003e-05 2024-09-10T05:57:30.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065666+0000", 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8195999999999997e-05 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2756 3.1a e74/24 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:30.011 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.709425317000001, 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012940208, 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226300+0000", 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059069400000000003 2024-09-10T05:57:30.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226316+0000", 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6509000000000001e-05 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226325+0000", 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7439999999999996e-06 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226425+0000", 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100188 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226452+0000", 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7140000000000001e-05 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233268+0000", 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068155660000000003 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233333+0000", 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4789000000000006e-05 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2768 3.4 3:206588f5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.589276257000002, 2024-09-10T05:57:30.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011512440000000001, 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2768 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340545+0000", 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3359999999999999e-06 2024-09-10T05:57:30.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342133+0000", 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001587771 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342159+0000", 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6554e-05 2024-09-10T05:57:30.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342171+0000", 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1956999999999999e-05 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342248+0000", 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6791000000000004e-05 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342372+0000", 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425500000000001 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342470+0000", 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7721999999999997e-05 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351396+0000", 2024-09-10T05:57:30.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089259419999999992 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351961+0000", 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056521100000000003 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.352021+0000", 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0003999999999997e-05 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.352054+0000", 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2897e-05 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2772 3.0 3:02cde5ff:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.546167280999999, 2024-09-10T05:57:30.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010850436, 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2772 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383654+0000", 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.67e-06 2024-09-10T05:57:30.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385466+0000", 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001811549 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385495+0000", 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9488999999999998e-05 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385510+0000", 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5116000000000001e-05 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385617+0000", 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010702299999999999 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385796+0000", 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017860700000000001 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385950+0000", 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015417600000000001 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.391450+0000", 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054996660000000003 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394434+0000", 2024-09-10T05:57:30.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029838529999999999 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394471+0000", 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6976e-05 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394501+0000", 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0311000000000002e-05 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2776 3.31 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.501385202000002, 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019117624, 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2776 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428435+0000", 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6019999999999998e-06 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429944+0000", 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001509095 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429973+0000", 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8558e-05 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429986+0000", 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3591000000000001e-05 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430053+0000", 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430167+0000", 2024-09-10T05:57:30.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114243 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430257+0000", 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9386000000000001e-05 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.434734+0000", 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044769909999999996 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447370+0000", 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012636214 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447476+0000", 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105844 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447550+0000", 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4622000000000005e-05 2024-09-10T05:57:30.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2782 3.25 3:a5d3e292:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.427372309999999, 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012424736, 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.036 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2782 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502448+0000", 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505248+0000", 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027999470000000001 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505285+0000", 2024-09-10T05:57:30.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.68e-05 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505304+0000", 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9423999999999999e-05 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505417+0000", 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011298000000000001 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505608+0000", 2024-09-10T05:57:30.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019085900000000001 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505785+0000", 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176832 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.511556+0000", 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057704219999999999 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514735+0000", 2024-09-10T05:57:30.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031793749999999999 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514811+0000", 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6129000000000002e-05 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514870+0000", 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9250999999999999e-05 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2783 3.3e 3:7c6034eb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.416290698000001, 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503764, 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2783 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513531+0000", 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1520000000000002e-06 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516867+0000", 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033353800000000002 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516900+0000", 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3414999999999998e-05 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516917+0000", 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867999999999998e-05 2024-09-10T05:57:30.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516998+0000", 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0851000000000002e-05 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517142+0000", 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144671 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517248+0000", 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105319 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526098+0000", 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088501629999999994 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526838+0000", 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074033699999999998 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526948+0000", 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109647 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.527031+0000", 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2960999999999994e-05 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2786 3.19 3:994682bc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.047 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.555389+0000", 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 28.374428855000001, 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009839403, 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2786 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.555389+0000", 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.555389+0000", 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.555392+0000", 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6419999999999999e-06 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557092+0000", 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00170067 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557114+0000", 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2198e-05 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557125+0000", 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0287e-05 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557220+0000", 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4973e-05 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557407+0000", 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018676200000000001 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.557582+0000", 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017572700000000001 2024-09-10T05:57:30.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.564612+0000", 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070294850000000002 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.565112+0000", 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050007199999999995 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.565178+0000", 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6507999999999994e-05 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.565228+0000", 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0078999999999999e-05 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.053 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:30.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:30.055 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:30.051+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:30.155 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:30.155+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:30.212 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:30.212 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:30.212 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:30.212 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:30.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:30.268 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:30.267+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:30.358 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:30.355+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:30.386 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:30.386 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:30.386 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:30.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:30.488 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:30.487+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:30.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:30.559 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:30.556+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:30.571 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:30.571 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:30.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:30.571 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:30.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.571 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2683 3.9 e73/24 3:92807282:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_146:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:30.571 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.446850+0000", 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.122897876, 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096763019999999995, 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.446850+0000", 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.446850+0000", 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.446852+0000", 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2800000000000002e-06 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450818+0000", 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039655150000000002 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450848+0000", 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0360000000000001e-05 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450862+0000", 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4338999999999999e-05 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450961+0000", 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8301999999999995e-05 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450989+0000", 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.456450+0000", 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054605840000000001 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.456526+0000", 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6556000000000004e-05 2024-09-10T05:57:30.575 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2684 3.3b e73/24 3:ded4c328:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_147:head v 73'6, mlcod=73'4)", 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.461033+0000", 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.108714785, 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010447488, 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.461033+0000", 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.461033+0000", 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.461035+0000", 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-10T05:57:30.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465834+0000", 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047998240000000003 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465856+0000", 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1441e-05 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465868+0000", 2024-09-10T05:57:30.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2300000000000001e-05 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465947+0000", 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8512999999999999e-05 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465974+0000", 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209e-05 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.471427+0000", 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054533389999999998 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.471480+0000", 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3140000000000003e-05 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2695 3.4 e73/24 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.594518+0000", 2024-09-10T05:57:30.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.975229574, 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098667310000000001, 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594518+0000", 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594518+0000", 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594520+0000", 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6199999999999999e-06 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596709+0000", 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021889409999999998 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596736+0000", 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7810999999999999e-05 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596750+0000", 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.34e-05 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596815+0000", 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5597000000000002e-05 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596837+0000", 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1880999999999999e-05 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.604314+0000", 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074762830000000002 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.604385+0000", 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1198000000000005e-05 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2701 3.3d e73/24 3:bc92f7d4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_164:head v 73'4, mlcod=72'2)", 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.656075+0000", 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.913672550000001, 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086565640000000003, 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656075+0000", 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656075+0000", 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656077+0000", 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6360000000000001e-06 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657478+0000", 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014012670000000001 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657496+0000", 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7978e-05 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657508+0000", 2024-09-10T05:57:30.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1603000000000001e-05 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657582+0000", 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4315999999999998e-05 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657612+0000", 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0596000000000003e-05 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664656+0000", 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070437950000000003 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664732+0000", 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5372999999999998e-05 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.589 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2715 3.3b e73/24 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head v 73'7, mlcod=73'5)", 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.805657+0000", 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.764090580000001, 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010096371, 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.805657+0000", 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.805657+0000", 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.805659+0000", 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.739e-06 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810651+0000", 2024-09-10T05:57:30.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049917970000000001 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810676+0000", 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5769e-05 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810689+0000", 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2445e-05 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810767+0000", 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8417000000000005e-05 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810794+0000", 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.815690+0000", 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048956709999999999 2024-09-10T05:57:30.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.815753+0000", 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3880999999999994e-05 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2716 3.3b e73/24 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head v 73'8, mlcod=73'5)", 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.751371486, 2024-09-10T05:57:30.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012669998999999999, 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818378+0000", 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.607e-06 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822721+0000", 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043427550000000002 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822741+0000", 2024-09-10T05:57:30.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0820000000000001e-05 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822750+0000", 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969999999999999e-06 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822826+0000", 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5488000000000006e-05 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822850+0000", 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4328000000000002e-05 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830980+0000", 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081304089999999999 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831046+0000", 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5895000000000005e-05 2024-09-10T05:57:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2720 3.9 e73/24 3:90160a04:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_183:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.860974+0000", 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.708773554, 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010555658000000001, 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.860974+0000", 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.860974+0000", 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.860977+0000", 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6529999999999998e-06 2024-09-10T05:57:30.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865618+0000", 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046415010000000001 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865636+0000", 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8162e-05 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865646+0000", 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.825e-06 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865709+0000", 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2687000000000005e-05 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865738+0000", 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8921999999999999e-05 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.871475+0000", 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057366589999999999 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.871530+0000", 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5248999999999999e-05 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.603 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2721 3.9 e73/24 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head v 73'5, mlcod=73'3)", 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.695766058, 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011236408, 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873983+0000", 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6729999999999999e-06 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878223+0000", 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042396789999999997 2024-09-10T05:57:30.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878246+0000", 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3326e-05 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878304+0000", 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7794000000000003e-05 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878368+0000", 2024-09-10T05:57:30.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4005999999999997e-05 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878391+0000", 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2909e-05 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885156+0000", 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067645680000000003 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885218+0000", 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2453000000000007e-05 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2724 3.3b e73/24 3:de2d4288:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_187:head v 73'9, mlcod=73'7)", 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.901245+0000", 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.668502506999999, 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010036058, 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901245+0000", 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901245+0000", 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901248+0000", 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6429999999999999e-06 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906079+0000", 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048312299999999997 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906122+0000", 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3090000000000002e-05 2024-09-10T05:57:30.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906138+0000", 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906230+0000", 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2584999999999995e-05 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906262+0000", 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1541000000000002e-05 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.911225+0000", 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049628340000000002 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.911281+0000", 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-05 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.612 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2725 3.21 3:856ed7cd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.664050715999998, 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018910211999999999, 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.613 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2725 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905702+0000", 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908098+0000", 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023965269999999999 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908124+0000", 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899000000000001e-05 2024-09-10T05:57:30.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908139+0000", 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5026e-05 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908222+0000", 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908417+0000", 2024-09-10T05:57:30.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195026 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908573+0000", 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155849 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.913471+0000", 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048985469999999996 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924490+0000", 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011019167999999999 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924557+0000", 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6925e-05 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924607+0000", 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9932000000000002e-05 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2731 3.4 e74/24 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.967074+0000", 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.60267344, 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086595500000000002, 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967074+0000", 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967074+0000", 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967075+0000", 2024-09-10T05:57:30.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969682+0000", 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026072629999999999 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969713+0000", 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1010999999999998e-05 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969728+0000", 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4688000000000001e-05 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969812+0000", 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4023000000000005e-05 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969838+0000", 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6769000000000001e-05 2024-09-10T05:57:30.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975673+0000", 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058346750000000001 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975734+0000", 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0742999999999998e-05 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2733 3.0 e74/24 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head v 74'3, mlcod=72'1)", 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.989218+0000", 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.580529753, 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089400929999999997, 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989218+0000", 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989218+0000", 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989220+0000", 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.711e-06 2024-09-10T05:57:30.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990539+0000", 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013190159999999999 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990558+0000", 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9006000000000001e-05 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990567+0000", 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7710000000000001e-06 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990645+0000", 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7213999999999996e-05 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990671+0000", 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6798e-05 2024-09-10T05:57:30.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998123+0000", 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074515240000000002 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998158+0000", 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5052999999999998e-05 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2740 3.4 e74/24 3:23fd3bef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_203:head v 74'6, mlcod=73'4)", 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.057932+0000", 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.511815548000001, 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071880420000000004, 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057932+0000", 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057932+0000", 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057934+0000", 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.689e-06 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.058891+0000", 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00095720699999999996 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.058913+0000", 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1883999999999999e-05 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.058926+0000", 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3196999999999999e-05 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.059012+0000", 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6374999999999999e-05 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.059042+0000", 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9893e-05 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065059+0000", 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060161850000000003 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065120+0000", 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1612000000000006e-05 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2748 3.3b e74/24 3:deadbbb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_211:head v 74'10, mlcod=73'8)", 2024-09-10T05:57:30.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.427270716999999, 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011669703999999999, 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142478+0000", 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999997e-07 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148304+0000", 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058267570000000001 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148327+0000", 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2921e-05 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148338+0000", 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294999999999999e-05 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148403+0000", 2024-09-10T05:57:30.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4332999999999995e-05 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148421+0000", 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7991000000000001e-05 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154104+0000", 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005683385 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154147+0000", 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2446e-05 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2751 3.21 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.403169914999999, 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019591372999999999, 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2751 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166581+0000", 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.167981+0000", 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00139999 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168020+0000", 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8980000000000003e-05 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168036+0000", 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6568000000000001e-05 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168113+0000", 2024-09-10T05:57:30.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6417999999999999e-05 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168228+0000", 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115161 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168349+0000", 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012086 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175149+0000", 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068000150000000004 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186073+0000", 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010924411 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186119+0000", 2024-09-10T05:57:30.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5550999999999998e-05 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186169+0000", 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0603000000000003e-05 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2753 3.21 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.383199191999999, 2024-09-10T05:57:30.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019351368000000001, 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2753 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186551+0000", 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5059999999999998e-06 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.187974+0000", 2024-09-10T05:57:30.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014233259999999999 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188000+0000", 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188011+0000", 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188082+0000", 2024-09-10T05:57:30.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1061000000000003e-05 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188225+0000", 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014240499999999999 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188343+0000", 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118019 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192712+0000", 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043687309999999998 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205798+0000", 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013086191 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205849+0000", 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-10T05:57:30.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205900+0000", 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1174999999999997e-05 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2757 3.2e 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.345703578999998, 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021228316000000001, 2024-09-10T05:57:30.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2757 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224047+0000", 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.531e-06 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225876+0000", 2024-09-10T05:57:30.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018291119999999999 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225905+0000", 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9615999999999999e-05 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225921+0000", 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5338000000000001e-05 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226002+0000", 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1521999999999996e-05 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226149+0000", 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147031 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226249+0000", 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9671000000000002e-05 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.232949+0000", 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067004150000000004 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245149+0000", 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012199468 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245220+0000", 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0990999999999998e-05 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245272+0000", 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2621000000000003e-05 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2768 3.4 e74/24 3:206588f5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_231:head v 74'7, mlcod=74'5)", 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.344165+0000", 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.225582565, 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0076008949999999999, 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.344165+0000", 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.344165+0000", 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.344168+0000", 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.345570+0000", 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014023029999999999 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.345604+0000", 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4165000000000002e-05 2024-09-10T05:57:30.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.345619+0000", 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4905e-05 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.345706+0000", 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7125000000000004e-05 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.345728+0000", 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2079999999999999e-05 2024-09-10T05:57:30.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351699+0000", 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059710880000000003 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351766+0000", 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6539999999999997e-05 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2769 3.c 3:32936715:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.353171+0000", 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.216576743000001, 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010342775, 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2769 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.353171+0000", 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.353171+0000", 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.353173+0000", 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.95e-06 2024-09-10T05:57:30.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354821+0000", 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016480869999999999 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354853+0000", 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1826999999999999e-05 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354867+0000", 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4577e-05 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354973+0000", 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105157 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.355153+0000", 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018055999999999999 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.355297+0000", 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014362199999999999 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.360662+0000", 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053651519999999998 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.363379+0000", 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027172849999999998 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.363455+0000", 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5495999999999997e-05 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.363514+0000", 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9061999999999998e-05 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2772 3.0 e74/24 3:02cde5ff:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_235:head v 74'4, mlcod=72'2)", 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.386067+0000", 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 29.183680529, 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082286770000000002, 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.386067+0000", 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.386067+0000", 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.386069+0000", 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.95e-06 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.387707+0000", 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016382829999999999 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.387727+0000", 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9222999999999999e-05 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.387739+0000", 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2138e-05 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.387841+0000", 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102613 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.387882+0000", 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0370000000000001e-05 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394254+0000", 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063725500000000003 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394296+0000", 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.155e-05 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:30.671 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:30.671 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:30.672 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:30.673 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:30.673 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:30.674 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:30.674 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:30.674 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:30.668+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:30.690 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:30.690 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:30.711 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:30.711 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:30.731 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:30.750 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:30.751 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:30.772 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:30.772 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:30.772 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:30.768+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:30.787 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:30.787 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:30.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:57:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-10T05:57:30.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-10T05:57:30.880 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:30.878+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:30.922 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:30.922 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:30.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:30.980 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:30.978+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:31.074 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:31.068+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:31.096 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:31.096 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:31.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:31.175 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:31.170+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:31.241 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:31.241 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:31.255 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:31.277 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:31.274+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:31.378 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:31.378 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:31.378 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:31.374+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:31.392 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:31.479 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:31.476+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:31.508 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:31.508 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:31.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:31.615 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:31.612+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:31.680 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:31.678+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:31.698 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:31.698 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:31.713 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:31.781 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:31.778+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:31.836 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.3 to 1 (10000) 2024-09-10T05:57:31.861 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-10T05:57:31.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:57:31.879 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:31.879 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:31.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:31.904 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:31.902+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:31.983 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:31.976+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:32.016 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:32.016 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:32.031 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:32.083 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:32.078+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:32.093 INFO:tasks.workunit.client.0.smithi070.stderr:100+0 records in 2024-09-10T05:57:32.093 INFO:tasks.workunit.client.0.smithi070.stderr:100+0 records out 2024-09-10T05:57:32.093 INFO:tasks.workunit.client.0.smithi070.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 6.72991 s, 156 MB/s 2024-09-10T05:57:32.184 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:32.180+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:32.199 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:32.199 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:32.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:32.248 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:57:32.254 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:57:32.269 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-10T05:57:31.831474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070224044,"num_objects":502,"num_object_clones":0,"num_object_copies":1004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":502,"num_whiteouts":0,"num_read":2935,"num_read_kb":2610,"num_write":1530,"num_write_kb":1066796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":10489836,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2335,"ondisk_log_size":2335,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2364724,"kb_used_data":2098540,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":752609996,"statfs":{"total":773094113280,"available":770672635904,"internally_reserved":0,"allocated":2148904960,"data_stored":2144981866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.040434"},"pg_stats":[{"pgid":"3.3f","version":"74'4","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812907+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:57:30.812907+0000","last_peered":"2024-09-10T05:57:30.812907+0000","last_clean":"2024-09-10T05:57:30.812907+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:57:30.812907+0000","last_undegraded":"2024-09-10T05:57:30.812907+0000","last_fullsized":"2024-09-10T05:57:30.812907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'1","reported_seq":132,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889789+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:57:29.889789+0000","last_peered":"2024-09-10T05:57:29.889789+0000","last_clean":"2024-09-10T05:57:29.889789+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:57:29.889789+0000","last_undegraded":"2024-09-10T05:57:29.889789+0000","last_fullsized":"2024-09-10T05:57:29.889789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"74'6","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890647+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:57:29.890647+0000","last_peered":"2024-09-10T05:57:29.890647+0000","last_clean":"2024-09-10T05:57:29.890647+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:57:29.890647+0000","last_undegraded":"2024-09-10T05:57:29.890647+0000","last_fullsized":"2024-09-10T05:57:29.890647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811442+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:57:30.811442+0000","last_peered":"2024-09-10T05:57:30.811442+0000","last_clean":"2024-09-10T05:57:30.811442+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:57:30.811442+0000","last_undegraded":"2024-09-10T05:57:30.811442+0000","last_fullsized":"2024-09-10T05:57:30.811442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"74'5","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808514+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:57:29.808514+0000","last_peered":"2024-09-10T05:57:29.808514+0000","last_clean":"2024-09-10T05:57:29.808514+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:57:29.808514+0000","last_undegraded":"2024-09-10T05:57:29.808514+0000","last_fullsized":"2024-09-10T05:57:29.808514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893101+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:57:29.893101+0000","last_peered":"2024-09-10T05:57:29.893101+0000","last_clean":"2024-09-10T05:57:29.893101+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:57:29.893101+0000","last_undegraded":"2024-09-10T05:57:29.893101+0000","last_fullsized":"2024-09-10T05:57:29.893101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"74'3","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891157+0000","last_change":"2024-09-10T05:56:23.067941+0000","last_active":"2024-09-10T05:57:29.891157+0000","last_peered":"2024-09-10T05:57:29.891157+0000","last_clean":"2024-09-10T05:57:29.891157+0000","last_became_active":"2024-09-10T05:56:23.066964+0000","last_became_peered":"2024-09-10T05:56:23.066964+0000","last_unstale":"2024-09-10T05:57:29.891157+0000","last_undegraded":"2024-09-10T05:57:29.891157+0000","last_fullsized":"2024-09-10T05:57:29.891157+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:07.840191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"67'8","reported_seq":175,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809329+0000","last_change":"2024-09-10T05:56:23.046850+0000","last_active":"2024-09-10T05:57:29.809329+0000","last_peered":"2024-09-10T05:57:29.809329+0000","last_clean":"2024-09-10T05:57:29.809329+0000","last_became_active":"2024-09-10T05:56:23.046172+0000","last_became_peered":"2024-09-10T05:56:23.046172+0000","last_unstale":"2024-09-10T05:57:29.809329+0000","last_undegraded":"2024-09-10T05:57:29.809329+0000","last_fullsized":"2024-09-10T05:57:29.809329+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:02.543439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"74'10","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813072+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:57:30.813072+0000","last_peered":"2024-09-10T05:57:30.813072+0000","last_clean":"2024-09-10T05:57:30.813072+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:57:30.813072+0000","last_undegraded":"2024-09-10T05:57:30.813072+0000","last_fullsized":"2024-09-10T05:57:30.813072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803137+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:57:29.803137+0000","last_peered":"2024-09-10T05:57:29.803137+0000","last_clean":"2024-09-10T05:57:29.803137+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:57:29.803137+0000","last_undegraded":"2024-09-10T05:57:29.803137+0000","last_fullsized":"2024-09-10T05:57:29.803137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890282+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:57:29.890282+0000","last_peered":"2024-09-10T05:57:29.890282+0000","last_clean":"2024-09-10T05:57:29.890282+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:57:29.890282+0000","last_undegraded":"2024-09-10T05:57:29.890282+0000","last_fullsized":"2024-09-10T05:57:29.890282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"80'7","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895052+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:57:29.895052+0000","last_peered":"2024-09-10T05:57:29.895052+0000","last_clean":"2024-09-10T05:57:29.895052+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:57:29.895052+0000","last_undegraded":"2024-09-10T05:57:29.895052+0000","last_fullsized":"2024-09-10T05:57:29.895052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"74'4","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811931+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:57:30.811931+0000","last_peered":"2024-09-10T05:57:30.811931+0000","last_clean":"2024-09-10T05:57:30.811931+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:57:30.811931+0000","last_undegraded":"2024-09-10T05:57:30.811931+0000","last_fullsized":"2024-09-10T05:57:30.811931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891103+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:57:29.891103+0000","last_peered":"2024-09-10T05:57:29.891103+0000","last_clean":"2024-09-10T05:57:29.891103+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:57:29.891103+0000","last_undegraded":"2024-09-10T05:57:29.891103+0000","last_fullsized":"2024-09-10T05:57:29.891103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"72'1","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888065+0000","last_change":"2024-09-10T05:56:23.044790+0000","last_active":"2024-09-10T05:57:29.888065+0000","last_peered":"2024-09-10T05:57:29.888065+0000","last_clean":"2024-09-10T05:57:29.888065+0000","last_became_active":"2024-09-10T05:56:23.044451+0000","last_became_peered":"2024-09-10T05:56:23.044451+0000","last_unstale":"2024-09-10T05:57:29.888065+0000","last_undegraded":"2024-09-10T05:57:29.888065+0000","last_fullsized":"2024-09-10T05:57:29.888065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:48.985907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802616+0000","last_change":"2024-09-10T05:56:23.059475+0000","last_active":"2024-09-10T05:57:29.802616+0000","last_peered":"2024-09-10T05:57:29.802616+0000","last_clean":"2024-09-10T05:57:29.802616+0000","last_became_active":"2024-09-10T05:56:23.059115+0000","last_became_peered":"2024-09-10T05:56:23.059115+0000","last_unstale":"2024-09-10T05:57:29.802616+0000","last_undegraded":"2024-09-10T05:57:29.802616+0000","last_fullsized":"2024-09-10T05:57:29.802616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:38.752296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889301+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:57:29.889301+0000","last_peered":"2024-09-10T05:57:29.889301+0000","last_clean":"2024-09-10T05:57:29.889301+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:57:29.889301+0000","last_undegraded":"2024-09-10T05:57:29.889301+0000","last_fullsized":"2024-09-10T05:57:29.889301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"74'5","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813034+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:57:30.813034+0000","last_peered":"2024-09-10T05:57:30.813034+0000","last_clean":"2024-09-10T05:57:30.813034+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:57:30.813034+0000","last_undegraded":"2024-09-10T05:57:30.813034+0000","last_fullsized":"2024-09-10T05:57:30.813034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811663+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:57:30.811663+0000","last_peered":"2024-09-10T05:57:30.811663+0000","last_clean":"2024-09-10T05:57:30.811663+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:57:30.811663+0000","last_undegraded":"2024-09-10T05:57:30.811663+0000","last_fullsized":"2024-09-10T05:57:30.811663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"74'6","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803439+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:57:29.803439+0000","last_peered":"2024-09-10T05:57:29.803439+0000","last_clean":"2024-09-10T05:57:29.803439+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:57:29.803439+0000","last_undegraded":"2024-09-10T05:57:29.803439+0000","last_fullsized":"2024-09-10T05:57:29.803439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890538+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:57:29.890538+0000","last_peered":"2024-09-10T05:57:29.890538+0000","last_clean":"2024-09-10T05:57:29.890538+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:57:29.890538+0000","last_undegraded":"2024-09-10T05:57:29.890538+0000","last_fullsized":"2024-09-10T05:57:29.890538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"71'3","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803993+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:57:29.803993+0000","last_peered":"2024-09-10T05:57:29.803993+0000","last_clean":"2024-09-10T05:57:29.803993+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:57:29.803993+0000","last_undegraded":"2024-09-10T05:57:29.803993+0000","last_fullsized":"2024-09-10T05:57:29.803993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801515+0000","last_change":"2024-09-10T05:56:23.060761+0000","last_active":"2024-09-10T05:57:29.801515+0000","last_peered":"2024-09-10T05:57:29.801515+0000","last_clean":"2024-09-10T05:57:29.801515+0000","last_became_active":"2024-09-10T05:56:23.060478+0000","last_became_peered":"2024-09-10T05:56:23.060478+0000","last_unstale":"2024-09-10T05:57:29.801515+0000","last_undegraded":"2024-09-10T05:57:29.801515+0000","last_fullsized":"2024-09-10T05:57:29.801515+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:37.688502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895883+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:57:29.895883+0000","last_peered":"2024-09-10T05:57:29.895883+0000","last_clean":"2024-09-10T05:57:29.895883+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:57:29.895883+0000","last_undegraded":"2024-09-10T05:57:29.895883+0000","last_fullsized":"2024-09-10T05:57:29.895883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"74'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801885+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:57:29.801885+0000","last_peered":"2024-09-10T05:57:29.801885+0000","last_clean":"2024-09-10T05:57:29.801885+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:57:29.801885+0000","last_undegraded":"2024-09-10T05:57:29.801885+0000","last_fullsized":"2024-09-10T05:57:29.801885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'6","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889375+0000","last_change":"2024-09-10T05:56:23.031635+0000","last_active":"2024-09-10T05:57:29.889375+0000","last_peered":"2024-09-10T05:57:29.889375+0000","last_clean":"2024-09-10T05:57:29.889375+0000","last_became_active":"2024-09-10T05:56:23.026992+0000","last_became_peered":"2024-09-10T05:56:23.026992+0000","last_unstale":"2024-09-10T05:57:29.889375+0000","last_undegraded":"2024-09-10T05:57:29.889375+0000","last_fullsized":"2024-09-10T05:57:29.889375+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:50.760900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895206+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:57:29.895206+0000","last_peered":"2024-09-10T05:57:29.895206+0000","last_clean":"2024-09-10T05:57:29.895206+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:57:29.895206+0000","last_undegraded":"2024-09-10T05:57:29.895206+0000","last_fullsized":"2024-09-10T05:57:29.895206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":134,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808346+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:57:29.808346+0000","last_peered":"2024-09-10T05:57:29.808346+0000","last_clean":"2024-09-10T05:57:29.808346+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:57:29.808346+0000","last_undegraded":"2024-09-10T05:57:29.808346+0000","last_fullsized":"2024-09-10T05:57:29.808346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"80'3","reported_seq":131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888496+0000","last_change":"2024-09-10T05:56:23.056685+0000","last_active":"2024-09-10T05:57:29.888496+0000","last_peered":"2024-09-10T05:57:29.888496+0000","last_clean":"2024-09-10T05:57:29.888496+0000","last_became_active":"2024-09-10T05:56:23.055767+0000","last_became_peered":"2024-09-10T05:56:23.055767+0000","last_unstale":"2024-09-10T05:57:29.888496+0000","last_undegraded":"2024-09-10T05:57:29.888496+0000","last_fullsized":"2024-09-10T05:57:29.888496+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:32.495236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"74'4","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889577+0000","last_change":"2024-09-10T05:56:23.049625+0000","last_active":"2024-09-10T05:57:29.889577+0000","last_peered":"2024-09-10T05:57:29.889577+0000","last_clean":"2024-09-10T05:57:29.889577+0000","last_became_active":"2024-09-10T05:56:23.049267+0000","last_became_peered":"2024-09-10T05:56:23.049267+0000","last_unstale":"2024-09-10T05:57:29.889577+0000","last_undegraded":"2024-09-10T05:57:29.889577+0000","last_fullsized":"2024-09-10T05:57:29.889577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:52.397184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"72'3","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813454+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:57:30.813454+0000","last_peered":"2024-09-10T05:57:30.813454+0000","last_clean":"2024-09-10T05:57:30.813454+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:57:30.813454+0000","last_undegraded":"2024-09-10T05:57:30.813454+0000","last_fullsized":"2024-09-10T05:57:30.813454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892349+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:57:29.892349+0000","last_peered":"2024-09-10T05:57:29.892349+0000","last_clean":"2024-09-10T05:57:29.892349+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:57:29.892349+0000","last_undegraded":"2024-09-10T05:57:29.892349+0000","last_fullsized":"2024-09-10T05:57:29.892349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"74'27","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809113+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:57:29.809113+0000","last_peered":"2024-09-10T05:57:29.809113+0000","last_clean":"2024-09-10T05:57:29.809113+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:57:29.809113+0000","last_undegraded":"2024-09-10T05:57:29.809113+0000","last_fullsized":"2024-09-10T05:57:29.809113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812241+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:57:30.812241+0000","last_peered":"2024-09-10T05:57:30.812241+0000","last_clean":"2024-09-10T05:57:30.812241+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:57:30.812241+0000","last_undegraded":"2024-09-10T05:57:30.812241+0000","last_fullsized":"2024-09-10T05:57:30.812241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'37","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889285+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:57:29.889285+0000","last_peered":"2024-09-10T05:57:29.889285+0000","last_clean":"2024-09-10T05:57:29.889285+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:57:29.889285+0000","last_undegraded":"2024-09-10T05:57:29.889285+0000","last_fullsized":"2024-09-10T05:57:29.889285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893105+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:57:29.893105+0000","last_peered":"2024-09-10T05:57:29.893105+0000","last_clean":"2024-09-10T05:57:29.893105+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:57:29.893105+0000","last_undegraded":"2024-09-10T05:57:29.893105+0000","last_fullsized":"2024-09-10T05:57:29.893105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"74'3","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808834+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:57:29.808834+0000","last_peered":"2024-09-10T05:57:29.808834+0000","last_clean":"2024-09-10T05:57:29.808834+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:57:29.808834+0000","last_undegraded":"2024-09-10T05:57:29.808834+0000","last_fullsized":"2024-09-10T05:57:29.808834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889933+0000","last_change":"2024-09-10T05:56:23.017197+0000","last_active":"2024-09-10T05:57:29.889933+0000","last_peered":"2024-09-10T05:57:29.889933+0000","last_clean":"2024-09-10T05:57:29.889933+0000","last_became_active":"2024-09-10T05:56:23.016946+0000","last_became_peered":"2024-09-10T05:56:23.016946+0000","last_unstale":"2024-09-10T05:57:29.889933+0000","last_undegraded":"2024-09-10T05:57:29.889933+0000","last_fullsized":"2024-09-10T05:57:29.889933+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:17.357508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":143,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897970+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:57:29.897970+0000","last_peered":"2024-09-10T05:57:29.897970+0000","last_clean":"2024-09-10T05:57:29.897970+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:57:29.897970+0000","last_undegraded":"2024-09-10T05:57:29.897970+0000","last_fullsized":"2024-09-10T05:57:29.897970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892763+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:57:29.892763+0000","last_peered":"2024-09-10T05:57:29.892763+0000","last_clean":"2024-09-10T05:57:29.892763+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:57:29.892763+0000","last_undegraded":"2024-09-10T05:57:29.892763+0000","last_fullsized":"2024-09-10T05:57:29.892763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808141+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:57:29.808141+0000","last_peered":"2024-09-10T05:57:29.808141+0000","last_clean":"2024-09-10T05:57:29.808141+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:57:29.808141+0000","last_undegraded":"2024-09-10T05:57:29.808141+0000","last_fullsized":"2024-09-10T05:57:29.808141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809523+0000","last_change":"2024-09-10T05:56:23.042081+0000","last_active":"2024-09-10T05:57:29.809523+0000","last_peered":"2024-09-10T05:57:29.809523+0000","last_clean":"2024-09-10T05:57:29.809523+0000","last_became_active":"2024-09-10T05:56:23.041763+0000","last_became_peered":"2024-09-10T05:56:23.041763+0000","last_unstale":"2024-09-10T05:57:29.809523+0000","last_undegraded":"2024-09-10T05:57:29.809523+0000","last_fullsized":"2024-09-10T05:57:29.809523+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:01.116823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"74'8","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811934+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:57:30.811934+0000","last_peered":"2024-09-10T05:57:30.811934+0000","last_clean":"2024-09-10T05:57:30.811934+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:57:30.811934+0000","last_undegraded":"2024-09-10T05:57:30.811934+0000","last_fullsized":"2024-09-10T05:57:30.811934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891900+0000","last_change":"2024-09-10T05:56:23.055375+0000","last_active":"2024-09-10T05:57:29.891900+0000","last_peered":"2024-09-10T05:57:29.891900+0000","last_clean":"2024-09-10T05:57:29.891900+0000","last_became_active":"2024-09-10T05:56:23.052761+0000","last_became_peered":"2024-09-10T05:56:23.052761+0000","last_unstale":"2024-09-10T05:57:29.891900+0000","last_undegraded":"2024-09-10T05:57:29.891900+0000","last_fullsized":"2024-09-10T05:57:29.891900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:57.904540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":162,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801706+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:57:29.801706+0000","last_peered":"2024-09-10T05:57:29.801706+0000","last_clean":"2024-09-10T05:57:29.801706+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:57:29.801706+0000","last_undegraded":"2024-09-10T05:57:29.801706+0000","last_fullsized":"2024-09-10T05:57:29.801706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"80'104","reported_seq":249,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813735+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:57:30.813735+0000","last_peered":"2024-09-10T05:57:30.813735+0000","last_clean":"2024-09-10T05:57:30.813735+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:57:30.813735+0000","last_undegraded":"2024-09-10T05:57:30.813735+0000","last_fullsized":"2024-09-10T05:57:30.813735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892759+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:57:29.892759+0000","last_peered":"2024-09-10T05:57:29.892759+0000","last_clean":"2024-09-10T05:57:29.892759+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:57:29.892759+0000","last_undegraded":"2024-09-10T05:57:29.892759+0000","last_fullsized":"2024-09-10T05:57:29.892759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":91,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892001+0000","last_change":"2024-09-10T05:56:23.011597+0000","last_active":"2024-09-10T05:57:29.892001+0000","last_peered":"2024-09-10T05:57:29.892001+0000","last_clean":"2024-09-10T05:57:29.892001+0000","last_became_active":"2024-09-10T05:56:23.008641+0000","last_became_peered":"2024-09-10T05:56:23.008641+0000","last_unstale":"2024-09-10T05:57:29.892001+0000","last_undegraded":"2024-09-10T05:57:29.892001+0000","last_fullsized":"2024-09-10T05:57:29.892001+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:28.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802137+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:57:29.802137+0000","last_peered":"2024-09-10T05:57:29.802137+0000","last_clean":"2024-09-10T05:57:29.802137+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:57:29.802137+0000","last_undegraded":"2024-09-10T05:57:29.802137+0000","last_fullsized":"2024-09-10T05:57:29.802137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890754+0000","last_change":"2024-09-10T05:56:23.060792+0000","last_active":"2024-09-10T05:57:29.890754+0000","last_peered":"2024-09-10T05:57:29.890754+0000","last_clean":"2024-09-10T05:57:29.890754+0000","last_became_active":"2024-09-10T05:56:23.059745+0000","last_became_peered":"2024-09-10T05:56:23.059745+0000","last_unstale":"2024-09-10T05:57:29.890754+0000","last_undegraded":"2024-09-10T05:57:29.890754+0000","last_fullsized":"2024-09-10T05:57:29.890754+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:11.407144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"74'20","reported_seq":158,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813978+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:57:30.813978+0000","last_peered":"2024-09-10T05:57:30.813978+0000","last_clean":"2024-09-10T05:57:30.813978+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:57:30.813978+0000","last_undegraded":"2024-09-10T05:57:30.813978+0000","last_fullsized":"2024-09-10T05:57:30.813978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"80'106","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889773+0000","last_change":"2024-09-10T05:56:23.146978+0000","last_active":"2024-09-10T05:57:29.889773+0000","last_peered":"2024-09-10T05:57:29.889773+0000","last_clean":"2024-09-10T05:57:29.889773+0000","last_became_active":"2024-09-10T05:56:23.037617+0000","last_became_peered":"2024-09-10T05:56:23.037617+0000","last_unstale":"2024-09-10T05:57:29.889773+0000","last_undegraded":"2024-09-10T05:57:29.889773+0000","last_fullsized":"2024-09-10T05:57:29.889773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:49.068438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890234+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:57:29.890234+0000","last_peered":"2024-09-10T05:57:29.890234+0000","last_clean":"2024-09-10T05:57:29.890234+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:57:29.890234+0000","last_undegraded":"2024-09-10T05:57:29.890234+0000","last_fullsized":"2024-09-10T05:57:29.890234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"72'4","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813288+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:57:30.813288+0000","last_peered":"2024-09-10T05:57:30.813288+0000","last_clean":"2024-09-10T05:57:30.813288+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:57:30.813288+0000","last_undegraded":"2024-09-10T05:57:30.813288+0000","last_fullsized":"2024-09-10T05:57:30.813288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811141+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:57:30.811141+0000","last_peered":"2024-09-10T05:57:30.811141+0000","last_clean":"2024-09-10T05:57:30.811141+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:57:30.811141+0000","last_undegraded":"2024-09-10T05:57:30.811141+0000","last_fullsized":"2024-09-10T05:57:30.811141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"74'32","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889511+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:57:29.889511+0000","last_peered":"2024-09-10T05:57:29.889511+0000","last_clean":"2024-09-10T05:57:29.889511+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:57:29.889511+0000","last_undegraded":"2024-09-10T05:57:29.889511+0000","last_fullsized":"2024-09-10T05:57:29.889511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889226+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:57:29.889226+0000","last_peered":"2024-09-10T05:57:29.889226+0000","last_clean":"2024-09-10T05:57:29.889226+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:57:29.889226+0000","last_undegraded":"2024-09-10T05:57:29.889226+0000","last_fullsized":"2024-09-10T05:57:29.889226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890797+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:57:29.890797+0000","last_peered":"2024-09-10T05:57:29.890797+0000","last_clean":"2024-09-10T05:57:29.890797+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:57:29.890797+0000","last_undegraded":"2024-09-10T05:57:29.890797+0000","last_fullsized":"2024-09-10T05:57:29.890797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894537+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:57:29.894537+0000","last_peered":"2024-09-10T05:57:29.894537+0000","last_clean":"2024-09-10T05:57:29.894537+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:57:29.894537+0000","last_undegraded":"2024-09-10T05:57:29.894537+0000","last_fullsized":"2024-09-10T05:57:29.894537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"74'3","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813385+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:57:30.813385+0000","last_peered":"2024-09-10T05:57:30.813385+0000","last_clean":"2024-09-10T05:57:30.813385+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:57:30.813385+0000","last_undegraded":"2024-09-10T05:57:30.813385+0000","last_fullsized":"2024-09-10T05:57:30.813385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801167+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:57:29.801167+0000","last_peered":"2024-09-10T05:57:29.801167+0000","last_clean":"2024-09-10T05:57:29.801167+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:57:29.801167+0000","last_undegraded":"2024-09-10T05:57:29.801167+0000","last_fullsized":"2024-09-10T05:57:29.801167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"74'20","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889656+0000","last_change":"2024-09-10T05:56:23.084361+0000","last_active":"2024-09-10T05:57:29.889656+0000","last_peered":"2024-09-10T05:57:29.889656+0000","last_clean":"2024-09-10T05:57:29.889656+0000","last_became_active":"2024-09-10T05:56:23.020849+0000","last_became_peered":"2024-09-10T05:56:23.020849+0000","last_unstale":"2024-09-10T05:57:29.889656+0000","last_undegraded":"2024-09-10T05:57:29.889656+0000","last_fullsized":"2024-09-10T05:57:29.889656+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:38.911377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888570+0000","last_change":"2024-09-10T05:56:23.035832+0000","last_active":"2024-09-10T05:57:29.888570+0000","last_peered":"2024-09-10T05:57:29.888570+0000","last_clean":"2024-09-10T05:57:29.888570+0000","last_became_active":"2024-09-10T05:56:23.035097+0000","last_became_peered":"2024-09-10T05:56:23.035097+0000","last_unstale":"2024-09-10T05:57:29.888570+0000","last_undegraded":"2024-09-10T05:57:29.888570+0000","last_fullsized":"2024-09-10T05:57:29.888570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:59.003597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802776+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:57:29.802776+0000","last_peered":"2024-09-10T05:57:29.802776+0000","last_clean":"2024-09-10T05:57:29.802776+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:57:29.802776+0000","last_undegraded":"2024-09-10T05:57:29.802776+0000","last_fullsized":"2024-09-10T05:57:29.802776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803080+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:57:29.803080+0000","last_peered":"2024-09-10T05:57:29.803080+0000","last_clean":"2024-09-10T05:57:29.803080+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:57:29.803080+0000","last_undegraded":"2024-09-10T05:57:29.803080+0000","last_fullsized":"2024-09-10T05:57:29.803080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'4","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814596+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:57:30.814596+0000","last_peered":"2024-09-10T05:57:30.814596+0000","last_clean":"2024-09-10T05:57:30.814596+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:57:30.814596+0000","last_undegraded":"2024-09-10T05:57:30.814596+0000","last_fullsized":"2024-09-10T05:57:30.814596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801666+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:57:29.801666+0000","last_peered":"2024-09-10T05:57:29.801666+0000","last_clean":"2024-09-10T05:57:29.801666+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:57:29.801666+0000","last_undegraded":"2024-09-10T05:57:29.801666+0000","last_fullsized":"2024-09-10T05:57:29.801666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"74'32","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811422+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:57:30.811422+0000","last_peered":"2024-09-10T05:57:30.811422+0000","last_clean":"2024-09-10T05:57:30.811422+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:57:30.811422+0000","last_undegraded":"2024-09-10T05:57:30.811422+0000","last_fullsized":"2024-09-10T05:57:30.811422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"80'104","reported_seq":324,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807830+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:57:29.807830+0000","last_peered":"2024-09-10T05:57:29.807830+0000","last_clean":"2024-09-10T05:57:29.807830+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:57:29.807830+0000","last_undegraded":"2024-09-10T05:57:29.807830+0000","last_fullsized":"2024-09-10T05:57:29.807830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809164+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:57:29.809164+0000","last_peered":"2024-09-10T05:57:29.809164+0000","last_clean":"2024-09-10T05:57:29.809164+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:57:29.809164+0000","last_undegraded":"2024-09-10T05:57:29.809164+0000","last_fullsized":"2024-09-10T05:57:29.809164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809896+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:57:29.809896+0000","last_peered":"2024-09-10T05:57:29.809896+0000","last_clean":"2024-09-10T05:57:29.809896+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:57:29.809896+0000","last_undegraded":"2024-09-10T05:57:29.809896+0000","last_fullsized":"2024-09-10T05:57:29.809896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"74'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801575+0000","last_change":"2024-09-10T05:56:59.881419+0000","last_active":"2024-09-10T05:57:29.801575+0000","last_peered":"2024-09-10T05:57:29.801575+0000","last_clean":"2024-09-10T05:57:29.801575+0000","last_became_active":"2024-09-10T05:56:59.839885+0000","last_became_peered":"2024-09-10T05:56:59.839885+0000","last_unstale":"2024-09-10T05:57:29.801575+0000","last_undegraded":"2024-09-10T05:57:29.801575+0000","last_fullsized":"2024-09-10T05:57:29.801575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:00.561931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802156+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:57:29.802156+0000","last_peered":"2024-09-10T05:57:29.802156+0000","last_clean":"2024-09-10T05:57:29.802156+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:57:29.802156+0000","last_undegraded":"2024-09-10T05:57:29.802156+0000","last_fullsized":"2024-09-10T05:57:29.802156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"74'34","reported_seq":179,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808360+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:57:29.808360+0000","last_peered":"2024-09-10T05:57:29.808360+0000","last_clean":"2024-09-10T05:57:29.808360+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:57:29.808360+0000","last_undegraded":"2024-09-10T05:57:29.808360+0000","last_fullsized":"2024-09-10T05:57:29.808360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.800998+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:57:29.800998+0000","last_peered":"2024-09-10T05:57:29.800998+0000","last_clean":"2024-09-10T05:57:29.800998+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:57:29.800998+0000","last_undegraded":"2024-09-10T05:57:29.800998+0000","last_fullsized":"2024-09-10T05:57:29.800998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889887+0000","last_change":"2024-09-10T05:56:23.037024+0000","last_active":"2024-09-10T05:57:29.889887+0000","last_peered":"2024-09-10T05:57:29.889887+0000","last_clean":"2024-09-10T05:57:29.889887+0000","last_became_active":"2024-09-10T05:56:23.036371+0000","last_became_peered":"2024-09-10T05:56:23.036371+0000","last_unstale":"2024-09-10T05:57:29.889887+0000","last_undegraded":"2024-09-10T05:57:29.889887+0000","last_fullsized":"2024-09-10T05:57:29.889887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:18.668696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'2","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.896251+0000","last_change":"2024-09-10T05:56:23.057903+0000","last_active":"2024-09-10T05:57:29.896251+0000","last_peered":"2024-09-10T05:57:29.896251+0000","last_clean":"2024-09-10T05:57:29.896251+0000","last_became_active":"2024-09-10T05:56:23.056044+0000","last_became_peered":"2024-09-10T05:56:23.056044+0000","last_unstale":"2024-09-10T05:57:29.896251+0000","last_undegraded":"2024-09-10T05:57:29.896251+0000","last_fullsized":"2024-09-10T05:57:29.896251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:23.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"72'1","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889835+0000","last_change":"2024-09-10T05:56:23.039960+0000","last_active":"2024-09-10T05:57:29.889835+0000","last_peered":"2024-09-10T05:57:29.889835+0000","last_clean":"2024-09-10T05:57:29.889835+0000","last_became_active":"2024-09-10T05:56:23.027827+0000","last_became_peered":"2024-09-10T05:56:23.027827+0000","last_unstale":"2024-09-10T05:57:29.889835+0000","last_undegraded":"2024-09-10T05:57:29.889835+0000","last_fullsized":"2024-09-10T05:57:29.889835+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:52.667117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801819+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:57:29.801819+0000","last_peered":"2024-09-10T05:57:29.801819+0000","last_clean":"2024-09-10T05:57:29.801819+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:57:29.801819+0000","last_undegraded":"2024-09-10T05:57:29.801819+0000","last_fullsized":"2024-09-10T05:57:29.801819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"74'24","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897806+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:57:29.897806+0000","last_peered":"2024-09-10T05:57:29.897806+0000","last_clean":"2024-09-10T05:57:29.897806+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:57:29.897806+0000","last_undegraded":"2024-09-10T05:57:29.897806+0000","last_fullsized":"2024-09-10T05:57:29.897806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808486+0000","last_change":"2024-09-10T05:56:23.042970+0000","last_active":"2024-09-10T05:57:29.808486+0000","last_peered":"2024-09-10T05:57:29.808486+0000","last_clean":"2024-09-10T05:57:29.808486+0000","last_became_active":"2024-09-10T05:56:23.041811+0000","last_became_peered":"2024-09-10T05:56:23.041811+0000","last_unstale":"2024-09-10T05:57:29.808486+0000","last_undegraded":"2024-09-10T05:57:29.808486+0000","last_fullsized":"2024-09-10T05:57:29.808486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:27.729049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887822+0000","last_change":"2024-09-10T05:56:23.045520+0000","last_active":"2024-09-10T05:57:29.887822+0000","last_peered":"2024-09-10T05:57:29.887822+0000","last_clean":"2024-09-10T05:57:29.887822+0000","last_became_active":"2024-09-10T05:56:23.044502+0000","last_became_peered":"2024-09-10T05:56:23.044502+0000","last_unstale":"2024-09-10T05:57:29.887822+0000","last_undegraded":"2024-09-10T05:57:29.887822+0000","last_fullsized":"2024-09-10T05:57:29.887822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:45.272996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"80'3","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895510+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:57:29.895510+0000","last_peered":"2024-09-10T05:57:29.895510+0000","last_clean":"2024-09-10T05:57:29.895510+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:57:29.895510+0000","last_undegraded":"2024-09-10T05:57:29.895510+0000","last_fullsized":"2024-09-10T05:57:29.895510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"74'6","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803550+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:57:29.803550+0000","last_peered":"2024-09-10T05:57:29.803550+0000","last_clean":"2024-09-10T05:57:29.803550+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:57:29.803550+0000","last_undegraded":"2024-09-10T05:57:29.803550+0000","last_fullsized":"2024-09-10T05:57:29.803550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888209+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:57:29.888209+0000","last_peered":"2024-09-10T05:57:29.888209+0000","last_clean":"2024-09-10T05:57:29.888209+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:57:29.888209+0000","last_undegraded":"2024-09-10T05:57:29.888209+0000","last_fullsized":"2024-09-10T05:57:29.888209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"74'20","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802434+0000","last_change":"2024-09-10T05:56:23.109965+0000","last_active":"2024-09-10T05:57:29.802434+0000","last_peered":"2024-09-10T05:57:29.802434+0000","last_clean":"2024-09-10T05:57:29.802434+0000","last_became_active":"2024-09-10T05:56:23.061551+0000","last_became_peered":"2024-09-10T05:56:23.061551+0000","last_unstale":"2024-09-10T05:57:29.802434+0000","last_undegraded":"2024-09-10T05:57:29.802434+0000","last_fullsized":"2024-09-10T05:57:29.802434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:17.436490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"80'104","reported_seq":258,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802075+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:57:29.802075+0000","last_peered":"2024-09-10T05:57:29.802075+0000","last_clean":"2024-09-10T05:57:29.802075+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:57:29.802075+0000","last_undegraded":"2024-09-10T05:57:29.802075+0000","last_fullsized":"2024-09-10T05:57:29.802075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888129+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:57:29.888129+0000","last_peered":"2024-09-10T05:57:29.888129+0000","last_clean":"2024-09-10T05:57:29.888129+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:57:29.888129+0000","last_undegraded":"2024-09-10T05:57:29.888129+0000","last_fullsized":"2024-09-10T05:57:29.888129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"74'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.898432+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:57:29.898432+0000","last_peered":"2024-09-10T05:57:29.898432+0000","last_clean":"2024-09-10T05:57:29.898432+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:57:29.898432+0000","last_undegraded":"2024-09-10T05:57:29.898432+0000","last_fullsized":"2024-09-10T05:57:29.898432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895639+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:57:29.895639+0000","last_peered":"2024-09-10T05:57:29.895639+0000","last_clean":"2024-09-10T05:57:29.895639+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:57:29.895639+0000","last_undegraded":"2024-09-10T05:57:29.895639+0000","last_fullsized":"2024-09-10T05:57:29.895639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":266,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890243+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:57:29.890243+0000","last_peered":"2024-09-10T05:57:29.890243+0000","last_clean":"2024-09-10T05:57:29.890243+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:57:29.890243+0000","last_undegraded":"2024-09-10T05:57:29.890243+0000","last_fullsized":"2024-09-10T05:57:29.890243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":81,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889676+0000","last_change":"2024-09-10T05:56:23.121112+0000","last_active":"2024-09-10T05:57:29.889676+0000","last_peered":"2024-09-10T05:57:29.889676+0000","last_clean":"2024-09-10T05:57:29.889676+0000","last_became_active":"2024-09-10T05:56:23.025741+0000","last_became_peered":"2024-09-10T05:56:23.025741+0000","last_unstale":"2024-09-10T05:57:29.889676+0000","last_undegraded":"2024-09-10T05:57:29.889676+0000","last_fullsized":"2024-09-10T05:57:29.889676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:43.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"80'104","reported_seq":284,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802946+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:57:29.802946+0000","last_peered":"2024-09-10T05:57:29.802946+0000","last_clean":"2024-09-10T05:57:29.802946+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:57:29.802946+0000","last_undegraded":"2024-09-10T05:57:29.802946+0000","last_fullsized":"2024-09-10T05:57:29.802946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892823+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:57:29.892823+0000","last_peered":"2024-09-10T05:57:29.892823+0000","last_clean":"2024-09-10T05:57:29.892823+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:57:29.892823+0000","last_undegraded":"2024-09-10T05:57:29.892823+0000","last_fullsized":"2024-09-10T05:57:29.892823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890165+0000","last_change":"2024-09-10T05:56:23.037294+0000","last_active":"2024-09-10T05:57:29.890165+0000","last_peered":"2024-09-10T05:57:29.890165+0000","last_clean":"2024-09-10T05:57:29.890165+0000","last_became_active":"2024-09-10T05:56:23.036712+0000","last_became_peered":"2024-09-10T05:56:23.036712+0000","last_unstale":"2024-09-10T05:57:29.890165+0000","last_undegraded":"2024-09-10T05:57:29.890165+0000","last_fullsized":"2024-09-10T05:57:29.890165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:09.211978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"74'2","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887543+0000","last_change":"2024-09-10T05:56:23.052086+0000","last_active":"2024-09-10T05:57:29.887543+0000","last_peered":"2024-09-10T05:57:29.887543+0000","last_clean":"2024-09-10T05:57:29.887543+0000","last_became_active":"2024-09-10T05:56:23.049459+0000","last_became_peered":"2024-09-10T05:56:23.049459+0000","last_unstale":"2024-09-10T05:57:29.887543+0000","last_undegraded":"2024-09-10T05:57:29.887543+0000","last_fullsized":"2024-09-10T05:57:29.887543+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:34.805862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.898171+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:57:29.898171+0000","last_peered":"2024-09-10T05:57:29.898171+0000","last_clean":"2024-09-10T05:57:29.898171+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:57:29.898171+0000","last_undegraded":"2024-09-10T05:57:29.898171+0000","last_fullsized":"2024-09-10T05:57:29.898171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"74'22","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891208+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:57:29.891208+0000","last_peered":"2024-09-10T05:57:29.891208+0000","last_clean":"2024-09-10T05:57:29.891208+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:57:29.891208+0000","last_undegraded":"2024-09-10T05:57:29.891208+0000","last_fullsized":"2024-09-10T05:57:29.891208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802572+0000","last_change":"2024-09-10T05:56:23.050573+0000","last_active":"2024-09-10T05:57:29.802572+0000","last_peered":"2024-09-10T05:57:29.802572+0000","last_clean":"2024-09-10T05:57:29.802572+0000","last_became_active":"2024-09-10T05:56:23.049743+0000","last_became_peered":"2024-09-10T05:56:23.049743+0000","last_unstale":"2024-09-10T05:57:29.802572+0000","last_undegraded":"2024-09-10T05:57:29.802572+0000","last_fullsized":"2024-09-10T05:57:29.802572+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889139+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:57:29.889139+0000","last_peered":"2024-09-10T05:57:29.889139+0000","last_clean":"2024-09-10T05:57:29.889139+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:57:29.889139+0000","last_undegraded":"2024-09-10T05:57:29.889139+0000","last_fullsized":"2024-09-10T05:57:29.889139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'6","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803750+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:57:29.803750+0000","last_peered":"2024-09-10T05:57:29.803750+0000","last_clean":"2024-09-10T05:57:29.803750+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:57:29.803750+0000","last_undegraded":"2024-09-10T05:57:29.803750+0000","last_fullsized":"2024-09-10T05:57:29.803750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":243,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811601+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:57:30.811601+0000","last_peered":"2024-09-10T05:57:30.811601+0000","last_clean":"2024-09-10T05:57:30.811601+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:57:30.811601+0000","last_undegraded":"2024-09-10T05:57:30.811601+0000","last_fullsized":"2024-09-10T05:57:30.811601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890173+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:57:29.890173+0000","last_peered":"2024-09-10T05:57:29.890173+0000","last_clean":"2024-09-10T05:57:29.890173+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:57:29.890173+0000","last_undegraded":"2024-09-10T05:57:29.890173+0000","last_fullsized":"2024-09-10T05:57:29.890173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"72'2","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888677+0000","last_change":"2024-09-10T05:56:23.037052+0000","last_active":"2024-09-10T05:57:29.888677+0000","last_peered":"2024-09-10T05:57:29.888677+0000","last_clean":"2024-09-10T05:57:29.888677+0000","last_became_active":"2024-09-10T05:56:23.036767+0000","last_became_peered":"2024-09-10T05:56:23.036767+0000","last_unstale":"2024-09-10T05:57:29.888677+0000","last_undegraded":"2024-09-10T05:57:29.888677+0000","last_fullsized":"2024-09-10T05:57:29.888677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:09.974956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":130,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812324+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:57:30.812324+0000","last_peered":"2024-09-10T05:57:30.812324+0000","last_clean":"2024-09-10T05:57:30.812324+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:57:30.812324+0000","last_undegraded":"2024-09-10T05:57:30.812324+0000","last_fullsized":"2024-09-10T05:57:30.812324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"74'34","reported_seq":216,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890548+0000","last_change":"2024-09-10T05:56:23.124071+0000","last_active":"2024-09-10T05:57:29.890548+0000","last_peered":"2024-09-10T05:57:29.890548+0000","last_clean":"2024-09-10T05:57:29.890548+0000","last_became_active":"2024-09-10T05:56:23.062515+0000","last_became_peered":"2024-09-10T05:56:23.062515+0000","last_unstale":"2024-09-10T05:57:29.890548+0000","last_undegraded":"2024-09-10T05:57:29.890548+0000","last_fullsized":"2024-09-10T05:57:29.890548+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809234+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:57:29.809234+0000","last_peered":"2024-09-10T05:57:29.809234+0000","last_clean":"2024-09-10T05:57:29.809234+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:57:29.809234+0000","last_undegraded":"2024-09-10T05:57:29.809234+0000","last_fullsized":"2024-09-10T05:57:29.809234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801799+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:57:29.801799+0000","last_peered":"2024-09-10T05:57:29.801799+0000","last_clean":"2024-09-10T05:57:29.801799+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:57:29.801799+0000","last_undegraded":"2024-09-10T05:57:29.801799+0000","last_fullsized":"2024-09-10T05:57:29.801799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809414+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:57:29.809414+0000","last_peered":"2024-09-10T05:57:29.809414+0000","last_clean":"2024-09-10T05:57:29.809414+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:57:29.809414+0000","last_undegraded":"2024-09-10T05:57:29.809414+0000","last_fullsized":"2024-09-10T05:57:29.809414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811351+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:57:30.811351+0000","last_peered":"2024-09-10T05:57:30.811351+0000","last_clean":"2024-09-10T05:57:30.811351+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:57:30.811351+0000","last_undegraded":"2024-09-10T05:57:30.811351+0000","last_fullsized":"2024-09-10T05:57:30.811351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"74'3","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808931+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:57:29.808931+0000","last_peered":"2024-09-10T05:57:29.808931+0000","last_clean":"2024-09-10T05:57:29.808931+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:57:29.808931+0000","last_undegraded":"2024-09-10T05:57:29.808931+0000","last_fullsized":"2024-09-10T05:57:29.808931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892306+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:57:29.892306+0000","last_peered":"2024-09-10T05:57:29.892306+0000","last_clean":"2024-09-10T05:57:29.892306+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:57:29.892306+0000","last_undegraded":"2024-09-10T05:57:29.892306+0000","last_fullsized":"2024-09-10T05:57:29.892306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"80'113","reported_seq":317,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888122+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:57:29.888122+0000","last_peered":"2024-09-10T05:57:29.888122+0000","last_clean":"2024-09-10T05:57:29.888122+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:57:29.888122+0000","last_undegraded":"2024-09-10T05:57:29.888122+0000","last_fullsized":"2024-09-10T05:57:29.888122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":155,"num_read_kb":139,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813887+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:57:30.813887+0000","last_peered":"2024-09-10T05:57:30.813887+0000","last_clean":"2024-09-10T05:57:30.813887+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:57:30.813887+0000","last_undegraded":"2024-09-10T05:57:30.813887+0000","last_fullsized":"2024-09-10T05:57:30.813887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":123,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888571+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:57:29.888571+0000","last_peered":"2024-09-10T05:57:29.888571+0000","last_clean":"2024-09-10T05:57:29.888571+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:57:29.888571+0000","last_undegraded":"2024-09-10T05:57:29.888571+0000","last_fullsized":"2024-09-10T05:57:29.888571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"66'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890250+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:57:29.890250+0000","last_peered":"2024-09-10T05:57:29.890250+0000","last_clean":"2024-09-10T05:57:29.890250+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:57:29.890250+0000","last_undegraded":"2024-09-10T05:57:29.890250+0000","last_fullsized":"2024-09-10T05:57:29.890250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801329+0000","last_change":"2024-09-10T05:56:23.064028+0000","last_active":"2024-09-10T05:57:29.801329+0000","last_peered":"2024-09-10T05:57:29.801329+0000","last_clean":"2024-09-10T05:57:29.801329+0000","last_became_active":"2024-09-10T05:56:23.063737+0000","last_became_peered":"2024-09-10T05:56:23.063737+0000","last_unstale":"2024-09-10T05:57:29.801329+0000","last_undegraded":"2024-09-10T05:57:29.801329+0000","last_fullsized":"2024-09-10T05:57:29.801329+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:13.386211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"74'4","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889558+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:57:29.889558+0000","last_peered":"2024-09-10T05:57:29.889558+0000","last_clean":"2024-09-10T05:57:29.889558+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:57:29.889558+0000","last_undegraded":"2024-09-10T05:57:29.889558+0000","last_fullsized":"2024-09-10T05:57:29.889558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802175+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:57:29.802175+0000","last_peered":"2024-09-10T05:57:29.802175+0000","last_clean":"2024-09-10T05:57:29.802175+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:57:29.802175+0000","last_undegraded":"2024-09-10T05:57:29.802175+0000","last_fullsized":"2024-09-10T05:57:29.802175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":170,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814218+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:57:30.814218+0000","last_peered":"2024-09-10T05:57:30.814218+0000","last_clean":"2024-09-10T05:57:30.814218+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:57:30.814218+0000","last_undegraded":"2024-09-10T05:57:30.814218+0000","last_fullsized":"2024-09-10T05:57:30.814218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808889+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:57:29.808889+0000","last_peered":"2024-09-10T05:57:29.808889+0000","last_clean":"2024-09-10T05:57:29.808889+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:57:29.808889+0000","last_undegraded":"2024-09-10T05:57:29.808889+0000","last_fullsized":"2024-09-10T05:57:29.808889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889059+0000","last_change":"2024-09-10T05:56:23.045091+0000","last_active":"2024-09-10T05:57:29.889059+0000","last_peered":"2024-09-10T05:57:29.889059+0000","last_clean":"2024-09-10T05:57:29.889059+0000","last_became_active":"2024-09-10T05:56:23.037788+0000","last_became_peered":"2024-09-10T05:56:23.037788+0000","last_unstale":"2024-09-10T05:57:29.889059+0000","last_undegraded":"2024-09-10T05:57:29.889059+0000","last_fullsized":"2024-09-10T05:57:29.889059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:15.274180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"80'3","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888438+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:57:29.888438+0000","last_peered":"2024-09-10T05:57:29.888438+0000","last_clean":"2024-09-10T05:57:29.888438+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:57:29.888438+0000","last_undegraded":"2024-09-10T05:57:29.888438+0000","last_fullsized":"2024-09-10T05:57:29.888438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890927+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:57:29.890927+0000","last_peered":"2024-09-10T05:57:29.890927+0000","last_clean":"2024-09-10T05:57:29.890927+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:57:29.890927+0000","last_undegraded":"2024-09-10T05:57:29.890927+0000","last_fullsized":"2024-09-10T05:57:29.890927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"74'6","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894263+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:57:29.894263+0000","last_peered":"2024-09-10T05:57:29.894263+0000","last_clean":"2024-09-10T05:57:29.894263+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:57:29.894263+0000","last_undegraded":"2024-09-10T05:57:29.894263+0000","last_fullsized":"2024-09-10T05:57:29.894263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808236+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:57:29.808236+0000","last_peered":"2024-09-10T05:57:29.808236+0000","last_clean":"2024-09-10T05:57:29.808236+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:57:29.808236+0000","last_undegraded":"2024-09-10T05:57:29.808236+0000","last_fullsized":"2024-09-10T05:57:29.808236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890631+0000","last_change":"2024-09-10T05:56:23.133328+0000","last_active":"2024-09-10T05:57:29.890631+0000","last_peered":"2024-09-10T05:57:29.890631+0000","last_clean":"2024-09-10T05:57:29.890631+0000","last_became_active":"2024-09-10T05:56:23.028081+0000","last_became_peered":"2024-09-10T05:56:23.028081+0000","last_unstale":"2024-09-10T05:57:29.890631+0000","last_undegraded":"2024-09-10T05:57:29.890631+0000","last_fullsized":"2024-09-10T05:57:29.890631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:08.397388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803725+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:57:29.803725+0000","last_peered":"2024-09-10T05:57:29.803725+0000","last_clean":"2024-09-10T05:57:29.803725+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:57:29.803725+0000","last_undegraded":"2024-09-10T05:57:29.803725+0000","last_fullsized":"2024-09-10T05:57:29.803725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889104+0000","last_change":"2024-09-10T05:56:23.065400+0000","last_active":"2024-09-10T05:57:29.889104+0000","last_peered":"2024-09-10T05:57:29.889104+0000","last_clean":"2024-09-10T05:57:29.889104+0000","last_became_active":"2024-09-10T05:56:23.064530+0000","last_became_peered":"2024-09-10T05:56:23.064530+0000","last_unstale":"2024-09-10T05:57:29.889104+0000","last_undegraded":"2024-09-10T05:57:29.889104+0000","last_fullsized":"2024-09-10T05:57:29.889104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:39.048277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801361+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:57:29.801361+0000","last_peered":"2024-09-10T05:57:29.801361+0000","last_clean":"2024-09-10T05:57:29.801361+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:57:29.801361+0000","last_undegraded":"2024-09-10T05:57:29.801361+0000","last_fullsized":"2024-09-10T05:57:29.801361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893475+0000","last_change":"2024-09-10T05:56:23.061131+0000","last_active":"2024-09-10T05:57:29.893475+0000","last_peered":"2024-09-10T05:57:29.893475+0000","last_clean":"2024-09-10T05:57:29.893475+0000","last_became_active":"2024-09-10T05:56:23.059938+0000","last_became_peered":"2024-09-10T05:56:23.059938+0000","last_unstale":"2024-09-10T05:57:29.893475+0000","last_undegraded":"2024-09-10T05:57:29.893475+0000","last_fullsized":"2024-09-10T05:57:29.893475+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:24.743938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888645+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:57:29.888645+0000","last_peered":"2024-09-10T05:57:29.888645+0000","last_clean":"2024-09-10T05:57:29.888645+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:57:29.888645+0000","last_undegraded":"2024-09-10T05:57:29.888645+0000","last_fullsized":"2024-09-10T05:57:29.888645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809533+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:57:29.809533+0000","last_peered":"2024-09-10T05:57:29.809533+0000","last_clean":"2024-09-10T05:57:29.809533+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:57:29.809533+0000","last_undegraded":"2024-09-10T05:57:29.809533+0000","last_fullsized":"2024-09-10T05:57:29.809533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"74'41","reported_seq":246,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809268+0000","last_change":"2024-09-10T05:56:23.082938+0000","last_active":"2024-09-10T05:57:29.809268+0000","last_peered":"2024-09-10T05:57:29.809268+0000","last_clean":"2024-09-10T05:57:29.809268+0000","last_became_active":"2024-09-10T05:56:23.012137+0000","last_became_peered":"2024-09-10T05:56:23.012137+0000","last_unstale":"2024-09-10T05:57:29.809268+0000","last_undegraded":"2024-09-10T05:57:29.809268+0000","last_fullsized":"2024-09-10T05:57:29.809268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:12.650262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888498+0000","last_change":"2024-09-10T05:56:23.057279+0000","last_active":"2024-09-10T05:57:29.888498+0000","last_peered":"2024-09-10T05:57:29.888498+0000","last_clean":"2024-09-10T05:57:29.888498+0000","last_became_active":"2024-09-10T05:56:23.055517+0000","last_became_peered":"2024-09-10T05:56:23.055517+0000","last_unstale":"2024-09-10T05:57:29.888498+0000","last_undegraded":"2024-09-10T05:57:29.888498+0000","last_fullsized":"2024-09-10T05:57:29.888498+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:18.809677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809045+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:57:29.809045+0000","last_peered":"2024-09-10T05:57:29.809045+0000","last_clean":"2024-09-10T05:57:29.809045+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:57:29.809045+0000","last_undegraded":"2024-09-10T05:57:29.809045+0000","last_fullsized":"2024-09-10T05:57:29.809045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809869+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:57:29.809869+0000","last_peered":"2024-09-10T05:57:29.809869+0000","last_clean":"2024-09-10T05:57:29.809869+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:57:29.809869+0000","last_undegraded":"2024-09-10T05:57:29.809869+0000","last_fullsized":"2024-09-10T05:57:29.809869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'7","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888521+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:57:29.888521+0000","last_peered":"2024-09-10T05:57:29.888521+0000","last_clean":"2024-09-10T05:57:29.888521+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:57:29.888521+0000","last_undegraded":"2024-09-10T05:57:29.888521+0000","last_fullsized":"2024-09-10T05:57:29.888521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814796+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:57:30.814796+0000","last_peered":"2024-09-10T05:57:30.814796+0000","last_clean":"2024-09-10T05:57:30.814796+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:57:30.814796+0000","last_undegraded":"2024-09-10T05:57:30.814796+0000","last_fullsized":"2024-09-10T05:57:30.814796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802588+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:57:29.802588+0000","last_peered":"2024-09-10T05:57:29.802588+0000","last_clean":"2024-09-10T05:57:29.802588+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:57:29.802588+0000","last_undegraded":"2024-09-10T05:57:29.802588+0000","last_fullsized":"2024-09-10T05:57:29.802588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887829+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:57:29.887829+0000","last_peered":"2024-09-10T05:57:29.887829+0000","last_clean":"2024-09-10T05:57:29.887829+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:57:29.887829+0000","last_undegraded":"2024-09-10T05:57:29.887829+0000","last_fullsized":"2024-09-10T05:57:29.887829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'104","reported_seq":247,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890120+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:57:29.890120+0000","last_peered":"2024-09-10T05:57:29.890120+0000","last_clean":"2024-09-10T05:57:29.890120+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:57:29.890120+0000","last_undegraded":"2024-09-10T05:57:29.890120+0000","last_fullsized":"2024-09-10T05:57:29.890120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'1","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892115+0000","last_change":"2024-09-10T05:56:23.034838+0000","last_active":"2024-09-10T05:57:29.892115+0000","last_peered":"2024-09-10T05:57:29.892115+0000","last_clean":"2024-09-10T05:57:29.892115+0000","last_became_active":"2024-09-10T05:56:23.034573+0000","last_became_peered":"2024-09-10T05:56:23.034573+0000","last_unstale":"2024-09-10T05:57:29.892115+0000","last_undegraded":"2024-09-10T05:57:29.892115+0000","last_fullsized":"2024-09-10T05:57:29.892115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:49.615870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887442+0000","last_change":"2024-09-10T05:56:23.008780+0000","last_active":"2024-09-10T05:57:29.887442+0000","last_peered":"2024-09-10T05:57:29.887442+0000","last_clean":"2024-09-10T05:57:29.887442+0000","last_became_active":"2024-09-10T05:56:23.008366+0000","last_became_peered":"2024-09-10T05:56:23.008366+0000","last_unstale":"2024-09-10T05:57:29.887442+0000","last_undegraded":"2024-09-10T05:57:29.887442+0000","last_fullsized":"2024-09-10T05:57:29.887442+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:13.265099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"74'2","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891792+0000","last_change":"2024-09-10T05:56:23.008892+0000","last_active":"2024-09-10T05:57:29.891792+0000","last_peered":"2024-09-10T05:57:29.891792+0000","last_clean":"2024-09-10T05:57:29.891792+0000","last_became_active":"2024-09-10T05:56:23.008313+0000","last_became_peered":"2024-09-10T05:56:23.008313+0000","last_unstale":"2024-09-10T05:57:29.891792+0000","last_undegraded":"2024-09-10T05:57:29.891792+0000","last_fullsized":"2024-09-10T05:57:29.891792+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:27.800265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890692+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:57:29.890692+0000","last_peered":"2024-09-10T05:57:29.890692+0000","last_clean":"2024-09-10T05:57:29.890692+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:57:29.890692+0000","last_undegraded":"2024-09-10T05:57:29.890692+0000","last_fullsized":"2024-09-10T05:57:29.890692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892043+0000","last_change":"2024-09-10T05:56:23.057234+0000","last_active":"2024-09-10T05:57:29.892043+0000","last_peered":"2024-09-10T05:57:29.892043+0000","last_clean":"2024-09-10T05:57:29.892043+0000","last_became_active":"2024-09-10T05:56:23.056440+0000","last_became_peered":"2024-09-10T05:56:23.056440+0000","last_unstale":"2024-09-10T05:57:29.892043+0000","last_undegraded":"2024-09-10T05:57:29.892043+0000","last_fullsized":"2024-09-10T05:57:29.892043+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:40.029847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":189,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893350+0000","last_change":"2024-09-10T05:56:23.097232+0000","last_active":"2024-09-10T05:57:29.893350+0000","last_peered":"2024-09-10T05:57:29.893350+0000","last_clean":"2024-09-10T05:57:29.893350+0000","last_became_active":"2024-09-10T05:56:23.058304+0000","last_became_peered":"2024-09-10T05:56:23.058304+0000","last_unstale":"2024-09-10T05:57:29.893350+0000","last_undegraded":"2024-09-10T05:57:29.893350+0000","last_fullsized":"2024-09-10T05:57:29.893350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:19.449857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"80'106","reported_seq":191,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889746+0000","last_change":"2024-09-10T05:56:23.135596+0000","last_active":"2024-09-10T05:57:29.889746+0000","last_peered":"2024-09-10T05:57:29.889746+0000","last_clean":"2024-09-10T05:57:29.889746+0000","last_became_active":"2024-09-10T05:56:23.040743+0000","last_became_peered":"2024-09-10T05:56:23.040743+0000","last_unstale":"2024-09-10T05:57:29.889746+0000","last_undegraded":"2024-09-10T05:57:29.889746+0000","last_fullsized":"2024-09-10T05:57:29.889746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:19.913543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808960+0000","last_change":"2024-09-10T05:56:23.051198+0000","last_active":"2024-09-10T05:57:29.808960+0000","last_peered":"2024-09-10T05:57:29.808960+0000","last_clean":"2024-09-10T05:57:29.808960+0000","last_became_active":"2024-09-10T05:56:23.050845+0000","last_became_peered":"2024-09-10T05:56:23.050845+0000","last_unstale":"2024-09-10T05:57:29.808960+0000","last_undegraded":"2024-09-10T05:57:29.808960+0000","last_fullsized":"2024-09-10T05:57:29.808960+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:06.435647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894889+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:57:29.894889+0000","last_peered":"2024-09-10T05:57:29.894889+0000","last_clean":"2024-09-10T05:57:29.894889+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:57:29.894889+0000","last_undegraded":"2024-09-10T05:57:29.894889+0000","last_fullsized":"2024-09-10T05:57:29.894889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"74'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809574+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:57:29.809574+0000","last_peered":"2024-09-10T05:57:29.809574+0000","last_clean":"2024-09-10T05:57:29.809574+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:57:29.809574+0000","last_undegraded":"2024-09-10T05:57:29.809574+0000","last_fullsized":"2024-09-10T05:57:29.809574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.804469+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:57:29.804469+0000","last_peered":"2024-09-10T05:57:29.804469+0000","last_clean":"2024-09-10T05:57:29.804469+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:57:29.804469+0000","last_undegraded":"2024-09-10T05:57:29.804469+0000","last_fullsized":"2024-09-10T05:57:29.804469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888218+0000","last_change":"2024-09-10T05:56:23.052359+0000","last_active":"2024-09-10T05:57:29.888218+0000","last_peered":"2024-09-10T05:57:29.888218+0000","last_clean":"2024-09-10T05:57:29.888218+0000","last_became_active":"2024-09-10T05:56:23.049786+0000","last_became_peered":"2024-09-10T05:56:23.049786+0000","last_unstale":"2024-09-10T05:57:29.888218+0000","last_undegraded":"2024-09-10T05:57:29.888218+0000","last_fullsized":"2024-09-10T05:57:29.888218+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:49.134672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"74'41","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812201+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:57:30.812201+0000","last_peered":"2024-09-10T05:57:30.812201+0000","last_clean":"2024-09-10T05:57:30.812201+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:57:30.812201+0000","last_undegraded":"2024-09-10T05:57:30.812201+0000","last_fullsized":"2024-09-10T05:57:30.812201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888796+0000","last_change":"2024-09-10T05:56:23.052211+0000","last_active":"2024-09-10T05:57:29.888796+0000","last_peered":"2024-09-10T05:57:29.888796+0000","last_clean":"2024-09-10T05:57:29.888796+0000","last_became_active":"2024-09-10T05:56:23.051916+0000","last_became_peered":"2024-09-10T05:56:23.051916+0000","last_unstale":"2024-09-10T05:57:29.888796+0000","last_undegraded":"2024-09-10T05:57:29.888796+0000","last_fullsized":"2024-09-10T05:57:29.888796+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:56.921238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890930+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:57:29.890930+0000","last_peered":"2024-09-10T05:57:29.890930+0000","last_clean":"2024-09-10T05:57:29.890930+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:57:29.890930+0000","last_undegraded":"2024-09-10T05:57:29.890930+0000","last_fullsized":"2024-09-10T05:57:29.890930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808362+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:57:29.808362+0000","last_peered":"2024-09-10T05:57:29.808362+0000","last_clean":"2024-09-10T05:57:29.808362+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:57:29.808362+0000","last_undegraded":"2024-09-10T05:57:29.808362+0000","last_fullsized":"2024-09-10T05:57:29.808362+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893346+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:57:29.893346+0000","last_peered":"2024-09-10T05:57:29.893346+0000","last_clean":"2024-09-10T05:57:29.893346+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:57:29.893346+0000","last_undegraded":"2024-09-10T05:57:29.893346+0000","last_fullsized":"2024-09-10T05:57:29.893346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895615+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:57:29.895615+0000","last_peered":"2024-09-10T05:57:29.895615+0000","last_clean":"2024-09-10T05:57:29.895615+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:57:29.895615+0000","last_undegraded":"2024-09-10T05:57:29.895615+0000","last_fullsized":"2024-09-10T05:57:29.895615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888893+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:57:29.888893+0000","last_peered":"2024-09-10T05:57:29.888893+0000","last_clean":"2024-09-10T05:57:29.888893+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:57:29.888893+0000","last_undegraded":"2024-09-10T05:57:29.888893+0000","last_fullsized":"2024-09-10T05:57:29.888893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"74'23","reported_seq":89,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887635+0000","last_change":"2024-09-10T05:56:23.074045+0000","last_active":"2024-09-10T05:57:29.887635+0000","last_peered":"2024-09-10T05:57:29.887635+0000","last_clean":"2024-09-10T05:57:29.887635+0000","last_became_active":"2024-09-10T05:56:23.019631+0000","last_became_peered":"2024-09-10T05:56:23.019631+0000","last_unstale":"2024-09-10T05:57:29.887635+0000","last_undegraded":"2024-09-10T05:57:29.887635+0000","last_fullsized":"2024-09-10T05:57:29.887635+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:54.559625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887635+0000","last_change":"2024-09-10T05:56:23.045936+0000","last_active":"2024-09-10T05:57:29.887635+0000","last_peered":"2024-09-10T05:57:29.887635+0000","last_clean":"2024-09-10T05:57:29.887635+0000","last_became_active":"2024-09-10T05:56:23.038258+0000","last_became_peered":"2024-09-10T05:56:23.038258+0000","last_unstale":"2024-09-10T05:57:29.887635+0000","last_undegraded":"2024-09-10T05:57:29.887635+0000","last_fullsized":"2024-09-10T05:57:29.887635+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.439503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891020+0000","last_change":"2024-09-10T05:56:23.017188+0000","last_active":"2024-09-10T05:57:29.891020+0000","last_peered":"2024-09-10T05:57:29.891020+0000","last_clean":"2024-09-10T05:57:29.891020+0000","last_became_active":"2024-09-10T05:56:23.016931+0000","last_became_peered":"2024-09-10T05:56:23.016931+0000","last_unstale":"2024-09-10T05:57:29.891020+0000","last_undegraded":"2024-09-10T05:57:29.891020+0000","last_fullsized":"2024-09-10T05:57:29.891020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:27.661737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888811+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:57:29.888811+0000","last_peered":"2024-09-10T05:57:29.888811+0000","last_clean":"2024-09-10T05:57:29.888811+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:57:29.888811+0000","last_undegraded":"2024-09-10T05:57:29.888811+0000","last_fullsized":"2024-09-10T05:57:29.888811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"74'5","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814502+0000","last_change":"2024-09-10T05:56:23.021907+0000","last_active":"2024-09-10T05:57:30.814502+0000","last_peered":"2024-09-10T05:57:30.814502+0000","last_clean":"2024-09-10T05:57:30.814502+0000","last_became_active":"2024-09-10T05:56:23.021259+0000","last_became_peered":"2024-09-10T05:56:23.021259+0000","last_unstale":"2024-09-10T05:57:30.814502+0000","last_undegraded":"2024-09-10T05:57:30.814502+0000","last_fullsized":"2024-09-10T05:57:30.814502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:14.123922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889150+0000","last_change":"2024-09-10T05:56:23.031916+0000","last_active":"2024-09-10T05:57:29.889150+0000","last_peered":"2024-09-10T05:57:29.889150+0000","last_clean":"2024-09-10T05:57:29.889150+0000","last_became_active":"2024-09-10T05:56:23.027500+0000","last_became_peered":"2024-09-10T05:56:23.027500+0000","last_unstale":"2024-09-10T05:57:29.889150+0000","last_undegraded":"2024-09-10T05:57:29.889150+0000","last_fullsized":"2024-09-10T05:57:29.889150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:46.438549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"74'6","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807724+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:57:29.807724+0000","last_peered":"2024-09-10T05:57:29.807724+0000","last_clean":"2024-09-10T05:57:29.807724+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:57:29.807724+0000","last_undegraded":"2024-09-10T05:57:29.807724+0000","last_fullsized":"2024-09-10T05:57:29.807724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811414+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:57:30.811414+0000","last_peered":"2024-09-10T05:57:30.811414+0000","last_clean":"2024-09-10T05:57:30.811414+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:57:30.811414+0000","last_undegraded":"2024-09-10T05:57:30.811414+0000","last_fullsized":"2024-09-10T05:57:30.811414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808106+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:57:29.808106+0000","last_peered":"2024-09-10T05:57:29.808106+0000","last_clean":"2024-09-10T05:57:29.808106+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:57:29.808106+0000","last_undegraded":"2024-09-10T05:57:29.808106+0000","last_fullsized":"2024-09-10T05:57:29.808106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'5","reported_seq":89,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887749+0000","last_change":"2024-09-10T05:56:23.018017+0000","last_active":"2024-09-10T05:57:29.887749+0000","last_peered":"2024-09-10T05:57:29.887749+0000","last_clean":"2024-09-10T05:57:29.887749+0000","last_became_active":"2024-09-10T05:56:23.008084+0000","last_became_peered":"2024-09-10T05:56:23.008084+0000","last_unstale":"2024-09-10T05:57:29.887749+0000","last_undegraded":"2024-09-10T05:57:29.887749+0000","last_fullsized":"2024-09-10T05:57:29.887749+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:37.245150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892557+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:57:29.892557+0000","last_peered":"2024-09-10T05:57:29.892557+0000","last_clean":"2024-09-10T05:57:29.892557+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:57:29.892557+0000","last_undegraded":"2024-09-10T05:57:29.892557+0000","last_fullsized":"2024-09-10T05:57:29.892557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.810784+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:57:30.810784+0000","last_peered":"2024-09-10T05:57:30.810784+0000","last_clean":"2024-09-10T05:57:30.810784+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:57:30.810784+0000","last_undegraded":"2024-09-10T05:57:30.810784+0000","last_fullsized":"2024-09-10T05:57:30.810784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"74'17","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889469+0000","last_change":"2024-09-10T05:56:23.144815+0000","last_active":"2024-09-10T05:57:29.889469+0000","last_peered":"2024-09-10T05:57:29.889469+0000","last_clean":"2024-09-10T05:57:29.889469+0000","last_became_active":"2024-09-10T05:56:23.041150+0000","last_became_peered":"2024-09-10T05:56:23.041150+0000","last_unstale":"2024-09-10T05:57:29.889469+0000","last_undegraded":"2024-09-10T05:57:29.889469+0000","last_fullsized":"2024-09-10T05:57:29.889469+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:26.741208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803709+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:57:29.803709+0000","last_peered":"2024-09-10T05:57:29.803709+0000","last_clean":"2024-09-10T05:57:29.803709+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:57:29.803709+0000","last_undegraded":"2024-09-10T05:57:29.803709+0000","last_fullsized":"2024-09-10T05:57:29.803709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"74'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890506+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:57:29.890506+0000","last_peered":"2024-09-10T05:57:29.890506+0000","last_clean":"2024-09-10T05:57:29.890506+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:57:29.890506+0000","last_undegraded":"2024-09-10T05:57:29.890506+0000","last_fullsized":"2024-09-10T05:57:29.890506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887930+0000","last_change":"2024-09-10T05:56:23.052761+0000","last_active":"2024-09-10T05:57:29.887930+0000","last_peered":"2024-09-10T05:57:29.887930+0000","last_clean":"2024-09-10T05:57:29.887930+0000","last_became_active":"2024-09-10T05:56:23.049110+0000","last_became_peered":"2024-09-10T05:56:23.049110+0000","last_unstale":"2024-09-10T05:57:29.887930+0000","last_undegraded":"2024-09-10T05:57:29.887930+0000","last_fullsized":"2024-09-10T05:57:29.887930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:44.011144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808893+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:57:29.808893+0000","last_peered":"2024-09-10T05:57:29.808893+0000","last_clean":"2024-09-10T05:57:29.808893+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:57:29.808893+0000","last_undegraded":"2024-09-10T05:57:29.808893+0000","last_fullsized":"2024-09-10T05:57:29.808893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802204+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:57:29.802204+0000","last_peered":"2024-09-10T05:57:29.802204+0000","last_clean":"2024-09-10T05:57:29.802204+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:57:29.802204+0000","last_undegraded":"2024-09-10T05:57:29.802204+0000","last_fullsized":"2024-09-10T05:57:29.802204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"74'14","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811380+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:57:30.811380+0000","last_peered":"2024-09-10T05:57:30.811380+0000","last_clean":"2024-09-10T05:57:30.811380+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:57:30.811380+0000","last_undegraded":"2024-09-10T05:57:30.811380+0000","last_fullsized":"2024-09-10T05:57:30.811380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809160+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:57:29.809160+0000","last_peered":"2024-09-10T05:57:29.809160+0000","last_clean":"2024-09-10T05:57:29.809160+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:57:29.809160+0000","last_undegraded":"2024-09-10T05:57:29.809160+0000","last_fullsized":"2024-09-10T05:57:29.809160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'5","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.804390+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:57:29.804390+0000","last_peered":"2024-09-10T05:57:29.804390+0000","last_clean":"2024-09-10T05:57:29.804390+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:57:29.804390+0000","last_undegraded":"2024-09-10T05:57:29.804390+0000","last_fullsized":"2024-09-10T05:57:29.804390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"74'8","reported_seq":77,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887723+0000","last_change":"2024-09-10T05:56:23.010745+0000","last_active":"2024-09-10T05:57:29.887723+0000","last_peered":"2024-09-10T05:57:29.887723+0000","last_clean":"2024-09-10T05:57:29.887723+0000","last_became_active":"2024-09-10T05:56:23.010466+0000","last_became_peered":"2024-09-10T05:56:23.010466+0000","last_unstale":"2024-09-10T05:57:29.887723+0000","last_undegraded":"2024-09-10T05:57:29.887723+0000","last_fullsized":"2024-09-10T05:57:29.887723+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:12.448397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809328+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:57:29.809328+0000","last_peered":"2024-09-10T05:57:29.809328+0000","last_clean":"2024-09-10T05:57:29.809328+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:57:29.809328+0000","last_undegraded":"2024-09-10T05:57:29.809328+0000","last_fullsized":"2024-09-10T05:57:29.809328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"74'31","reported_seq":170,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888840+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:57:29.888840+0000","last_peered":"2024-09-10T05:57:29.888840+0000","last_clean":"2024-09-10T05:57:29.888840+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:57:29.888840+0000","last_undegraded":"2024-09-10T05:57:29.888840+0000","last_fullsized":"2024-09-10T05:57:29.888840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890912+0000","last_change":"2024-09-10T05:56:23.065281+0000","last_active":"2024-09-10T05:57:29.890912+0000","last_peered":"2024-09-10T05:57:29.890912+0000","last_clean":"2024-09-10T05:57:29.890912+0000","last_became_active":"2024-09-10T05:56:23.064464+0000","last_became_peered":"2024-09-10T05:56:23.064464+0000","last_unstale":"2024-09-10T05:57:29.890912+0000","last_undegraded":"2024-09-10T05:57:29.890912+0000","last_fullsized":"2024-09-10T05:57:29.890912+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:21.392647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889230+0000","last_change":"2024-09-10T05:56:23.045151+0000","last_active":"2024-09-10T05:57:29.889230+0000","last_peered":"2024-09-10T05:57:29.889230+0000","last_clean":"2024-09-10T05:57:29.889230+0000","last_became_active":"2024-09-10T05:56:23.040353+0000","last_became_peered":"2024-09-10T05:56:23.040353+0000","last_unstale":"2024-09-10T05:57:29.889230+0000","last_undegraded":"2024-09-10T05:57:29.889230+0000","last_fullsized":"2024-09-10T05:57:29.889230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:43.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809386+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:57:29.809386+0000","last_peered":"2024-09-10T05:57:29.809386+0000","last_clean":"2024-09-10T05:57:29.809386+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:57:29.809386+0000","last_undegraded":"2024-09-10T05:57:29.809386+0000","last_fullsized":"2024-09-10T05:57:29.809386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"74'8","reported_seq":154,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888464+0000","last_change":"2024-09-10T05:56:23.050367+0000","last_active":"2024-09-10T05:57:29.888464+0000","last_peered":"2024-09-10T05:57:29.888464+0000","last_clean":"2024-09-10T05:57:29.888464+0000","last_became_active":"2024-09-10T05:56:23.050069+0000","last_became_peered":"2024-09-10T05:56:23.050069+0000","last_unstale":"2024-09-10T05:57:29.888464+0000","last_undegraded":"2024-09-10T05:57:29.888464+0000","last_fullsized":"2024-09-10T05:57:29.888464+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:04.360756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.804073+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:57:29.804073+0000","last_peered":"2024-09-10T05:57:29.804073+0000","last_clean":"2024-09-10T05:57:29.804073+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:57:29.804073+0000","last_undegraded":"2024-09-10T05:57:29.804073+0000","last_fullsized":"2024-09-10T05:57:29.804073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"74'20","reported_seq":155,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811961+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:57:30.811961+0000","last_peered":"2024-09-10T05:57:30.811961+0000","last_clean":"2024-09-10T05:57:30.811961+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:57:30.811961+0000","last_undegraded":"2024-09-10T05:57:30.811961+0000","last_fullsized":"2024-09-10T05:57:30.811961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889021+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:57:29.889021+0000","last_peered":"2024-09-10T05:57:29.889021+0000","last_clean":"2024-09-10T05:57:29.889021+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:57:29.889021+0000","last_undegraded":"2024-09-10T05:57:29.889021+0000","last_fullsized":"2024-09-10T05:57:29.889021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802193+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:57:29.802193+0000","last_peered":"2024-09-10T05:57:29.802193+0000","last_clean":"2024-09-10T05:57:29.802193+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:57:29.802193+0000","last_undegraded":"2024-09-10T05:57:29.802193+0000","last_fullsized":"2024-09-10T05:57:29.802193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890373+0000","last_change":"2024-09-10T05:56:23.045737+0000","last_active":"2024-09-10T05:57:29.890373+0000","last_peered":"2024-09-10T05:57:29.890373+0000","last_clean":"2024-09-10T05:57:29.890373+0000","last_became_active":"2024-09-10T05:56:23.045444+0000","last_became_peered":"2024-09-10T05:56:23.045444+0000","last_unstale":"2024-09-10T05:57:29.890373+0000","last_undegraded":"2024-09-10T05:57:29.890373+0000","last_fullsized":"2024-09-10T05:57:29.890373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:30.592439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"74'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894130+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:57:29.894130+0000","last_peered":"2024-09-10T05:57:29.894130+0000","last_clean":"2024-09-10T05:57:29.894130+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:57:29.894130+0000","last_undegraded":"2024-09-10T05:57:29.894130+0000","last_fullsized":"2024-09-10T05:57:29.894130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":216,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897527+0000","last_change":"2024-09-10T05:56:23.127993+0000","last_active":"2024-09-10T05:57:29.897527+0000","last_peered":"2024-09-10T05:57:29.897527+0000","last_clean":"2024-09-10T05:57:29.897527+0000","last_became_active":"2024-09-10T05:56:23.062056+0000","last_became_peered":"2024-09-10T05:56:23.062056+0000","last_unstale":"2024-09-10T05:57:29.897527+0000","last_undegraded":"2024-09-10T05:57:29.897527+0000","last_fullsized":"2024-09-10T05:57:29.897527+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:40.985541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"74'24","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891681+0000","last_change":"2024-09-10T05:56:23.107948+0000","last_active":"2024-09-10T05:57:29.891681+0000","last_peered":"2024-09-10T05:57:29.891681+0000","last_clean":"2024-09-10T05:57:29.891681+0000","last_became_active":"2024-09-10T05:56:23.025431+0000","last_became_peered":"2024-09-10T05:56:23.025431+0000","last_unstale":"2024-09-10T05:57:29.891681+0000","last_undegraded":"2024-09-10T05:57:29.891681+0000","last_fullsized":"2024-09-10T05:57:29.891681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:02.951376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887817+0000","last_change":"2024-09-10T05:56:23.016482+0000","last_active":"2024-09-10T05:57:29.887817+0000","last_peered":"2024-09-10T05:57:29.887817+0000","last_clean":"2024-09-10T05:57:29.887817+0000","last_became_active":"2024-09-10T05:56:23.015986+0000","last_became_peered":"2024-09-10T05:56:23.015986+0000","last_unstale":"2024-09-10T05:57:29.887817+0000","last_undegraded":"2024-09-10T05:57:29.887817+0000","last_fullsized":"2024-09-10T05:57:29.887817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:20.881180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889565+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:57:29.889565+0000","last_peered":"2024-09-10T05:57:29.889565+0000","last_clean":"2024-09-10T05:57:29.889565+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:57:29.889565+0000","last_undegraded":"2024-09-10T05:57:29.889565+0000","last_fullsized":"2024-09-10T05:57:29.889565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802037+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:57:29.802037+0000","last_peered":"2024-09-10T05:57:29.802037+0000","last_clean":"2024-09-10T05:57:29.802037+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:57:29.802037+0000","last_undegraded":"2024-09-10T05:57:29.802037+0000","last_fullsized":"2024-09-10T05:57:29.802037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"74'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809274+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:57:29.809274+0000","last_peered":"2024-09-10T05:57:29.809274+0000","last_clean":"2024-09-10T05:57:29.809274+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:57:29.809274+0000","last_undegraded":"2024-09-10T05:57:29.809274+0000","last_fullsized":"2024-09-10T05:57:29.809274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889187+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:57:29.889187+0000","last_peered":"2024-09-10T05:57:29.889187+0000","last_clean":"2024-09-10T05:57:29.889187+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:57:29.889187+0000","last_undegraded":"2024-09-10T05:57:29.889187+0000","last_fullsized":"2024-09-10T05:57:29.889187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897963+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:57:29.897963+0000","last_peered":"2024-09-10T05:57:29.897963+0000","last_clean":"2024-09-10T05:57:29.897963+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:57:29.897963+0000","last_undegraded":"2024-09-10T05:57:29.897963+0000","last_fullsized":"2024-09-10T05:57:29.897963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"80'104","reported_seq":246,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803220+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:57:29.803220+0000","last_peered":"2024-09-10T05:57:29.803220+0000","last_clean":"2024-09-10T05:57:29.803220+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:57:29.803220+0000","last_undegraded":"2024-09-10T05:57:29.803220+0000","last_fullsized":"2024-09-10T05:57:29.803220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.810783+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:57:30.810783+0000","last_peered":"2024-09-10T05:57:30.810783+0000","last_clean":"2024-09-10T05:57:30.810783+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:57:30.810783+0000","last_undegraded":"2024-09-10T05:57:30.810783+0000","last_fullsized":"2024-09-10T05:57:30.810783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893072+0000","last_change":"2024-09-10T05:56:23.057534+0000","last_active":"2024-09-10T05:57:29.893072+0000","last_peered":"2024-09-10T05:57:29.893072+0000","last_clean":"2024-09-10T05:57:29.893072+0000","last_became_active":"2024-09-10T05:56:23.055973+0000","last_became_peered":"2024-09-10T05:56:23.055973+0000","last_unstale":"2024-09-10T05:57:29.893072+0000","last_undegraded":"2024-09-10T05:57:29.893072+0000","last_fullsized":"2024-09-10T05:57:29.893072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:25.497531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"74'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891286+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:57:29.891286+0000","last_peered":"2024-09-10T05:57:29.891286+0000","last_clean":"2024-09-10T05:57:29.891286+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:57:29.891286+0000","last_undegraded":"2024-09-10T05:57:29.891286+0000","last_fullsized":"2024-09-10T05:57:29.891286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811659+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:57:30.811659+0000","last_peered":"2024-09-10T05:57:30.811659+0000","last_clean":"2024-09-10T05:57:30.811659+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:57:30.811659+0000","last_undegraded":"2024-09-10T05:57:30.811659+0000","last_fullsized":"2024-09-10T05:57:30.811659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"74'44","reported_seq":200,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890002+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:57:29.890002+0000","last_peered":"2024-09-10T05:57:29.890002+0000","last_clean":"2024-09-10T05:57:29.890002+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:57:29.890002+0000","last_undegraded":"2024-09-10T05:57:29.890002+0000","last_fullsized":"2024-09-10T05:57:29.890002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807504+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:57:29.807504+0000","last_peered":"2024-09-10T05:57:29.807504+0000","last_clean":"2024-09-10T05:57:29.807504+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:57:29.807504+0000","last_undegraded":"2024-09-10T05:57:29.807504+0000","last_fullsized":"2024-09-10T05:57:29.807504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":117,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813522+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:57:30.813522+0000","last_peered":"2024-09-10T05:57:30.813522+0000","last_clean":"2024-09-10T05:57:30.813522+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:57:30.813522+0000","last_undegraded":"2024-09-10T05:57:30.813522+0000","last_fullsized":"2024-09-10T05:57:30.813522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"66'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893458+0000","last_change":"2024-09-10T05:56:59.849209+0000","last_active":"2024-09-10T05:57:29.893458+0000","last_peered":"2024-09-10T05:57:29.893458+0000","last_clean":"2024-09-10T05:57:29.893458+0000","last_became_active":"2024-09-10T05:56:59.844131+0000","last_became_peered":"2024-09-10T05:56:59.844131+0000","last_unstale":"2024-09-10T05:57:29.893458+0000","last_undegraded":"2024-09-10T05:57:29.893458+0000","last_fullsized":"2024-09-10T05:57:29.893458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:41.776545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"73'3","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893270+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:57:29.893270+0000","last_peered":"2024-09-10T05:57:29.893270+0000","last_clean":"2024-09-10T05:57:29.893270+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:57:29.893270+0000","last_undegraded":"2024-09-10T05:57:29.893270+0000","last_fullsized":"2024-09-10T05:57:29.893270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889753+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:57:29.889753+0000","last_peered":"2024-09-10T05:57:29.889753+0000","last_clean":"2024-09-10T05:57:29.889753+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:57:29.889753+0000","last_undegraded":"2024-09-10T05:57:29.889753+0000","last_fullsized":"2024-09-10T05:57:29.889753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"74'20","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807507+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:57:29.807507+0000","last_peered":"2024-09-10T05:57:29.807507+0000","last_clean":"2024-09-10T05:57:29.807507+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:57:29.807507+0000","last_undegraded":"2024-09-10T05:57:29.807507+0000","last_fullsized":"2024-09-10T05:57:29.807507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801953+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:57:29.801953+0000","last_peered":"2024-09-10T05:57:29.801953+0000","last_clean":"2024-09-10T05:57:29.801953+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:57:29.801953+0000","last_undegraded":"2024-09-10T05:57:29.801953+0000","last_fullsized":"2024-09-10T05:57:29.801953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890853+0000","last_change":"2024-09-10T05:56:23.034843+0000","last_active":"2024-09-10T05:57:29.890853+0000","last_peered":"2024-09-10T05:57:29.890853+0000","last_clean":"2024-09-10T05:57:29.890853+0000","last_became_active":"2024-09-10T05:56:23.033226+0000","last_became_peered":"2024-09-10T05:56:23.033226+0000","last_unstale":"2024-09-10T05:57:29.890853+0000","last_undegraded":"2024-09-10T05:57:29.890853+0000","last_fullsized":"2024-09-10T05:57:29.890853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:40.377323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888020+0000","last_change":"2024-09-10T05:56:23.034224+0000","last_active":"2024-09-10T05:57:29.888020+0000","last_peered":"2024-09-10T05:57:29.888020+0000","last_clean":"2024-09-10T05:57:29.888020+0000","last_became_active":"2024-09-10T05:56:23.033976+0000","last_became_peered":"2024-09-10T05:56:23.033976+0000","last_unstale":"2024-09-10T05:57:29.888020+0000","last_undegraded":"2024-09-10T05:57:29.888020+0000","last_fullsized":"2024-09-10T05:57:29.888020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:30.677812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"74'5","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890742+0000","last_change":"2024-09-10T05:56:23.026756+0000","last_active":"2024-09-10T05:57:29.890742+0000","last_peered":"2024-09-10T05:57:29.890742+0000","last_clean":"2024-09-10T05:57:29.890742+0000","last_became_active":"2024-09-10T05:56:23.026265+0000","last_became_peered":"2024-09-10T05:56:23.026265+0000","last_unstale":"2024-09-10T05:57:29.890742+0000","last_undegraded":"2024-09-10T05:57:29.890742+0000","last_fullsized":"2024-09-10T05:57:29.890742+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.455768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888794+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:57:29.888794+0000","last_peered":"2024-09-10T05:57:29.888794+0000","last_clean":"2024-09-10T05:57:29.888794+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:57:29.888794+0000","last_undegraded":"2024-09-10T05:57:29.888794+0000","last_fullsized":"2024-09-10T05:57:29.888794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"74'16","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889562+0000","last_change":"2024-09-10T05:56:23.093611+0000","last_active":"2024-09-10T05:57:29.889562+0000","last_peered":"2024-09-10T05:57:29.889562+0000","last_clean":"2024-09-10T05:57:29.889562+0000","last_became_active":"2024-09-10T05:56:23.021588+0000","last_became_peered":"2024-09-10T05:56:23.021588+0000","last_unstale":"2024-09-10T05:57:29.889562+0000","last_undegraded":"2024-09-10T05:57:29.889562+0000","last_fullsized":"2024-09-10T05:57:29.889562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:05.418407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892041+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:57:29.892041+0000","last_peered":"2024-09-10T05:57:29.892041+0000","last_clean":"2024-09-10T05:57:29.892041+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:57:29.892041+0000","last_undegraded":"2024-09-10T05:57:29.892041+0000","last_fullsized":"2024-09-10T05:57:29.892041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814092+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:57:30.814092+0000","last_peered":"2024-09-10T05:57:30.814092+0000","last_clean":"2024-09-10T05:57:30.814092+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:57:30.814092+0000","last_undegraded":"2024-09-10T05:57:30.814092+0000","last_fullsized":"2024-09-10T05:57:30.814092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889523+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:57:29.889523+0000","last_peered":"2024-09-10T05:57:29.889523+0000","last_clean":"2024-09-10T05:57:29.889523+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:57:29.889523+0000","last_undegraded":"2024-09-10T05:57:29.889523+0000","last_fullsized":"2024-09-10T05:57:29.889523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"73'2","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802331+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:57:29.802331+0000","last_peered":"2024-09-10T05:57:29.802331+0000","last_clean":"2024-09-10T05:57:29.802331+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:57:29.802331+0000","last_undegraded":"2024-09-10T05:57:29.802331+0000","last_fullsized":"2024-09-10T05:57:29.802331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887930+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:57:29.887930+0000","last_peered":"2024-09-10T05:57:29.887930+0000","last_clean":"2024-09-10T05:57:29.887930+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:57:29.887930+0000","last_undegraded":"2024-09-10T05:57:29.887930+0000","last_fullsized":"2024-09-10T05:57:29.887930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"74'27","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892435+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:57:29.892435+0000","last_peered":"2024-09-10T05:57:29.892435+0000","last_clean":"2024-09-10T05:57:29.892435+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:57:29.892435+0000","last_undegraded":"2024-09-10T05:57:29.892435+0000","last_fullsized":"2024-09-10T05:57:29.892435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809055+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:57:29.809055+0000","last_peered":"2024-09-10T05:57:29.809055+0000","last_clean":"2024-09-10T05:57:29.809055+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:57:29.809055+0000","last_undegraded":"2024-09-10T05:57:29.809055+0000","last_fullsized":"2024-09-10T05:57:29.809055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897732+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:57:29.897732+0000","last_peered":"2024-09-10T05:57:29.897732+0000","last_clean":"2024-09-10T05:57:29.897732+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:57:29.897732+0000","last_undegraded":"2024-09-10T05:57:29.897732+0000","last_fullsized":"2024-09-10T05:57:29.897732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"66'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890077+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:57:29.890077+0000","last_peered":"2024-09-10T05:57:29.890077+0000","last_clean":"2024-09-10T05:57:29.890077+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:57:29.890077+0000","last_undegraded":"2024-09-10T05:57:29.890077+0000","last_fullsized":"2024-09-10T05:57:29.890077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'5","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802113+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:57:29.802113+0000","last_peered":"2024-09-10T05:57:29.802113+0000","last_clean":"2024-09-10T05:57:29.802113+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:57:29.802113+0000","last_undegraded":"2024-09-10T05:57:29.802113+0000","last_fullsized":"2024-09-10T05:57:29.802113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":162,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890466+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:57:29.890466+0000","last_peered":"2024-09-10T05:57:29.890466+0000","last_clean":"2024-09-10T05:57:29.890466+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:57:29.890466+0000","last_undegraded":"2024-09-10T05:57:29.890466+0000","last_fullsized":"2024-09-10T05:57:29.890466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"74'3","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801356+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:57:29.801356+0000","last_peered":"2024-09-10T05:57:29.801356+0000","last_clean":"2024-09-10T05:57:29.801356+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:57:29.801356+0000","last_undegraded":"2024-09-10T05:57:29.801356+0000","last_fullsized":"2024-09-10T05:57:29.801356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'3","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892602+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:57:29.892602+0000","last_peered":"2024-09-10T05:57:29.892602+0000","last_clean":"2024-09-10T05:57:29.892602+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:57:29.892602+0000","last_undegraded":"2024-09-10T05:57:29.892602+0000","last_fullsized":"2024-09-10T05:57:29.892602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"74'3","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890795+0000","last_change":"2024-09-10T05:56:23.060633+0000","last_active":"2024-09-10T05:57:29.890795+0000","last_peered":"2024-09-10T05:57:29.890795+0000","last_clean":"2024-09-10T05:57:29.890795+0000","last_became_active":"2024-09-10T05:56:23.059675+0000","last_became_peered":"2024-09-10T05:56:23.059675+0000","last_unstale":"2024-09-10T05:57:29.890795+0000","last_undegraded":"2024-09-10T05:57:29.890795+0000","last_fullsized":"2024-09-10T05:57:29.890795+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:54.126172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888566+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:57:29.888566+0000","last_peered":"2024-09-10T05:57:29.888566+0000","last_clean":"2024-09-10T05:57:29.888566+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:57:29.888566+0000","last_undegraded":"2024-09-10T05:57:29.888566+0000","last_fullsized":"2024-09-10T05:57:29.888566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"74'4","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809563+0000","last_change":"2024-09-10T05:56:23.047159+0000","last_active":"2024-09-10T05:57:29.809563+0000","last_peered":"2024-09-10T05:57:29.809563+0000","last_clean":"2024-09-10T05:57:29.809563+0000","last_became_active":"2024-09-10T05:56:23.046548+0000","last_became_peered":"2024-09-10T05:56:23.046548+0000","last_unstale":"2024-09-10T05:57:29.809563+0000","last_undegraded":"2024-09-10T05:57:29.809563+0000","last_fullsized":"2024-09-10T05:57:29.809563+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:39.908493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808947+0000","last_change":"2024-09-10T05:56:54.822912+0000","last_active":"2024-09-10T05:57:29.808947+0000","last_peered":"2024-09-10T05:57:29.808947+0000","last_clean":"2024-09-10T05:57:29.808947+0000","last_became_active":"2024-09-10T05:56:54.820694+0000","last_became_peered":"2024-09-10T05:56:54.820694+0000","last_unstale":"2024-09-10T05:57:29.808947+0000","last_undegraded":"2024-09-10T05:57:29.808947+0000","last_fullsized":"2024-09-10T05:57:29.808947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:16.363744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"74'7","reported_seq":76,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890027+0000","last_change":"2024-09-10T05:56:23.028796+0000","last_active":"2024-09-10T05:57:29.890027+0000","last_peered":"2024-09-10T05:57:29.890027+0000","last_clean":"2024-09-10T05:57:29.890027+0000","last_became_active":"2024-09-10T05:56:23.028497+0000","last_became_peered":"2024-09-10T05:56:23.028497+0000","last_unstale":"2024-09-10T05:57:29.890027+0000","last_undegraded":"2024-09-10T05:57:29.890027+0000","last_fullsized":"2024-09-10T05:57:29.890027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:09.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"67'6","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893991+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:57:29.893991+0000","last_peered":"2024-09-10T05:57:29.893991+0000","last_clean":"2024-09-10T05:57:29.893991+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:57:29.893991+0000","last_undegraded":"2024-09-10T05:57:29.893991+0000","last_fullsized":"2024-09-10T05:57:29.893991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"74'7","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889393+0000","last_change":"2024-09-10T05:56:23.037012+0000","last_active":"2024-09-10T05:57:29.889393+0000","last_peered":"2024-09-10T05:57:29.889393+0000","last_clean":"2024-09-10T05:57:29.889393+0000","last_became_active":"2024-09-10T05:56:23.036730+0000","last_became_peered":"2024-09-10T05:56:23.036730+0000","last_unstale":"2024-09-10T05:57:29.889393+0000","last_undegraded":"2024-09-10T05:57:29.889393+0000","last_fullsized":"2024-09-10T05:57:29.889393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:47.789902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887852+0000","last_change":"2024-09-10T05:56:23.049294+0000","last_active":"2024-09-10T05:57:29.887852+0000","last_peered":"2024-09-10T05:57:29.887852+0000","last_clean":"2024-09-10T05:57:29.887852+0000","last_became_active":"2024-09-10T05:56:23.049026+0000","last_became_peered":"2024-09-10T05:56:23.049026+0000","last_unstale":"2024-09-10T05:57:29.887852+0000","last_undegraded":"2024-09-10T05:57:29.887852+0000","last_fullsized":"2024-09-10T05:57:29.887852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:42.468350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803806+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:57:29.803806+0000","last_peered":"2024-09-10T05:57:29.803806+0000","last_clean":"2024-09-10T05:57:29.803806+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:57:29.803806+0000","last_undegraded":"2024-09-10T05:57:29.803806+0000","last_fullsized":"2024-09-10T05:57:29.803806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801992+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:57:29.801992+0000","last_peered":"2024-09-10T05:57:29.801992+0000","last_clean":"2024-09-10T05:57:29.801992+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:57:29.801992+0000","last_undegraded":"2024-09-10T05:57:29.801992+0000","last_fullsized":"2024-09-10T05:57:29.801992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'3","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892234+0000","last_change":"2024-09-10T05:56:23.055385+0000","last_active":"2024-09-10T05:57:29.892234+0000","last_peered":"2024-09-10T05:57:29.892234+0000","last_clean":"2024-09-10T05:57:29.892234+0000","last_became_active":"2024-09-10T05:56:23.053209+0000","last_became_peered":"2024-09-10T05:56:23.053209+0000","last_unstale":"2024-09-10T05:57:29.892234+0000","last_undegraded":"2024-09-10T05:57:29.892234+0000","last_fullsized":"2024-09-10T05:57:29.892234+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:12.695061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808576+0000","last_change":"2024-09-10T05:56:23.043354+0000","last_active":"2024-09-10T05:57:29.808576+0000","last_peered":"2024-09-10T05:57:29.808576+0000","last_clean":"2024-09-10T05:57:29.808576+0000","last_became_active":"2024-09-10T05:56:23.042470+0000","last_became_peered":"2024-09-10T05:56:23.042470+0000","last_unstale":"2024-09-10T05:57:29.808576+0000","last_undegraded":"2024-09-10T05:57:29.808576+0000","last_fullsized":"2024-09-10T05:57:29.808576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:34.970506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"74'3","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890258+0000","last_change":"2024-09-10T05:56:23.065960+0000","last_active":"2024-09-10T05:57:29.890258+0000","last_peered":"2024-09-10T05:57:29.890258+0000","last_clean":"2024-09-10T05:57:29.890258+0000","last_became_active":"2024-09-10T05:56:23.064580+0000","last_became_peered":"2024-09-10T05:56:23.064580+0000","last_unstale":"2024-09-10T05:57:29.890258+0000","last_undegraded":"2024-09-10T05:57:29.890258+0000","last_fullsized":"2024-09-10T05:57:29.890258+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:54.286114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"80'6","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.898187+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:57:29.898187+0000","last_peered":"2024-09-10T05:57:29.898187+0000","last_clean":"2024-09-10T05:57:29.898187+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:57:29.898187+0000","last_undegraded":"2024-09-10T05:57:29.898187+0000","last_fullsized":"2024-09-10T05:57:29.898187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"74'3","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888131+0000","last_change":"2024-09-10T05:56:23.039970+0000","last_active":"2024-09-10T05:57:29.888131+0000","last_peered":"2024-09-10T05:57:29.888131+0000","last_clean":"2024-09-10T05:57:29.888131+0000","last_became_active":"2024-09-10T05:56:23.028702+0000","last_became_peered":"2024-09-10T05:56:23.028702+0000","last_unstale":"2024-09-10T05:57:29.888131+0000","last_undegraded":"2024-09-10T05:57:29.888131+0000","last_fullsized":"2024-09-10T05:57:29.888131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:00.770967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801954+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:57:29.801954+0000","last_peered":"2024-09-10T05:57:29.801954+0000","last_clean":"2024-09-10T05:57:29.801954+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:57:29.801954+0000","last_undegraded":"2024-09-10T05:57:29.801954+0000","last_fullsized":"2024-09-10T05:57:29.801954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"74'9","reported_seq":143,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890726+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:57:29.890726+0000","last_peered":"2024-09-10T05:57:29.890726+0000","last_clean":"2024-09-10T05:57:29.890726+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:57:29.890726+0000","last_undegraded":"2024-09-10T05:57:29.890726+0000","last_fullsized":"2024-09-10T05:57:29.890726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.896950+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:57:29.896950+0000","last_peered":"2024-09-10T05:57:29.896950+0000","last_clean":"2024-09-10T05:57:29.896950+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:57:29.896950+0000","last_undegraded":"2024-09-10T05:57:29.896950+0000","last_fullsized":"2024-09-10T05:57:29.896950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"72'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809680+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:57:29.809680+0000","last_peered":"2024-09-10T05:57:29.809680+0000","last_clean":"2024-09-10T05:57:29.809680+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:57:29.809680+0000","last_undegraded":"2024-09-10T05:57:29.809680+0000","last_fullsized":"2024-09-10T05:57:29.809680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'2","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812638+0000","last_change":"2024-09-10T05:56:23.041678+0000","last_active":"2024-09-10T05:57:30.812638+0000","last_peered":"2024-09-10T05:57:30.812638+0000","last_clean":"2024-09-10T05:57:30.812638+0000","last_became_active":"2024-09-10T05:56:23.040913+0000","last_became_peered":"2024-09-10T05:56:23.040913+0000","last_unstale":"2024-09-10T05:57:30.812638+0000","last_undegraded":"2024-09-10T05:57:30.812638+0000","last_fullsized":"2024-09-10T05:57:30.812638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:42.175576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'2","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803578+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:57:29.803578+0000","last_peered":"2024-09-10T05:57:29.803578+0000","last_clean":"2024-09-10T05:57:29.803578+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:57:29.803578+0000","last_undegraded":"2024-09-10T05:57:29.803578+0000","last_fullsized":"2024-09-10T05:57:29.803578+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808009+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:57:29.808009+0000","last_peered":"2024-09-10T05:57:29.808009+0000","last_clean":"2024-09-10T05:57:29.808009+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:57:29.808009+0000","last_undegraded":"2024-09-10T05:57:29.808009+0000","last_fullsized":"2024-09-10T05:57:29.808009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'4","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814765+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:57:30.814765+0000","last_peered":"2024-09-10T05:57:30.814765+0000","last_clean":"2024-09-10T05:57:30.814765+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:57:30.814765+0000","last_undegraded":"2024-09-10T05:57:30.814765+0000","last_fullsized":"2024-09-10T05:57:30.814765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888294+0000","last_change":"2024-09-10T05:56:23.040862+0000","last_active":"2024-09-10T05:57:29.888294+0000","last_peered":"2024-09-10T05:57:29.888294+0000","last_clean":"2024-09-10T05:57:29.888294+0000","last_became_active":"2024-09-10T05:56:23.040554+0000","last_became_peered":"2024-09-10T05:56:23.040554+0000","last_unstale":"2024-09-10T05:57:29.888294+0000","last_undegraded":"2024-09-10T05:57:29.888294+0000","last_fullsized":"2024-09-10T05:57:29.888294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:05.730570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"74'3","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802256+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:57:29.802256+0000","last_peered":"2024-09-10T05:57:29.802256+0000","last_clean":"2024-09-10T05:57:29.802256+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:57:29.802256+0000","last_undegraded":"2024-09-10T05:57:29.802256+0000","last_fullsized":"2024-09-10T05:57:29.802256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811133+0000","last_change":"2024-09-10T05:56:23.022264+0000","last_active":"2024-09-10T05:57:30.811133+0000","last_peered":"2024-09-10T05:57:30.811133+0000","last_clean":"2024-09-10T05:57:30.811133+0000","last_became_active":"2024-09-10T05:56:23.021493+0000","last_became_peered":"2024-09-10T05:56:23.021493+0000","last_unstale":"2024-09-10T05:57:30.811133+0000","last_undegraded":"2024-09-10T05:57:30.811133+0000","last_fullsized":"2024-09-10T05:57:30.811133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:17.610734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"73'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893585+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:57:29.893585+0000","last_peered":"2024-09-10T05:57:29.893585+0000","last_clean":"2024-09-10T05:57:29.893585+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:57:29.893585+0000","last_undegraded":"2024-09-10T05:57:29.893585+0000","last_fullsized":"2024-09-10T05:57:29.893585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'8","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.800998+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:57:29.800998+0000","last_peered":"2024-09-10T05:57:29.800998+0000","last_clean":"2024-09-10T05:57:29.800998+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:57:29.800998+0000","last_undegraded":"2024-09-10T05:57:29.800998+0000","last_fullsized":"2024-09-10T05:57:29.800998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"67'2","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808596+0000","last_change":"2024-09-10T05:56:23.043355+0000","last_active":"2024-09-10T05:57:29.808596+0000","last_peered":"2024-09-10T05:57:29.808596+0000","last_clean":"2024-09-10T05:57:29.808596+0000","last_became_active":"2024-09-10T05:56:23.042207+0000","last_became_peered":"2024-09-10T05:56:23.042207+0000","last_unstale":"2024-09-10T05:57:29.808596+0000","last_undegraded":"2024-09-10T05:57:29.808596+0000","last_fullsized":"2024-09-10T05:57:29.808596+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:01.926326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"74'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888323+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:57:29.888323+0000","last_peered":"2024-09-10T05:57:29.888323+0000","last_clean":"2024-09-10T05:57:29.888323+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:57:29.888323+0000","last_undegraded":"2024-09-10T05:57:29.888323+0000","last_fullsized":"2024-09-10T05:57:29.888323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891385+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:57:29.891385+0000","last_peered":"2024-09-10T05:57:29.891385+0000","last_clean":"2024-09-10T05:57:29.891385+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:57:29.891385+0000","last_undegraded":"2024-09-10T05:57:29.891385+0000","last_fullsized":"2024-09-10T05:57:29.891385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":264,"num_write":236,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":836,"ondisk_log_size":836,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":83511,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1089,"num_read_kb":816,"num_write":635,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":127162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":826,"ondisk_log_size":826,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1136,"num_read_kb":1116,"num_write":239,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":307,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368692,"kb_used_data":337500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94003148,"statfs":{"total":96636764160,"available":96259223552,"internally_reserved":0,"allocated":345600000,"data_stored":345101396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241124,"kb_used_data":209932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94130716,"statfs":{"total":96636764160,"available":96389853184,"internally_reserved":0,"allocated":214970368,"data_stored":214488493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284248,"kb_used_data":253052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94087592,"statfs":{"total":96636764160,"available":96345694208,"internally_reserved":0,"allocated":259125248,"data_stored":258587317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542176,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300492,"kb_used_data":269300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94071348,"statfs":{"total":96636764160,"available":96329060352,"internally_reserved":0,"allocated":275763200,"data_stored":275297942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337460,"kb_used_data":302108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94034380,"statfs":{"total":96636764160,"available":96291205120,"internally_reserved":0,"allocated":309358592,"data_stored":308853868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251396,"kb_used_data":216044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94120444,"statfs":{"total":96636764160,"available":96379334656,"internally_reserved":0,"allocated":221229056,"data_stored":220770282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231016,"kb_used_data":195660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94140824,"statfs":{"total":96636764160,"available":96400203776,"internally_reserved":0,"allocated":200355840,"data_stored":199857876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350296,"kb_used_data":314944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94021544,"statfs":{"total":96636764160,"available":96278061056,"internally_reserved":0,"allocated":322502656,"data_stored":322024692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":320864256,"data_stored":320864256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":199229440,"data_stored":199229440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":220200960,"data_stored":220200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274726912,"data_stored":274726912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":257949696,"data_stored":257949696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":213909504,"data_stored":213909504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":343932928,"data_stored":343932928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":59227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":60781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:57:32.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:57:32.307 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:32.304+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:32.386 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:32.380+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:32.391 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:32.391 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:32.407 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:32.495 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:32.492+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:32.573 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:32.573 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:32.588 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:32.586+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:32.589 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:32.638 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:57:32.644 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:57:32.656 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-10T05:57:31.831474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070224044,"num_objects":502,"num_object_clones":0,"num_object_copies":1004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":502,"num_whiteouts":0,"num_read":2935,"num_read_kb":2610,"num_write":1530,"num_write_kb":1066796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":10489836,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2335,"ondisk_log_size":2335,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2364724,"kb_used_data":2098540,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":752609996,"statfs":{"total":773094113280,"available":770672635904,"internally_reserved":0,"allocated":2148904960,"data_stored":2144981866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.040434"},"pg_stats":[{"pgid":"3.3f","version":"74'4","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812907+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:57:30.812907+0000","last_peered":"2024-09-10T05:57:30.812907+0000","last_clean":"2024-09-10T05:57:30.812907+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:57:30.812907+0000","last_undegraded":"2024-09-10T05:57:30.812907+0000","last_fullsized":"2024-09-10T05:57:30.812907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'1","reported_seq":132,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889789+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:57:29.889789+0000","last_peered":"2024-09-10T05:57:29.889789+0000","last_clean":"2024-09-10T05:57:29.889789+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:57:29.889789+0000","last_undegraded":"2024-09-10T05:57:29.889789+0000","last_fullsized":"2024-09-10T05:57:29.889789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"74'6","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890647+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:57:29.890647+0000","last_peered":"2024-09-10T05:57:29.890647+0000","last_clean":"2024-09-10T05:57:29.890647+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:57:29.890647+0000","last_undegraded":"2024-09-10T05:57:29.890647+0000","last_fullsized":"2024-09-10T05:57:29.890647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811442+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:57:30.811442+0000","last_peered":"2024-09-10T05:57:30.811442+0000","last_clean":"2024-09-10T05:57:30.811442+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:57:30.811442+0000","last_undegraded":"2024-09-10T05:57:30.811442+0000","last_fullsized":"2024-09-10T05:57:30.811442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"74'5","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808514+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:57:29.808514+0000","last_peered":"2024-09-10T05:57:29.808514+0000","last_clean":"2024-09-10T05:57:29.808514+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:57:29.808514+0000","last_undegraded":"2024-09-10T05:57:29.808514+0000","last_fullsized":"2024-09-10T05:57:29.808514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893101+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:57:29.893101+0000","last_peered":"2024-09-10T05:57:29.893101+0000","last_clean":"2024-09-10T05:57:29.893101+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:57:29.893101+0000","last_undegraded":"2024-09-10T05:57:29.893101+0000","last_fullsized":"2024-09-10T05:57:29.893101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"74'3","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891157+0000","last_change":"2024-09-10T05:56:23.067941+0000","last_active":"2024-09-10T05:57:29.891157+0000","last_peered":"2024-09-10T05:57:29.891157+0000","last_clean":"2024-09-10T05:57:29.891157+0000","last_became_active":"2024-09-10T05:56:23.066964+0000","last_became_peered":"2024-09-10T05:56:23.066964+0000","last_unstale":"2024-09-10T05:57:29.891157+0000","last_undegraded":"2024-09-10T05:57:29.891157+0000","last_fullsized":"2024-09-10T05:57:29.891157+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:07.840191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"67'8","reported_seq":175,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809329+0000","last_change":"2024-09-10T05:56:23.046850+0000","last_active":"2024-09-10T05:57:29.809329+0000","last_peered":"2024-09-10T05:57:29.809329+0000","last_clean":"2024-09-10T05:57:29.809329+0000","last_became_active":"2024-09-10T05:56:23.046172+0000","last_became_peered":"2024-09-10T05:56:23.046172+0000","last_unstale":"2024-09-10T05:57:29.809329+0000","last_undegraded":"2024-09-10T05:57:29.809329+0000","last_fullsized":"2024-09-10T05:57:29.809329+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:02.543439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"74'10","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813072+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:57:30.813072+0000","last_peered":"2024-09-10T05:57:30.813072+0000","last_clean":"2024-09-10T05:57:30.813072+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:57:30.813072+0000","last_undegraded":"2024-09-10T05:57:30.813072+0000","last_fullsized":"2024-09-10T05:57:30.813072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803137+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:57:29.803137+0000","last_peered":"2024-09-10T05:57:29.803137+0000","last_clean":"2024-09-10T05:57:29.803137+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:57:29.803137+0000","last_undegraded":"2024-09-10T05:57:29.803137+0000","last_fullsized":"2024-09-10T05:57:29.803137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890282+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:57:29.890282+0000","last_peered":"2024-09-10T05:57:29.890282+0000","last_clean":"2024-09-10T05:57:29.890282+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:57:29.890282+0000","last_undegraded":"2024-09-10T05:57:29.890282+0000","last_fullsized":"2024-09-10T05:57:29.890282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"80'7","reported_seq":159,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895052+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:57:29.895052+0000","last_peered":"2024-09-10T05:57:29.895052+0000","last_clean":"2024-09-10T05:57:29.895052+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:57:29.895052+0000","last_undegraded":"2024-09-10T05:57:29.895052+0000","last_fullsized":"2024-09-10T05:57:29.895052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"74'4","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811931+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:57:30.811931+0000","last_peered":"2024-09-10T05:57:30.811931+0000","last_clean":"2024-09-10T05:57:30.811931+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:57:30.811931+0000","last_undegraded":"2024-09-10T05:57:30.811931+0000","last_fullsized":"2024-09-10T05:57:30.811931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891103+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:57:29.891103+0000","last_peered":"2024-09-10T05:57:29.891103+0000","last_clean":"2024-09-10T05:57:29.891103+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:57:29.891103+0000","last_undegraded":"2024-09-10T05:57:29.891103+0000","last_fullsized":"2024-09-10T05:57:29.891103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"72'1","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888065+0000","last_change":"2024-09-10T05:56:23.044790+0000","last_active":"2024-09-10T05:57:29.888065+0000","last_peered":"2024-09-10T05:57:29.888065+0000","last_clean":"2024-09-10T05:57:29.888065+0000","last_became_active":"2024-09-10T05:56:23.044451+0000","last_became_peered":"2024-09-10T05:56:23.044451+0000","last_unstale":"2024-09-10T05:57:29.888065+0000","last_undegraded":"2024-09-10T05:57:29.888065+0000","last_fullsized":"2024-09-10T05:57:29.888065+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:48.985907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802616+0000","last_change":"2024-09-10T05:56:23.059475+0000","last_active":"2024-09-10T05:57:29.802616+0000","last_peered":"2024-09-10T05:57:29.802616+0000","last_clean":"2024-09-10T05:57:29.802616+0000","last_became_active":"2024-09-10T05:56:23.059115+0000","last_became_peered":"2024-09-10T05:56:23.059115+0000","last_unstale":"2024-09-10T05:57:29.802616+0000","last_undegraded":"2024-09-10T05:57:29.802616+0000","last_fullsized":"2024-09-10T05:57:29.802616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:38.752296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889301+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:57:29.889301+0000","last_peered":"2024-09-10T05:57:29.889301+0000","last_clean":"2024-09-10T05:57:29.889301+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:57:29.889301+0000","last_undegraded":"2024-09-10T05:57:29.889301+0000","last_fullsized":"2024-09-10T05:57:29.889301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"74'5","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813034+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:57:30.813034+0000","last_peered":"2024-09-10T05:57:30.813034+0000","last_clean":"2024-09-10T05:57:30.813034+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:57:30.813034+0000","last_undegraded":"2024-09-10T05:57:30.813034+0000","last_fullsized":"2024-09-10T05:57:30.813034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811663+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:57:30.811663+0000","last_peered":"2024-09-10T05:57:30.811663+0000","last_clean":"2024-09-10T05:57:30.811663+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:57:30.811663+0000","last_undegraded":"2024-09-10T05:57:30.811663+0000","last_fullsized":"2024-09-10T05:57:30.811663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"74'6","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803439+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:57:29.803439+0000","last_peered":"2024-09-10T05:57:29.803439+0000","last_clean":"2024-09-10T05:57:29.803439+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:57:29.803439+0000","last_undegraded":"2024-09-10T05:57:29.803439+0000","last_fullsized":"2024-09-10T05:57:29.803439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890538+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:57:29.890538+0000","last_peered":"2024-09-10T05:57:29.890538+0000","last_clean":"2024-09-10T05:57:29.890538+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:57:29.890538+0000","last_undegraded":"2024-09-10T05:57:29.890538+0000","last_fullsized":"2024-09-10T05:57:29.890538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"71'3","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803993+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:57:29.803993+0000","last_peered":"2024-09-10T05:57:29.803993+0000","last_clean":"2024-09-10T05:57:29.803993+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:57:29.803993+0000","last_undegraded":"2024-09-10T05:57:29.803993+0000","last_fullsized":"2024-09-10T05:57:29.803993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801515+0000","last_change":"2024-09-10T05:56:23.060761+0000","last_active":"2024-09-10T05:57:29.801515+0000","last_peered":"2024-09-10T05:57:29.801515+0000","last_clean":"2024-09-10T05:57:29.801515+0000","last_became_active":"2024-09-10T05:56:23.060478+0000","last_became_peered":"2024-09-10T05:56:23.060478+0000","last_unstale":"2024-09-10T05:57:29.801515+0000","last_undegraded":"2024-09-10T05:57:29.801515+0000","last_fullsized":"2024-09-10T05:57:29.801515+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:37.688502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895883+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:57:29.895883+0000","last_peered":"2024-09-10T05:57:29.895883+0000","last_clean":"2024-09-10T05:57:29.895883+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:57:29.895883+0000","last_undegraded":"2024-09-10T05:57:29.895883+0000","last_fullsized":"2024-09-10T05:57:29.895883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"74'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801885+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:57:29.801885+0000","last_peered":"2024-09-10T05:57:29.801885+0000","last_clean":"2024-09-10T05:57:29.801885+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:57:29.801885+0000","last_undegraded":"2024-09-10T05:57:29.801885+0000","last_fullsized":"2024-09-10T05:57:29.801885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'6","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889375+0000","last_change":"2024-09-10T05:56:23.031635+0000","last_active":"2024-09-10T05:57:29.889375+0000","last_peered":"2024-09-10T05:57:29.889375+0000","last_clean":"2024-09-10T05:57:29.889375+0000","last_became_active":"2024-09-10T05:56:23.026992+0000","last_became_peered":"2024-09-10T05:56:23.026992+0000","last_unstale":"2024-09-10T05:57:29.889375+0000","last_undegraded":"2024-09-10T05:57:29.889375+0000","last_fullsized":"2024-09-10T05:57:29.889375+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:50.760900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895206+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:57:29.895206+0000","last_peered":"2024-09-10T05:57:29.895206+0000","last_clean":"2024-09-10T05:57:29.895206+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:57:29.895206+0000","last_undegraded":"2024-09-10T05:57:29.895206+0000","last_fullsized":"2024-09-10T05:57:29.895206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":134,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808346+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:57:29.808346+0000","last_peered":"2024-09-10T05:57:29.808346+0000","last_clean":"2024-09-10T05:57:29.808346+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:57:29.808346+0000","last_undegraded":"2024-09-10T05:57:29.808346+0000","last_fullsized":"2024-09-10T05:57:29.808346+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"80'3","reported_seq":131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888496+0000","last_change":"2024-09-10T05:56:23.056685+0000","last_active":"2024-09-10T05:57:29.888496+0000","last_peered":"2024-09-10T05:57:29.888496+0000","last_clean":"2024-09-10T05:57:29.888496+0000","last_became_active":"2024-09-10T05:56:23.055767+0000","last_became_peered":"2024-09-10T05:56:23.055767+0000","last_unstale":"2024-09-10T05:57:29.888496+0000","last_undegraded":"2024-09-10T05:57:29.888496+0000","last_fullsized":"2024-09-10T05:57:29.888496+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:32.495236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"74'4","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889577+0000","last_change":"2024-09-10T05:56:23.049625+0000","last_active":"2024-09-10T05:57:29.889577+0000","last_peered":"2024-09-10T05:57:29.889577+0000","last_clean":"2024-09-10T05:57:29.889577+0000","last_became_active":"2024-09-10T05:56:23.049267+0000","last_became_peered":"2024-09-10T05:56:23.049267+0000","last_unstale":"2024-09-10T05:57:29.889577+0000","last_undegraded":"2024-09-10T05:57:29.889577+0000","last_fullsized":"2024-09-10T05:57:29.889577+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:52.397184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"72'3","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813454+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:57:30.813454+0000","last_peered":"2024-09-10T05:57:30.813454+0000","last_clean":"2024-09-10T05:57:30.813454+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:57:30.813454+0000","last_undegraded":"2024-09-10T05:57:30.813454+0000","last_fullsized":"2024-09-10T05:57:30.813454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892349+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:57:29.892349+0000","last_peered":"2024-09-10T05:57:29.892349+0000","last_clean":"2024-09-10T05:57:29.892349+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:57:29.892349+0000","last_undegraded":"2024-09-10T05:57:29.892349+0000","last_fullsized":"2024-09-10T05:57:29.892349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"74'27","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809113+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:57:29.809113+0000","last_peered":"2024-09-10T05:57:29.809113+0000","last_clean":"2024-09-10T05:57:29.809113+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:57:29.809113+0000","last_undegraded":"2024-09-10T05:57:29.809113+0000","last_fullsized":"2024-09-10T05:57:29.809113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812241+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:57:30.812241+0000","last_peered":"2024-09-10T05:57:30.812241+0000","last_clean":"2024-09-10T05:57:30.812241+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:57:30.812241+0000","last_undegraded":"2024-09-10T05:57:30.812241+0000","last_fullsized":"2024-09-10T05:57:30.812241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"80'37","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889285+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:57:29.889285+0000","last_peered":"2024-09-10T05:57:29.889285+0000","last_clean":"2024-09-10T05:57:29.889285+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:57:29.889285+0000","last_undegraded":"2024-09-10T05:57:29.889285+0000","last_fullsized":"2024-09-10T05:57:29.889285+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893105+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:57:29.893105+0000","last_peered":"2024-09-10T05:57:29.893105+0000","last_clean":"2024-09-10T05:57:29.893105+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:57:29.893105+0000","last_undegraded":"2024-09-10T05:57:29.893105+0000","last_fullsized":"2024-09-10T05:57:29.893105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"74'3","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808834+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:57:29.808834+0000","last_peered":"2024-09-10T05:57:29.808834+0000","last_clean":"2024-09-10T05:57:29.808834+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:57:29.808834+0000","last_undegraded":"2024-09-10T05:57:29.808834+0000","last_fullsized":"2024-09-10T05:57:29.808834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889933+0000","last_change":"2024-09-10T05:56:23.017197+0000","last_active":"2024-09-10T05:57:29.889933+0000","last_peered":"2024-09-10T05:57:29.889933+0000","last_clean":"2024-09-10T05:57:29.889933+0000","last_became_active":"2024-09-10T05:56:23.016946+0000","last_became_peered":"2024-09-10T05:56:23.016946+0000","last_unstale":"2024-09-10T05:57:29.889933+0000","last_undegraded":"2024-09-10T05:57:29.889933+0000","last_fullsized":"2024-09-10T05:57:29.889933+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:17.357508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":143,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897970+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:57:29.897970+0000","last_peered":"2024-09-10T05:57:29.897970+0000","last_clean":"2024-09-10T05:57:29.897970+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:57:29.897970+0000","last_undegraded":"2024-09-10T05:57:29.897970+0000","last_fullsized":"2024-09-10T05:57:29.897970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892763+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:57:29.892763+0000","last_peered":"2024-09-10T05:57:29.892763+0000","last_clean":"2024-09-10T05:57:29.892763+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:57:29.892763+0000","last_undegraded":"2024-09-10T05:57:29.892763+0000","last_fullsized":"2024-09-10T05:57:29.892763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808141+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:57:29.808141+0000","last_peered":"2024-09-10T05:57:29.808141+0000","last_clean":"2024-09-10T05:57:29.808141+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:57:29.808141+0000","last_undegraded":"2024-09-10T05:57:29.808141+0000","last_fullsized":"2024-09-10T05:57:29.808141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809523+0000","last_change":"2024-09-10T05:56:23.042081+0000","last_active":"2024-09-10T05:57:29.809523+0000","last_peered":"2024-09-10T05:57:29.809523+0000","last_clean":"2024-09-10T05:57:29.809523+0000","last_became_active":"2024-09-10T05:56:23.041763+0000","last_became_peered":"2024-09-10T05:56:23.041763+0000","last_unstale":"2024-09-10T05:57:29.809523+0000","last_undegraded":"2024-09-10T05:57:29.809523+0000","last_fullsized":"2024-09-10T05:57:29.809523+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:01.116823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"74'8","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811934+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:57:30.811934+0000","last_peered":"2024-09-10T05:57:30.811934+0000","last_clean":"2024-09-10T05:57:30.811934+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:57:30.811934+0000","last_undegraded":"2024-09-10T05:57:30.811934+0000","last_fullsized":"2024-09-10T05:57:30.811934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891900+0000","last_change":"2024-09-10T05:56:23.055375+0000","last_active":"2024-09-10T05:57:29.891900+0000","last_peered":"2024-09-10T05:57:29.891900+0000","last_clean":"2024-09-10T05:57:29.891900+0000","last_became_active":"2024-09-10T05:56:23.052761+0000","last_became_peered":"2024-09-10T05:56:23.052761+0000","last_unstale":"2024-09-10T05:57:29.891900+0000","last_undegraded":"2024-09-10T05:57:29.891900+0000","last_fullsized":"2024-09-10T05:57:29.891900+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:57.904540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":162,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801706+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:57:29.801706+0000","last_peered":"2024-09-10T05:57:29.801706+0000","last_clean":"2024-09-10T05:57:29.801706+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:57:29.801706+0000","last_undegraded":"2024-09-10T05:57:29.801706+0000","last_fullsized":"2024-09-10T05:57:29.801706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"80'104","reported_seq":249,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813735+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:57:30.813735+0000","last_peered":"2024-09-10T05:57:30.813735+0000","last_clean":"2024-09-10T05:57:30.813735+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:57:30.813735+0000","last_undegraded":"2024-09-10T05:57:30.813735+0000","last_fullsized":"2024-09-10T05:57:30.813735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892759+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:57:29.892759+0000","last_peered":"2024-09-10T05:57:29.892759+0000","last_clean":"2024-09-10T05:57:29.892759+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:57:29.892759+0000","last_undegraded":"2024-09-10T05:57:29.892759+0000","last_fullsized":"2024-09-10T05:57:29.892759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":91,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892001+0000","last_change":"2024-09-10T05:56:23.011597+0000","last_active":"2024-09-10T05:57:29.892001+0000","last_peered":"2024-09-10T05:57:29.892001+0000","last_clean":"2024-09-10T05:57:29.892001+0000","last_became_active":"2024-09-10T05:56:23.008641+0000","last_became_peered":"2024-09-10T05:56:23.008641+0000","last_unstale":"2024-09-10T05:57:29.892001+0000","last_undegraded":"2024-09-10T05:57:29.892001+0000","last_fullsized":"2024-09-10T05:57:29.892001+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:28.014908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802137+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:57:29.802137+0000","last_peered":"2024-09-10T05:57:29.802137+0000","last_clean":"2024-09-10T05:57:29.802137+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:57:29.802137+0000","last_undegraded":"2024-09-10T05:57:29.802137+0000","last_fullsized":"2024-09-10T05:57:29.802137+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890754+0000","last_change":"2024-09-10T05:56:23.060792+0000","last_active":"2024-09-10T05:57:29.890754+0000","last_peered":"2024-09-10T05:57:29.890754+0000","last_clean":"2024-09-10T05:57:29.890754+0000","last_became_active":"2024-09-10T05:56:23.059745+0000","last_became_peered":"2024-09-10T05:56:23.059745+0000","last_unstale":"2024-09-10T05:57:29.890754+0000","last_undegraded":"2024-09-10T05:57:29.890754+0000","last_fullsized":"2024-09-10T05:57:29.890754+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:11.407144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"74'20","reported_seq":158,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813978+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:57:30.813978+0000","last_peered":"2024-09-10T05:57:30.813978+0000","last_clean":"2024-09-10T05:57:30.813978+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:57:30.813978+0000","last_undegraded":"2024-09-10T05:57:30.813978+0000","last_fullsized":"2024-09-10T05:57:30.813978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"80'106","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889773+0000","last_change":"2024-09-10T05:56:23.146978+0000","last_active":"2024-09-10T05:57:29.889773+0000","last_peered":"2024-09-10T05:57:29.889773+0000","last_clean":"2024-09-10T05:57:29.889773+0000","last_became_active":"2024-09-10T05:56:23.037617+0000","last_became_peered":"2024-09-10T05:56:23.037617+0000","last_unstale":"2024-09-10T05:57:29.889773+0000","last_undegraded":"2024-09-10T05:57:29.889773+0000","last_fullsized":"2024-09-10T05:57:29.889773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:49.068438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890234+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:57:29.890234+0000","last_peered":"2024-09-10T05:57:29.890234+0000","last_clean":"2024-09-10T05:57:29.890234+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:57:29.890234+0000","last_undegraded":"2024-09-10T05:57:29.890234+0000","last_fullsized":"2024-09-10T05:57:29.890234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"72'4","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813288+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:57:30.813288+0000","last_peered":"2024-09-10T05:57:30.813288+0000","last_clean":"2024-09-10T05:57:30.813288+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:57:30.813288+0000","last_undegraded":"2024-09-10T05:57:30.813288+0000","last_fullsized":"2024-09-10T05:57:30.813288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811141+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:57:30.811141+0000","last_peered":"2024-09-10T05:57:30.811141+0000","last_clean":"2024-09-10T05:57:30.811141+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:57:30.811141+0000","last_undegraded":"2024-09-10T05:57:30.811141+0000","last_fullsized":"2024-09-10T05:57:30.811141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"74'32","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889511+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:57:29.889511+0000","last_peered":"2024-09-10T05:57:29.889511+0000","last_clean":"2024-09-10T05:57:29.889511+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:57:29.889511+0000","last_undegraded":"2024-09-10T05:57:29.889511+0000","last_fullsized":"2024-09-10T05:57:29.889511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889226+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:57:29.889226+0000","last_peered":"2024-09-10T05:57:29.889226+0000","last_clean":"2024-09-10T05:57:29.889226+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:57:29.889226+0000","last_undegraded":"2024-09-10T05:57:29.889226+0000","last_fullsized":"2024-09-10T05:57:29.889226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890797+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:57:29.890797+0000","last_peered":"2024-09-10T05:57:29.890797+0000","last_clean":"2024-09-10T05:57:29.890797+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:57:29.890797+0000","last_undegraded":"2024-09-10T05:57:29.890797+0000","last_fullsized":"2024-09-10T05:57:29.890797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894537+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:57:29.894537+0000","last_peered":"2024-09-10T05:57:29.894537+0000","last_clean":"2024-09-10T05:57:29.894537+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:57:29.894537+0000","last_undegraded":"2024-09-10T05:57:29.894537+0000","last_fullsized":"2024-09-10T05:57:29.894537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"74'3","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813385+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:57:30.813385+0000","last_peered":"2024-09-10T05:57:30.813385+0000","last_clean":"2024-09-10T05:57:30.813385+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:57:30.813385+0000","last_undegraded":"2024-09-10T05:57:30.813385+0000","last_fullsized":"2024-09-10T05:57:30.813385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801167+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:57:29.801167+0000","last_peered":"2024-09-10T05:57:29.801167+0000","last_clean":"2024-09-10T05:57:29.801167+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:57:29.801167+0000","last_undegraded":"2024-09-10T05:57:29.801167+0000","last_fullsized":"2024-09-10T05:57:29.801167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"74'20","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889656+0000","last_change":"2024-09-10T05:56:23.084361+0000","last_active":"2024-09-10T05:57:29.889656+0000","last_peered":"2024-09-10T05:57:29.889656+0000","last_clean":"2024-09-10T05:57:29.889656+0000","last_became_active":"2024-09-10T05:56:23.020849+0000","last_became_peered":"2024-09-10T05:56:23.020849+0000","last_unstale":"2024-09-10T05:57:29.889656+0000","last_undegraded":"2024-09-10T05:57:29.889656+0000","last_fullsized":"2024-09-10T05:57:29.889656+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:38.911377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888570+0000","last_change":"2024-09-10T05:56:23.035832+0000","last_active":"2024-09-10T05:57:29.888570+0000","last_peered":"2024-09-10T05:57:29.888570+0000","last_clean":"2024-09-10T05:57:29.888570+0000","last_became_active":"2024-09-10T05:56:23.035097+0000","last_became_peered":"2024-09-10T05:56:23.035097+0000","last_unstale":"2024-09-10T05:57:29.888570+0000","last_undegraded":"2024-09-10T05:57:29.888570+0000","last_fullsized":"2024-09-10T05:57:29.888570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:59.003597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802776+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:57:29.802776+0000","last_peered":"2024-09-10T05:57:29.802776+0000","last_clean":"2024-09-10T05:57:29.802776+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:57:29.802776+0000","last_undegraded":"2024-09-10T05:57:29.802776+0000","last_fullsized":"2024-09-10T05:57:29.802776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803080+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:57:29.803080+0000","last_peered":"2024-09-10T05:57:29.803080+0000","last_clean":"2024-09-10T05:57:29.803080+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:57:29.803080+0000","last_undegraded":"2024-09-10T05:57:29.803080+0000","last_fullsized":"2024-09-10T05:57:29.803080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'4","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814596+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:57:30.814596+0000","last_peered":"2024-09-10T05:57:30.814596+0000","last_clean":"2024-09-10T05:57:30.814596+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:57:30.814596+0000","last_undegraded":"2024-09-10T05:57:30.814596+0000","last_fullsized":"2024-09-10T05:57:30.814596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801666+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:57:29.801666+0000","last_peered":"2024-09-10T05:57:29.801666+0000","last_clean":"2024-09-10T05:57:29.801666+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:57:29.801666+0000","last_undegraded":"2024-09-10T05:57:29.801666+0000","last_fullsized":"2024-09-10T05:57:29.801666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"74'32","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811422+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:57:30.811422+0000","last_peered":"2024-09-10T05:57:30.811422+0000","last_clean":"2024-09-10T05:57:30.811422+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:57:30.811422+0000","last_undegraded":"2024-09-10T05:57:30.811422+0000","last_fullsized":"2024-09-10T05:57:30.811422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"80'104","reported_seq":324,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807830+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:57:29.807830+0000","last_peered":"2024-09-10T05:57:29.807830+0000","last_clean":"2024-09-10T05:57:29.807830+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:57:29.807830+0000","last_undegraded":"2024-09-10T05:57:29.807830+0000","last_fullsized":"2024-09-10T05:57:29.807830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809164+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:57:29.809164+0000","last_peered":"2024-09-10T05:57:29.809164+0000","last_clean":"2024-09-10T05:57:29.809164+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:57:29.809164+0000","last_undegraded":"2024-09-10T05:57:29.809164+0000","last_fullsized":"2024-09-10T05:57:29.809164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809896+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:57:29.809896+0000","last_peered":"2024-09-10T05:57:29.809896+0000","last_clean":"2024-09-10T05:57:29.809896+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:57:29.809896+0000","last_undegraded":"2024-09-10T05:57:29.809896+0000","last_fullsized":"2024-09-10T05:57:29.809896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"74'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801575+0000","last_change":"2024-09-10T05:56:59.881419+0000","last_active":"2024-09-10T05:57:29.801575+0000","last_peered":"2024-09-10T05:57:29.801575+0000","last_clean":"2024-09-10T05:57:29.801575+0000","last_became_active":"2024-09-10T05:56:59.839885+0000","last_became_peered":"2024-09-10T05:56:59.839885+0000","last_unstale":"2024-09-10T05:57:29.801575+0000","last_undegraded":"2024-09-10T05:57:29.801575+0000","last_fullsized":"2024-09-10T05:57:29.801575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:00.561931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802156+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:57:29.802156+0000","last_peered":"2024-09-10T05:57:29.802156+0000","last_clean":"2024-09-10T05:57:29.802156+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:57:29.802156+0000","last_undegraded":"2024-09-10T05:57:29.802156+0000","last_fullsized":"2024-09-10T05:57:29.802156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"74'34","reported_seq":179,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808360+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:57:29.808360+0000","last_peered":"2024-09-10T05:57:29.808360+0000","last_clean":"2024-09-10T05:57:29.808360+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:57:29.808360+0000","last_undegraded":"2024-09-10T05:57:29.808360+0000","last_fullsized":"2024-09-10T05:57:29.808360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.800998+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:57:29.800998+0000","last_peered":"2024-09-10T05:57:29.800998+0000","last_clean":"2024-09-10T05:57:29.800998+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:57:29.800998+0000","last_undegraded":"2024-09-10T05:57:29.800998+0000","last_fullsized":"2024-09-10T05:57:29.800998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889887+0000","last_change":"2024-09-10T05:56:23.037024+0000","last_active":"2024-09-10T05:57:29.889887+0000","last_peered":"2024-09-10T05:57:29.889887+0000","last_clean":"2024-09-10T05:57:29.889887+0000","last_became_active":"2024-09-10T05:56:23.036371+0000","last_became_peered":"2024-09-10T05:56:23.036371+0000","last_unstale":"2024-09-10T05:57:29.889887+0000","last_undegraded":"2024-09-10T05:57:29.889887+0000","last_fullsized":"2024-09-10T05:57:29.889887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:18.668696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'2","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.896251+0000","last_change":"2024-09-10T05:56:23.057903+0000","last_active":"2024-09-10T05:57:29.896251+0000","last_peered":"2024-09-10T05:57:29.896251+0000","last_clean":"2024-09-10T05:57:29.896251+0000","last_became_active":"2024-09-10T05:56:23.056044+0000","last_became_peered":"2024-09-10T05:56:23.056044+0000","last_unstale":"2024-09-10T05:57:29.896251+0000","last_undegraded":"2024-09-10T05:57:29.896251+0000","last_fullsized":"2024-09-10T05:57:29.896251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:23.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"72'1","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889835+0000","last_change":"2024-09-10T05:56:23.039960+0000","last_active":"2024-09-10T05:57:29.889835+0000","last_peered":"2024-09-10T05:57:29.889835+0000","last_clean":"2024-09-10T05:57:29.889835+0000","last_became_active":"2024-09-10T05:56:23.027827+0000","last_became_peered":"2024-09-10T05:56:23.027827+0000","last_unstale":"2024-09-10T05:57:29.889835+0000","last_undegraded":"2024-09-10T05:57:29.889835+0000","last_fullsized":"2024-09-10T05:57:29.889835+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:52.667117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801819+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:57:29.801819+0000","last_peered":"2024-09-10T05:57:29.801819+0000","last_clean":"2024-09-10T05:57:29.801819+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:57:29.801819+0000","last_undegraded":"2024-09-10T05:57:29.801819+0000","last_fullsized":"2024-09-10T05:57:29.801819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"74'24","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897806+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:57:29.897806+0000","last_peered":"2024-09-10T05:57:29.897806+0000","last_clean":"2024-09-10T05:57:29.897806+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:57:29.897806+0000","last_undegraded":"2024-09-10T05:57:29.897806+0000","last_fullsized":"2024-09-10T05:57:29.897806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808486+0000","last_change":"2024-09-10T05:56:23.042970+0000","last_active":"2024-09-10T05:57:29.808486+0000","last_peered":"2024-09-10T05:57:29.808486+0000","last_clean":"2024-09-10T05:57:29.808486+0000","last_became_active":"2024-09-10T05:56:23.041811+0000","last_became_peered":"2024-09-10T05:56:23.041811+0000","last_unstale":"2024-09-10T05:57:29.808486+0000","last_undegraded":"2024-09-10T05:57:29.808486+0000","last_fullsized":"2024-09-10T05:57:29.808486+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:27.729049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887822+0000","last_change":"2024-09-10T05:56:23.045520+0000","last_active":"2024-09-10T05:57:29.887822+0000","last_peered":"2024-09-10T05:57:29.887822+0000","last_clean":"2024-09-10T05:57:29.887822+0000","last_became_active":"2024-09-10T05:56:23.044502+0000","last_became_peered":"2024-09-10T05:56:23.044502+0000","last_unstale":"2024-09-10T05:57:29.887822+0000","last_undegraded":"2024-09-10T05:57:29.887822+0000","last_fullsized":"2024-09-10T05:57:29.887822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:45.272996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"80'3","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895510+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:57:29.895510+0000","last_peered":"2024-09-10T05:57:29.895510+0000","last_clean":"2024-09-10T05:57:29.895510+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:57:29.895510+0000","last_undegraded":"2024-09-10T05:57:29.895510+0000","last_fullsized":"2024-09-10T05:57:29.895510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"74'6","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803550+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:57:29.803550+0000","last_peered":"2024-09-10T05:57:29.803550+0000","last_clean":"2024-09-10T05:57:29.803550+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:57:29.803550+0000","last_undegraded":"2024-09-10T05:57:29.803550+0000","last_fullsized":"2024-09-10T05:57:29.803550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888209+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:57:29.888209+0000","last_peered":"2024-09-10T05:57:29.888209+0000","last_clean":"2024-09-10T05:57:29.888209+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:57:29.888209+0000","last_undegraded":"2024-09-10T05:57:29.888209+0000","last_fullsized":"2024-09-10T05:57:29.888209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"74'20","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802434+0000","last_change":"2024-09-10T05:56:23.109965+0000","last_active":"2024-09-10T05:57:29.802434+0000","last_peered":"2024-09-10T05:57:29.802434+0000","last_clean":"2024-09-10T05:57:29.802434+0000","last_became_active":"2024-09-10T05:56:23.061551+0000","last_became_peered":"2024-09-10T05:56:23.061551+0000","last_unstale":"2024-09-10T05:57:29.802434+0000","last_undegraded":"2024-09-10T05:57:29.802434+0000","last_fullsized":"2024-09-10T05:57:29.802434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:17.436490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"80'104","reported_seq":258,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802075+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:57:29.802075+0000","last_peered":"2024-09-10T05:57:29.802075+0000","last_clean":"2024-09-10T05:57:29.802075+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:57:29.802075+0000","last_undegraded":"2024-09-10T05:57:29.802075+0000","last_fullsized":"2024-09-10T05:57:29.802075+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888129+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:57:29.888129+0000","last_peered":"2024-09-10T05:57:29.888129+0000","last_clean":"2024-09-10T05:57:29.888129+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:57:29.888129+0000","last_undegraded":"2024-09-10T05:57:29.888129+0000","last_fullsized":"2024-09-10T05:57:29.888129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"74'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.898432+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:57:29.898432+0000","last_peered":"2024-09-10T05:57:29.898432+0000","last_clean":"2024-09-10T05:57:29.898432+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:57:29.898432+0000","last_undegraded":"2024-09-10T05:57:29.898432+0000","last_fullsized":"2024-09-10T05:57:29.898432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895639+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:57:29.895639+0000","last_peered":"2024-09-10T05:57:29.895639+0000","last_clean":"2024-09-10T05:57:29.895639+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:57:29.895639+0000","last_undegraded":"2024-09-10T05:57:29.895639+0000","last_fullsized":"2024-09-10T05:57:29.895639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":266,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890243+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:57:29.890243+0000","last_peered":"2024-09-10T05:57:29.890243+0000","last_clean":"2024-09-10T05:57:29.890243+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:57:29.890243+0000","last_undegraded":"2024-09-10T05:57:29.890243+0000","last_fullsized":"2024-09-10T05:57:29.890243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":81,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889676+0000","last_change":"2024-09-10T05:56:23.121112+0000","last_active":"2024-09-10T05:57:29.889676+0000","last_peered":"2024-09-10T05:57:29.889676+0000","last_clean":"2024-09-10T05:57:29.889676+0000","last_became_active":"2024-09-10T05:56:23.025741+0000","last_became_peered":"2024-09-10T05:56:23.025741+0000","last_unstale":"2024-09-10T05:57:29.889676+0000","last_undegraded":"2024-09-10T05:57:29.889676+0000","last_fullsized":"2024-09-10T05:57:29.889676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:43.488695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"80'104","reported_seq":284,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802946+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:57:29.802946+0000","last_peered":"2024-09-10T05:57:29.802946+0000","last_clean":"2024-09-10T05:57:29.802946+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:57:29.802946+0000","last_undegraded":"2024-09-10T05:57:29.802946+0000","last_fullsized":"2024-09-10T05:57:29.802946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892823+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:57:29.892823+0000","last_peered":"2024-09-10T05:57:29.892823+0000","last_clean":"2024-09-10T05:57:29.892823+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:57:29.892823+0000","last_undegraded":"2024-09-10T05:57:29.892823+0000","last_fullsized":"2024-09-10T05:57:29.892823+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890165+0000","last_change":"2024-09-10T05:56:23.037294+0000","last_active":"2024-09-10T05:57:29.890165+0000","last_peered":"2024-09-10T05:57:29.890165+0000","last_clean":"2024-09-10T05:57:29.890165+0000","last_became_active":"2024-09-10T05:56:23.036712+0000","last_became_peered":"2024-09-10T05:56:23.036712+0000","last_unstale":"2024-09-10T05:57:29.890165+0000","last_undegraded":"2024-09-10T05:57:29.890165+0000","last_fullsized":"2024-09-10T05:57:29.890165+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:09.211978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"74'2","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887543+0000","last_change":"2024-09-10T05:56:23.052086+0000","last_active":"2024-09-10T05:57:29.887543+0000","last_peered":"2024-09-10T05:57:29.887543+0000","last_clean":"2024-09-10T05:57:29.887543+0000","last_became_active":"2024-09-10T05:56:23.049459+0000","last_became_peered":"2024-09-10T05:56:23.049459+0000","last_unstale":"2024-09-10T05:57:29.887543+0000","last_undegraded":"2024-09-10T05:57:29.887543+0000","last_fullsized":"2024-09-10T05:57:29.887543+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:34.805862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.898171+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:57:29.898171+0000","last_peered":"2024-09-10T05:57:29.898171+0000","last_clean":"2024-09-10T05:57:29.898171+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:57:29.898171+0000","last_undegraded":"2024-09-10T05:57:29.898171+0000","last_fullsized":"2024-09-10T05:57:29.898171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"74'22","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891208+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:57:29.891208+0000","last_peered":"2024-09-10T05:57:29.891208+0000","last_clean":"2024-09-10T05:57:29.891208+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:57:29.891208+0000","last_undegraded":"2024-09-10T05:57:29.891208+0000","last_fullsized":"2024-09-10T05:57:29.891208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802572+0000","last_change":"2024-09-10T05:56:23.050573+0000","last_active":"2024-09-10T05:57:29.802572+0000","last_peered":"2024-09-10T05:57:29.802572+0000","last_clean":"2024-09-10T05:57:29.802572+0000","last_became_active":"2024-09-10T05:56:23.049743+0000","last_became_peered":"2024-09-10T05:56:23.049743+0000","last_unstale":"2024-09-10T05:57:29.802572+0000","last_undegraded":"2024-09-10T05:57:29.802572+0000","last_fullsized":"2024-09-10T05:57:29.802572+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889139+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:57:29.889139+0000","last_peered":"2024-09-10T05:57:29.889139+0000","last_clean":"2024-09-10T05:57:29.889139+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:57:29.889139+0000","last_undegraded":"2024-09-10T05:57:29.889139+0000","last_fullsized":"2024-09-10T05:57:29.889139+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'6","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803750+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:57:29.803750+0000","last_peered":"2024-09-10T05:57:29.803750+0000","last_clean":"2024-09-10T05:57:29.803750+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:57:29.803750+0000","last_undegraded":"2024-09-10T05:57:29.803750+0000","last_fullsized":"2024-09-10T05:57:29.803750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":243,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811601+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:57:30.811601+0000","last_peered":"2024-09-10T05:57:30.811601+0000","last_clean":"2024-09-10T05:57:30.811601+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:57:30.811601+0000","last_undegraded":"2024-09-10T05:57:30.811601+0000","last_fullsized":"2024-09-10T05:57:30.811601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890173+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:57:29.890173+0000","last_peered":"2024-09-10T05:57:29.890173+0000","last_clean":"2024-09-10T05:57:29.890173+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:57:29.890173+0000","last_undegraded":"2024-09-10T05:57:29.890173+0000","last_fullsized":"2024-09-10T05:57:29.890173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"72'2","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888677+0000","last_change":"2024-09-10T05:56:23.037052+0000","last_active":"2024-09-10T05:57:29.888677+0000","last_peered":"2024-09-10T05:57:29.888677+0000","last_clean":"2024-09-10T05:57:29.888677+0000","last_became_active":"2024-09-10T05:56:23.036767+0000","last_became_peered":"2024-09-10T05:56:23.036767+0000","last_unstale":"2024-09-10T05:57:29.888677+0000","last_undegraded":"2024-09-10T05:57:29.888677+0000","last_fullsized":"2024-09-10T05:57:29.888677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:19:09.974956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":130,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812324+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:57:30.812324+0000","last_peered":"2024-09-10T05:57:30.812324+0000","last_clean":"2024-09-10T05:57:30.812324+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:57:30.812324+0000","last_undegraded":"2024-09-10T05:57:30.812324+0000","last_fullsized":"2024-09-10T05:57:30.812324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"74'34","reported_seq":216,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890548+0000","last_change":"2024-09-10T05:56:23.124071+0000","last_active":"2024-09-10T05:57:29.890548+0000","last_peered":"2024-09-10T05:57:29.890548+0000","last_clean":"2024-09-10T05:57:29.890548+0000","last_became_active":"2024-09-10T05:56:23.062515+0000","last_became_peered":"2024-09-10T05:56:23.062515+0000","last_unstale":"2024-09-10T05:57:29.890548+0000","last_undegraded":"2024-09-10T05:57:29.890548+0000","last_fullsized":"2024-09-10T05:57:29.890548+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809234+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:57:29.809234+0000","last_peered":"2024-09-10T05:57:29.809234+0000","last_clean":"2024-09-10T05:57:29.809234+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:57:29.809234+0000","last_undegraded":"2024-09-10T05:57:29.809234+0000","last_fullsized":"2024-09-10T05:57:29.809234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801799+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:57:29.801799+0000","last_peered":"2024-09-10T05:57:29.801799+0000","last_clean":"2024-09-10T05:57:29.801799+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:57:29.801799+0000","last_undegraded":"2024-09-10T05:57:29.801799+0000","last_fullsized":"2024-09-10T05:57:29.801799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809414+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:57:29.809414+0000","last_peered":"2024-09-10T05:57:29.809414+0000","last_clean":"2024-09-10T05:57:29.809414+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:57:29.809414+0000","last_undegraded":"2024-09-10T05:57:29.809414+0000","last_fullsized":"2024-09-10T05:57:29.809414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811351+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:57:30.811351+0000","last_peered":"2024-09-10T05:57:30.811351+0000","last_clean":"2024-09-10T05:57:30.811351+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:57:30.811351+0000","last_undegraded":"2024-09-10T05:57:30.811351+0000","last_fullsized":"2024-09-10T05:57:30.811351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"74'3","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808931+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:57:29.808931+0000","last_peered":"2024-09-10T05:57:29.808931+0000","last_clean":"2024-09-10T05:57:29.808931+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:57:29.808931+0000","last_undegraded":"2024-09-10T05:57:29.808931+0000","last_fullsized":"2024-09-10T05:57:29.808931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892306+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:57:29.892306+0000","last_peered":"2024-09-10T05:57:29.892306+0000","last_clean":"2024-09-10T05:57:29.892306+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:57:29.892306+0000","last_undegraded":"2024-09-10T05:57:29.892306+0000","last_fullsized":"2024-09-10T05:57:29.892306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"80'113","reported_seq":317,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888122+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:57:29.888122+0000","last_peered":"2024-09-10T05:57:29.888122+0000","last_clean":"2024-09-10T05:57:29.888122+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:57:29.888122+0000","last_undegraded":"2024-09-10T05:57:29.888122+0000","last_fullsized":"2024-09-10T05:57:29.888122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":155,"num_read_kb":139,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813887+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:57:30.813887+0000","last_peered":"2024-09-10T05:57:30.813887+0000","last_clean":"2024-09-10T05:57:30.813887+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:57:30.813887+0000","last_undegraded":"2024-09-10T05:57:30.813887+0000","last_fullsized":"2024-09-10T05:57:30.813887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":123,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888571+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:57:29.888571+0000","last_peered":"2024-09-10T05:57:29.888571+0000","last_clean":"2024-09-10T05:57:29.888571+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:57:29.888571+0000","last_undegraded":"2024-09-10T05:57:29.888571+0000","last_fullsized":"2024-09-10T05:57:29.888571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"66'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890250+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:57:29.890250+0000","last_peered":"2024-09-10T05:57:29.890250+0000","last_clean":"2024-09-10T05:57:29.890250+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:57:29.890250+0000","last_undegraded":"2024-09-10T05:57:29.890250+0000","last_fullsized":"2024-09-10T05:57:29.890250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801329+0000","last_change":"2024-09-10T05:56:23.064028+0000","last_active":"2024-09-10T05:57:29.801329+0000","last_peered":"2024-09-10T05:57:29.801329+0000","last_clean":"2024-09-10T05:57:29.801329+0000","last_became_active":"2024-09-10T05:56:23.063737+0000","last_became_peered":"2024-09-10T05:56:23.063737+0000","last_unstale":"2024-09-10T05:57:29.801329+0000","last_undegraded":"2024-09-10T05:57:29.801329+0000","last_fullsized":"2024-09-10T05:57:29.801329+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:13.386211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"74'4","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889558+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:57:29.889558+0000","last_peered":"2024-09-10T05:57:29.889558+0000","last_clean":"2024-09-10T05:57:29.889558+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:57:29.889558+0000","last_undegraded":"2024-09-10T05:57:29.889558+0000","last_fullsized":"2024-09-10T05:57:29.889558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802175+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:57:29.802175+0000","last_peered":"2024-09-10T05:57:29.802175+0000","last_clean":"2024-09-10T05:57:29.802175+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:57:29.802175+0000","last_undegraded":"2024-09-10T05:57:29.802175+0000","last_fullsized":"2024-09-10T05:57:29.802175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":170,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814218+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:57:30.814218+0000","last_peered":"2024-09-10T05:57:30.814218+0000","last_clean":"2024-09-10T05:57:30.814218+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:57:30.814218+0000","last_undegraded":"2024-09-10T05:57:30.814218+0000","last_fullsized":"2024-09-10T05:57:30.814218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808889+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:57:29.808889+0000","last_peered":"2024-09-10T05:57:29.808889+0000","last_clean":"2024-09-10T05:57:29.808889+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:57:29.808889+0000","last_undegraded":"2024-09-10T05:57:29.808889+0000","last_fullsized":"2024-09-10T05:57:29.808889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889059+0000","last_change":"2024-09-10T05:56:23.045091+0000","last_active":"2024-09-10T05:57:29.889059+0000","last_peered":"2024-09-10T05:57:29.889059+0000","last_clean":"2024-09-10T05:57:29.889059+0000","last_became_active":"2024-09-10T05:56:23.037788+0000","last_became_peered":"2024-09-10T05:56:23.037788+0000","last_unstale":"2024-09-10T05:57:29.889059+0000","last_undegraded":"2024-09-10T05:57:29.889059+0000","last_fullsized":"2024-09-10T05:57:29.889059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:15.274180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"80'3","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888438+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:57:29.888438+0000","last_peered":"2024-09-10T05:57:29.888438+0000","last_clean":"2024-09-10T05:57:29.888438+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:57:29.888438+0000","last_undegraded":"2024-09-10T05:57:29.888438+0000","last_fullsized":"2024-09-10T05:57:29.888438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890927+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:57:29.890927+0000","last_peered":"2024-09-10T05:57:29.890927+0000","last_clean":"2024-09-10T05:57:29.890927+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:57:29.890927+0000","last_undegraded":"2024-09-10T05:57:29.890927+0000","last_fullsized":"2024-09-10T05:57:29.890927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"74'6","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894263+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:57:29.894263+0000","last_peered":"2024-09-10T05:57:29.894263+0000","last_clean":"2024-09-10T05:57:29.894263+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:57:29.894263+0000","last_undegraded":"2024-09-10T05:57:29.894263+0000","last_fullsized":"2024-09-10T05:57:29.894263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808236+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:57:29.808236+0000","last_peered":"2024-09-10T05:57:29.808236+0000","last_clean":"2024-09-10T05:57:29.808236+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:57:29.808236+0000","last_undegraded":"2024-09-10T05:57:29.808236+0000","last_fullsized":"2024-09-10T05:57:29.808236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":83,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890631+0000","last_change":"2024-09-10T05:56:23.133328+0000","last_active":"2024-09-10T05:57:29.890631+0000","last_peered":"2024-09-10T05:57:29.890631+0000","last_clean":"2024-09-10T05:57:29.890631+0000","last_became_active":"2024-09-10T05:56:23.028081+0000","last_became_peered":"2024-09-10T05:56:23.028081+0000","last_unstale":"2024-09-10T05:57:29.890631+0000","last_undegraded":"2024-09-10T05:57:29.890631+0000","last_fullsized":"2024-09-10T05:57:29.890631+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:08.397388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803725+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:57:29.803725+0000","last_peered":"2024-09-10T05:57:29.803725+0000","last_clean":"2024-09-10T05:57:29.803725+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:57:29.803725+0000","last_undegraded":"2024-09-10T05:57:29.803725+0000","last_fullsized":"2024-09-10T05:57:29.803725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889104+0000","last_change":"2024-09-10T05:56:23.065400+0000","last_active":"2024-09-10T05:57:29.889104+0000","last_peered":"2024-09-10T05:57:29.889104+0000","last_clean":"2024-09-10T05:57:29.889104+0000","last_became_active":"2024-09-10T05:56:23.064530+0000","last_became_peered":"2024-09-10T05:56:23.064530+0000","last_unstale":"2024-09-10T05:57:29.889104+0000","last_undegraded":"2024-09-10T05:57:29.889104+0000","last_fullsized":"2024-09-10T05:57:29.889104+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:39.048277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801361+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:57:29.801361+0000","last_peered":"2024-09-10T05:57:29.801361+0000","last_clean":"2024-09-10T05:57:29.801361+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:57:29.801361+0000","last_undegraded":"2024-09-10T05:57:29.801361+0000","last_fullsized":"2024-09-10T05:57:29.801361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893475+0000","last_change":"2024-09-10T05:56:23.061131+0000","last_active":"2024-09-10T05:57:29.893475+0000","last_peered":"2024-09-10T05:57:29.893475+0000","last_clean":"2024-09-10T05:57:29.893475+0000","last_became_active":"2024-09-10T05:56:23.059938+0000","last_became_peered":"2024-09-10T05:56:23.059938+0000","last_unstale":"2024-09-10T05:57:29.893475+0000","last_undegraded":"2024-09-10T05:57:29.893475+0000","last_fullsized":"2024-09-10T05:57:29.893475+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:24.743938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888645+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:57:29.888645+0000","last_peered":"2024-09-10T05:57:29.888645+0000","last_clean":"2024-09-10T05:57:29.888645+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:57:29.888645+0000","last_undegraded":"2024-09-10T05:57:29.888645+0000","last_fullsized":"2024-09-10T05:57:29.888645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809533+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:57:29.809533+0000","last_peered":"2024-09-10T05:57:29.809533+0000","last_clean":"2024-09-10T05:57:29.809533+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:57:29.809533+0000","last_undegraded":"2024-09-10T05:57:29.809533+0000","last_fullsized":"2024-09-10T05:57:29.809533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"74'41","reported_seq":246,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809268+0000","last_change":"2024-09-10T05:56:23.082938+0000","last_active":"2024-09-10T05:57:29.809268+0000","last_peered":"2024-09-10T05:57:29.809268+0000","last_clean":"2024-09-10T05:57:29.809268+0000","last_became_active":"2024-09-10T05:56:23.012137+0000","last_became_peered":"2024-09-10T05:56:23.012137+0000","last_unstale":"2024-09-10T05:57:29.809268+0000","last_undegraded":"2024-09-10T05:57:29.809268+0000","last_fullsized":"2024-09-10T05:57:29.809268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:12.650262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888498+0000","last_change":"2024-09-10T05:56:23.057279+0000","last_active":"2024-09-10T05:57:29.888498+0000","last_peered":"2024-09-10T05:57:29.888498+0000","last_clean":"2024-09-10T05:57:29.888498+0000","last_became_active":"2024-09-10T05:56:23.055517+0000","last_became_peered":"2024-09-10T05:56:23.055517+0000","last_unstale":"2024-09-10T05:57:29.888498+0000","last_undegraded":"2024-09-10T05:57:29.888498+0000","last_fullsized":"2024-09-10T05:57:29.888498+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:18.809677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809045+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:57:29.809045+0000","last_peered":"2024-09-10T05:57:29.809045+0000","last_clean":"2024-09-10T05:57:29.809045+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:57:29.809045+0000","last_undegraded":"2024-09-10T05:57:29.809045+0000","last_fullsized":"2024-09-10T05:57:29.809045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809869+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:57:29.809869+0000","last_peered":"2024-09-10T05:57:29.809869+0000","last_clean":"2024-09-10T05:57:29.809869+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:57:29.809869+0000","last_undegraded":"2024-09-10T05:57:29.809869+0000","last_fullsized":"2024-09-10T05:57:29.809869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"74'7","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888521+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:57:29.888521+0000","last_peered":"2024-09-10T05:57:29.888521+0000","last_clean":"2024-09-10T05:57:29.888521+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:57:29.888521+0000","last_undegraded":"2024-09-10T05:57:29.888521+0000","last_fullsized":"2024-09-10T05:57:29.888521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814796+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:57:30.814796+0000","last_peered":"2024-09-10T05:57:30.814796+0000","last_clean":"2024-09-10T05:57:30.814796+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:57:30.814796+0000","last_undegraded":"2024-09-10T05:57:30.814796+0000","last_fullsized":"2024-09-10T05:57:30.814796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802588+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:57:29.802588+0000","last_peered":"2024-09-10T05:57:29.802588+0000","last_clean":"2024-09-10T05:57:29.802588+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:57:29.802588+0000","last_undegraded":"2024-09-10T05:57:29.802588+0000","last_fullsized":"2024-09-10T05:57:29.802588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887829+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:57:29.887829+0000","last_peered":"2024-09-10T05:57:29.887829+0000","last_clean":"2024-09-10T05:57:29.887829+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:57:29.887829+0000","last_undegraded":"2024-09-10T05:57:29.887829+0000","last_fullsized":"2024-09-10T05:57:29.887829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'104","reported_seq":247,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890120+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:57:29.890120+0000","last_peered":"2024-09-10T05:57:29.890120+0000","last_clean":"2024-09-10T05:57:29.890120+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:57:29.890120+0000","last_undegraded":"2024-09-10T05:57:29.890120+0000","last_fullsized":"2024-09-10T05:57:29.890120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'1","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892115+0000","last_change":"2024-09-10T05:56:23.034838+0000","last_active":"2024-09-10T05:57:29.892115+0000","last_peered":"2024-09-10T05:57:29.892115+0000","last_clean":"2024-09-10T05:57:29.892115+0000","last_became_active":"2024-09-10T05:56:23.034573+0000","last_became_peered":"2024-09-10T05:56:23.034573+0000","last_unstale":"2024-09-10T05:57:29.892115+0000","last_undegraded":"2024-09-10T05:57:29.892115+0000","last_fullsized":"2024-09-10T05:57:29.892115+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:49.615870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887442+0000","last_change":"2024-09-10T05:56:23.008780+0000","last_active":"2024-09-10T05:57:29.887442+0000","last_peered":"2024-09-10T05:57:29.887442+0000","last_clean":"2024-09-10T05:57:29.887442+0000","last_became_active":"2024-09-10T05:56:23.008366+0000","last_became_peered":"2024-09-10T05:56:23.008366+0000","last_unstale":"2024-09-10T05:57:29.887442+0000","last_undegraded":"2024-09-10T05:57:29.887442+0000","last_fullsized":"2024-09-10T05:57:29.887442+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:13.265099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"74'2","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891792+0000","last_change":"2024-09-10T05:56:23.008892+0000","last_active":"2024-09-10T05:57:29.891792+0000","last_peered":"2024-09-10T05:57:29.891792+0000","last_clean":"2024-09-10T05:57:29.891792+0000","last_became_active":"2024-09-10T05:56:23.008313+0000","last_became_peered":"2024-09-10T05:56:23.008313+0000","last_unstale":"2024-09-10T05:57:29.891792+0000","last_undegraded":"2024-09-10T05:57:29.891792+0000","last_fullsized":"2024-09-10T05:57:29.891792+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:27.800265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890692+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:57:29.890692+0000","last_peered":"2024-09-10T05:57:29.890692+0000","last_clean":"2024-09-10T05:57:29.890692+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:57:29.890692+0000","last_undegraded":"2024-09-10T05:57:29.890692+0000","last_fullsized":"2024-09-10T05:57:29.890692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892043+0000","last_change":"2024-09-10T05:56:23.057234+0000","last_active":"2024-09-10T05:57:29.892043+0000","last_peered":"2024-09-10T05:57:29.892043+0000","last_clean":"2024-09-10T05:57:29.892043+0000","last_became_active":"2024-09-10T05:56:23.056440+0000","last_became_peered":"2024-09-10T05:56:23.056440+0000","last_unstale":"2024-09-10T05:57:29.892043+0000","last_undegraded":"2024-09-10T05:57:29.892043+0000","last_fullsized":"2024-09-10T05:57:29.892043+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:40.029847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":189,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893350+0000","last_change":"2024-09-10T05:56:23.097232+0000","last_active":"2024-09-10T05:57:29.893350+0000","last_peered":"2024-09-10T05:57:29.893350+0000","last_clean":"2024-09-10T05:57:29.893350+0000","last_became_active":"2024-09-10T05:56:23.058304+0000","last_became_peered":"2024-09-10T05:56:23.058304+0000","last_unstale":"2024-09-10T05:57:29.893350+0000","last_undegraded":"2024-09-10T05:57:29.893350+0000","last_fullsized":"2024-09-10T05:57:29.893350+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:19.449857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"80'106","reported_seq":191,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889746+0000","last_change":"2024-09-10T05:56:23.135596+0000","last_active":"2024-09-10T05:57:29.889746+0000","last_peered":"2024-09-10T05:57:29.889746+0000","last_clean":"2024-09-10T05:57:29.889746+0000","last_became_active":"2024-09-10T05:56:23.040743+0000","last_became_peered":"2024-09-10T05:56:23.040743+0000","last_unstale":"2024-09-10T05:57:29.889746+0000","last_undegraded":"2024-09-10T05:57:29.889746+0000","last_fullsized":"2024-09-10T05:57:29.889746+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:19.913543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808960+0000","last_change":"2024-09-10T05:56:23.051198+0000","last_active":"2024-09-10T05:57:29.808960+0000","last_peered":"2024-09-10T05:57:29.808960+0000","last_clean":"2024-09-10T05:57:29.808960+0000","last_became_active":"2024-09-10T05:56:23.050845+0000","last_became_peered":"2024-09-10T05:56:23.050845+0000","last_unstale":"2024-09-10T05:57:29.808960+0000","last_undegraded":"2024-09-10T05:57:29.808960+0000","last_fullsized":"2024-09-10T05:57:29.808960+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:06.435647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894889+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:57:29.894889+0000","last_peered":"2024-09-10T05:57:29.894889+0000","last_clean":"2024-09-10T05:57:29.894889+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:57:29.894889+0000","last_undegraded":"2024-09-10T05:57:29.894889+0000","last_fullsized":"2024-09-10T05:57:29.894889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"74'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809574+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:57:29.809574+0000","last_peered":"2024-09-10T05:57:29.809574+0000","last_clean":"2024-09-10T05:57:29.809574+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:57:29.809574+0000","last_undegraded":"2024-09-10T05:57:29.809574+0000","last_fullsized":"2024-09-10T05:57:29.809574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.804469+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:57:29.804469+0000","last_peered":"2024-09-10T05:57:29.804469+0000","last_clean":"2024-09-10T05:57:29.804469+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:57:29.804469+0000","last_undegraded":"2024-09-10T05:57:29.804469+0000","last_fullsized":"2024-09-10T05:57:29.804469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888218+0000","last_change":"2024-09-10T05:56:23.052359+0000","last_active":"2024-09-10T05:57:29.888218+0000","last_peered":"2024-09-10T05:57:29.888218+0000","last_clean":"2024-09-10T05:57:29.888218+0000","last_became_active":"2024-09-10T05:56:23.049786+0000","last_became_peered":"2024-09-10T05:56:23.049786+0000","last_unstale":"2024-09-10T05:57:29.888218+0000","last_undegraded":"2024-09-10T05:57:29.888218+0000","last_fullsized":"2024-09-10T05:57:29.888218+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:49.134672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"74'41","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812201+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:57:30.812201+0000","last_peered":"2024-09-10T05:57:30.812201+0000","last_clean":"2024-09-10T05:57:30.812201+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:57:30.812201+0000","last_undegraded":"2024-09-10T05:57:30.812201+0000","last_fullsized":"2024-09-10T05:57:30.812201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888796+0000","last_change":"2024-09-10T05:56:23.052211+0000","last_active":"2024-09-10T05:57:29.888796+0000","last_peered":"2024-09-10T05:57:29.888796+0000","last_clean":"2024-09-10T05:57:29.888796+0000","last_became_active":"2024-09-10T05:56:23.051916+0000","last_became_peered":"2024-09-10T05:56:23.051916+0000","last_unstale":"2024-09-10T05:57:29.888796+0000","last_undegraded":"2024-09-10T05:57:29.888796+0000","last_fullsized":"2024-09-10T05:57:29.888796+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:56.921238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890930+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:57:29.890930+0000","last_peered":"2024-09-10T05:57:29.890930+0000","last_clean":"2024-09-10T05:57:29.890930+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:57:29.890930+0000","last_undegraded":"2024-09-10T05:57:29.890930+0000","last_fullsized":"2024-09-10T05:57:29.890930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808362+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:57:29.808362+0000","last_peered":"2024-09-10T05:57:29.808362+0000","last_clean":"2024-09-10T05:57:29.808362+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:57:29.808362+0000","last_undegraded":"2024-09-10T05:57:29.808362+0000","last_fullsized":"2024-09-10T05:57:29.808362+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893346+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:57:29.893346+0000","last_peered":"2024-09-10T05:57:29.893346+0000","last_clean":"2024-09-10T05:57:29.893346+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:57:29.893346+0000","last_undegraded":"2024-09-10T05:57:29.893346+0000","last_fullsized":"2024-09-10T05:57:29.893346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.895615+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:57:29.895615+0000","last_peered":"2024-09-10T05:57:29.895615+0000","last_clean":"2024-09-10T05:57:29.895615+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:57:29.895615+0000","last_undegraded":"2024-09-10T05:57:29.895615+0000","last_fullsized":"2024-09-10T05:57:29.895615+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888893+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:57:29.888893+0000","last_peered":"2024-09-10T05:57:29.888893+0000","last_clean":"2024-09-10T05:57:29.888893+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:57:29.888893+0000","last_undegraded":"2024-09-10T05:57:29.888893+0000","last_fullsized":"2024-09-10T05:57:29.888893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"74'23","reported_seq":89,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887635+0000","last_change":"2024-09-10T05:56:23.074045+0000","last_active":"2024-09-10T05:57:29.887635+0000","last_peered":"2024-09-10T05:57:29.887635+0000","last_clean":"2024-09-10T05:57:29.887635+0000","last_became_active":"2024-09-10T05:56:23.019631+0000","last_became_peered":"2024-09-10T05:56:23.019631+0000","last_unstale":"2024-09-10T05:57:29.887635+0000","last_undegraded":"2024-09-10T05:57:29.887635+0000","last_fullsized":"2024-09-10T05:57:29.887635+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:54.559625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887635+0000","last_change":"2024-09-10T05:56:23.045936+0000","last_active":"2024-09-10T05:57:29.887635+0000","last_peered":"2024-09-10T05:57:29.887635+0000","last_clean":"2024-09-10T05:57:29.887635+0000","last_became_active":"2024-09-10T05:56:23.038258+0000","last_became_peered":"2024-09-10T05:56:23.038258+0000","last_unstale":"2024-09-10T05:57:29.887635+0000","last_undegraded":"2024-09-10T05:57:29.887635+0000","last_fullsized":"2024-09-10T05:57:29.887635+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.439503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891020+0000","last_change":"2024-09-10T05:56:23.017188+0000","last_active":"2024-09-10T05:57:29.891020+0000","last_peered":"2024-09-10T05:57:29.891020+0000","last_clean":"2024-09-10T05:57:29.891020+0000","last_became_active":"2024-09-10T05:56:23.016931+0000","last_became_peered":"2024-09-10T05:56:23.016931+0000","last_unstale":"2024-09-10T05:57:29.891020+0000","last_undegraded":"2024-09-10T05:57:29.891020+0000","last_fullsized":"2024-09-10T05:57:29.891020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:27.661737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":152,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888811+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:57:29.888811+0000","last_peered":"2024-09-10T05:57:29.888811+0000","last_clean":"2024-09-10T05:57:29.888811+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:57:29.888811+0000","last_undegraded":"2024-09-10T05:57:29.888811+0000","last_fullsized":"2024-09-10T05:57:29.888811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"74'5","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814502+0000","last_change":"2024-09-10T05:56:23.021907+0000","last_active":"2024-09-10T05:57:30.814502+0000","last_peered":"2024-09-10T05:57:30.814502+0000","last_clean":"2024-09-10T05:57:30.814502+0000","last_became_active":"2024-09-10T05:56:23.021259+0000","last_became_peered":"2024-09-10T05:56:23.021259+0000","last_unstale":"2024-09-10T05:57:30.814502+0000","last_undegraded":"2024-09-10T05:57:30.814502+0000","last_fullsized":"2024-09-10T05:57:30.814502+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:14.123922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889150+0000","last_change":"2024-09-10T05:56:23.031916+0000","last_active":"2024-09-10T05:57:29.889150+0000","last_peered":"2024-09-10T05:57:29.889150+0000","last_clean":"2024-09-10T05:57:29.889150+0000","last_became_active":"2024-09-10T05:56:23.027500+0000","last_became_peered":"2024-09-10T05:56:23.027500+0000","last_unstale":"2024-09-10T05:57:29.889150+0000","last_undegraded":"2024-09-10T05:57:29.889150+0000","last_fullsized":"2024-09-10T05:57:29.889150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:46.438549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"74'6","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807724+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:57:29.807724+0000","last_peered":"2024-09-10T05:57:29.807724+0000","last_clean":"2024-09-10T05:57:29.807724+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:57:29.807724+0000","last_undegraded":"2024-09-10T05:57:29.807724+0000","last_fullsized":"2024-09-10T05:57:29.807724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811414+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:57:30.811414+0000","last_peered":"2024-09-10T05:57:30.811414+0000","last_clean":"2024-09-10T05:57:30.811414+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:57:30.811414+0000","last_undegraded":"2024-09-10T05:57:30.811414+0000","last_fullsized":"2024-09-10T05:57:30.811414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808106+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:57:29.808106+0000","last_peered":"2024-09-10T05:57:29.808106+0000","last_clean":"2024-09-10T05:57:29.808106+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:57:29.808106+0000","last_undegraded":"2024-09-10T05:57:29.808106+0000","last_fullsized":"2024-09-10T05:57:29.808106+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'5","reported_seq":89,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887749+0000","last_change":"2024-09-10T05:56:23.018017+0000","last_active":"2024-09-10T05:57:29.887749+0000","last_peered":"2024-09-10T05:57:29.887749+0000","last_clean":"2024-09-10T05:57:29.887749+0000","last_became_active":"2024-09-10T05:56:23.008084+0000","last_became_peered":"2024-09-10T05:56:23.008084+0000","last_unstale":"2024-09-10T05:57:29.887749+0000","last_undegraded":"2024-09-10T05:57:29.887749+0000","last_fullsized":"2024-09-10T05:57:29.887749+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:37.245150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892557+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:57:29.892557+0000","last_peered":"2024-09-10T05:57:29.892557+0000","last_clean":"2024-09-10T05:57:29.892557+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:57:29.892557+0000","last_undegraded":"2024-09-10T05:57:29.892557+0000","last_fullsized":"2024-09-10T05:57:29.892557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.810784+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:57:30.810784+0000","last_peered":"2024-09-10T05:57:30.810784+0000","last_clean":"2024-09-10T05:57:30.810784+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:57:30.810784+0000","last_undegraded":"2024-09-10T05:57:30.810784+0000","last_fullsized":"2024-09-10T05:57:30.810784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"74'17","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889469+0000","last_change":"2024-09-10T05:56:23.144815+0000","last_active":"2024-09-10T05:57:29.889469+0000","last_peered":"2024-09-10T05:57:29.889469+0000","last_clean":"2024-09-10T05:57:29.889469+0000","last_became_active":"2024-09-10T05:56:23.041150+0000","last_became_peered":"2024-09-10T05:56:23.041150+0000","last_unstale":"2024-09-10T05:57:29.889469+0000","last_undegraded":"2024-09-10T05:57:29.889469+0000","last_fullsized":"2024-09-10T05:57:29.889469+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:26.741208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803709+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:57:29.803709+0000","last_peered":"2024-09-10T05:57:29.803709+0000","last_clean":"2024-09-10T05:57:29.803709+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:57:29.803709+0000","last_undegraded":"2024-09-10T05:57:29.803709+0000","last_fullsized":"2024-09-10T05:57:29.803709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"74'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890506+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:57:29.890506+0000","last_peered":"2024-09-10T05:57:29.890506+0000","last_clean":"2024-09-10T05:57:29.890506+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:57:29.890506+0000","last_undegraded":"2024-09-10T05:57:29.890506+0000","last_fullsized":"2024-09-10T05:57:29.890506+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887930+0000","last_change":"2024-09-10T05:56:23.052761+0000","last_active":"2024-09-10T05:57:29.887930+0000","last_peered":"2024-09-10T05:57:29.887930+0000","last_clean":"2024-09-10T05:57:29.887930+0000","last_became_active":"2024-09-10T05:56:23.049110+0000","last_became_peered":"2024-09-10T05:56:23.049110+0000","last_unstale":"2024-09-10T05:57:29.887930+0000","last_undegraded":"2024-09-10T05:57:29.887930+0000","last_fullsized":"2024-09-10T05:57:29.887930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:44.011144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808893+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:57:29.808893+0000","last_peered":"2024-09-10T05:57:29.808893+0000","last_clean":"2024-09-10T05:57:29.808893+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:57:29.808893+0000","last_undegraded":"2024-09-10T05:57:29.808893+0000","last_fullsized":"2024-09-10T05:57:29.808893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802204+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:57:29.802204+0000","last_peered":"2024-09-10T05:57:29.802204+0000","last_clean":"2024-09-10T05:57:29.802204+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:57:29.802204+0000","last_undegraded":"2024-09-10T05:57:29.802204+0000","last_fullsized":"2024-09-10T05:57:29.802204+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"74'14","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811380+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:57:30.811380+0000","last_peered":"2024-09-10T05:57:30.811380+0000","last_clean":"2024-09-10T05:57:30.811380+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:57:30.811380+0000","last_undegraded":"2024-09-10T05:57:30.811380+0000","last_fullsized":"2024-09-10T05:57:30.811380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809160+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:57:29.809160+0000","last_peered":"2024-09-10T05:57:29.809160+0000","last_clean":"2024-09-10T05:57:29.809160+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:57:29.809160+0000","last_undegraded":"2024-09-10T05:57:29.809160+0000","last_fullsized":"2024-09-10T05:57:29.809160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'5","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.804390+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:57:29.804390+0000","last_peered":"2024-09-10T05:57:29.804390+0000","last_clean":"2024-09-10T05:57:29.804390+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:57:29.804390+0000","last_undegraded":"2024-09-10T05:57:29.804390+0000","last_fullsized":"2024-09-10T05:57:29.804390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"74'8","reported_seq":77,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887723+0000","last_change":"2024-09-10T05:56:23.010745+0000","last_active":"2024-09-10T05:57:29.887723+0000","last_peered":"2024-09-10T05:57:29.887723+0000","last_clean":"2024-09-10T05:57:29.887723+0000","last_became_active":"2024-09-10T05:56:23.010466+0000","last_became_peered":"2024-09-10T05:56:23.010466+0000","last_unstale":"2024-09-10T05:57:29.887723+0000","last_undegraded":"2024-09-10T05:57:29.887723+0000","last_fullsized":"2024-09-10T05:57:29.887723+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:12.448397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809328+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:57:29.809328+0000","last_peered":"2024-09-10T05:57:29.809328+0000","last_clean":"2024-09-10T05:57:29.809328+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:57:29.809328+0000","last_undegraded":"2024-09-10T05:57:29.809328+0000","last_fullsized":"2024-09-10T05:57:29.809328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"74'31","reported_seq":170,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888840+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:57:29.888840+0000","last_peered":"2024-09-10T05:57:29.888840+0000","last_clean":"2024-09-10T05:57:29.888840+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:57:29.888840+0000","last_undegraded":"2024-09-10T05:57:29.888840+0000","last_fullsized":"2024-09-10T05:57:29.888840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890912+0000","last_change":"2024-09-10T05:56:23.065281+0000","last_active":"2024-09-10T05:57:29.890912+0000","last_peered":"2024-09-10T05:57:29.890912+0000","last_clean":"2024-09-10T05:57:29.890912+0000","last_became_active":"2024-09-10T05:56:23.064464+0000","last_became_peered":"2024-09-10T05:56:23.064464+0000","last_unstale":"2024-09-10T05:57:29.890912+0000","last_undegraded":"2024-09-10T05:57:29.890912+0000","last_fullsized":"2024-09-10T05:57:29.890912+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:21.392647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889230+0000","last_change":"2024-09-10T05:56:23.045151+0000","last_active":"2024-09-10T05:57:29.889230+0000","last_peered":"2024-09-10T05:57:29.889230+0000","last_clean":"2024-09-10T05:57:29.889230+0000","last_became_active":"2024-09-10T05:56:23.040353+0000","last_became_peered":"2024-09-10T05:56:23.040353+0000","last_unstale":"2024-09-10T05:57:29.889230+0000","last_undegraded":"2024-09-10T05:57:29.889230+0000","last_fullsized":"2024-09-10T05:57:29.889230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:43.668848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809386+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:57:29.809386+0000","last_peered":"2024-09-10T05:57:29.809386+0000","last_clean":"2024-09-10T05:57:29.809386+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:57:29.809386+0000","last_undegraded":"2024-09-10T05:57:29.809386+0000","last_fullsized":"2024-09-10T05:57:29.809386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"74'8","reported_seq":154,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888464+0000","last_change":"2024-09-10T05:56:23.050367+0000","last_active":"2024-09-10T05:57:29.888464+0000","last_peered":"2024-09-10T05:57:29.888464+0000","last_clean":"2024-09-10T05:57:29.888464+0000","last_became_active":"2024-09-10T05:56:23.050069+0000","last_became_peered":"2024-09-10T05:56:23.050069+0000","last_unstale":"2024-09-10T05:57:29.888464+0000","last_undegraded":"2024-09-10T05:57:29.888464+0000","last_fullsized":"2024-09-10T05:57:29.888464+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:04.360756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.804073+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:57:29.804073+0000","last_peered":"2024-09-10T05:57:29.804073+0000","last_clean":"2024-09-10T05:57:29.804073+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:57:29.804073+0000","last_undegraded":"2024-09-10T05:57:29.804073+0000","last_fullsized":"2024-09-10T05:57:29.804073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"74'20","reported_seq":155,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811961+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:57:30.811961+0000","last_peered":"2024-09-10T05:57:30.811961+0000","last_clean":"2024-09-10T05:57:30.811961+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:57:30.811961+0000","last_undegraded":"2024-09-10T05:57:30.811961+0000","last_fullsized":"2024-09-10T05:57:30.811961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889021+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:57:29.889021+0000","last_peered":"2024-09-10T05:57:29.889021+0000","last_clean":"2024-09-10T05:57:29.889021+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:57:29.889021+0000","last_undegraded":"2024-09-10T05:57:29.889021+0000","last_fullsized":"2024-09-10T05:57:29.889021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802193+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:57:29.802193+0000","last_peered":"2024-09-10T05:57:29.802193+0000","last_clean":"2024-09-10T05:57:29.802193+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:57:29.802193+0000","last_undegraded":"2024-09-10T05:57:29.802193+0000","last_fullsized":"2024-09-10T05:57:29.802193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890373+0000","last_change":"2024-09-10T05:56:23.045737+0000","last_active":"2024-09-10T05:57:29.890373+0000","last_peered":"2024-09-10T05:57:29.890373+0000","last_clean":"2024-09-10T05:57:29.890373+0000","last_became_active":"2024-09-10T05:56:23.045444+0000","last_became_peered":"2024-09-10T05:56:23.045444+0000","last_unstale":"2024-09-10T05:57:29.890373+0000","last_undegraded":"2024-09-10T05:57:29.890373+0000","last_fullsized":"2024-09-10T05:57:29.890373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:30.592439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":23,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"74'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.894130+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:57:29.894130+0000","last_peered":"2024-09-10T05:57:29.894130+0000","last_clean":"2024-09-10T05:57:29.894130+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:57:29.894130+0000","last_undegraded":"2024-09-10T05:57:29.894130+0000","last_fullsized":"2024-09-10T05:57:29.894130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":216,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897527+0000","last_change":"2024-09-10T05:56:23.127993+0000","last_active":"2024-09-10T05:57:29.897527+0000","last_peered":"2024-09-10T05:57:29.897527+0000","last_clean":"2024-09-10T05:57:29.897527+0000","last_became_active":"2024-09-10T05:56:23.062056+0000","last_became_peered":"2024-09-10T05:56:23.062056+0000","last_unstale":"2024-09-10T05:57:29.897527+0000","last_undegraded":"2024-09-10T05:57:29.897527+0000","last_fullsized":"2024-09-10T05:57:29.897527+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:40.985541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"74'24","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891681+0000","last_change":"2024-09-10T05:56:23.107948+0000","last_active":"2024-09-10T05:57:29.891681+0000","last_peered":"2024-09-10T05:57:29.891681+0000","last_clean":"2024-09-10T05:57:29.891681+0000","last_became_active":"2024-09-10T05:56:23.025431+0000","last_became_peered":"2024-09-10T05:56:23.025431+0000","last_unstale":"2024-09-10T05:57:29.891681+0000","last_undegraded":"2024-09-10T05:57:29.891681+0000","last_fullsized":"2024-09-10T05:57:29.891681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:02.951376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887817+0000","last_change":"2024-09-10T05:56:23.016482+0000","last_active":"2024-09-10T05:57:29.887817+0000","last_peered":"2024-09-10T05:57:29.887817+0000","last_clean":"2024-09-10T05:57:29.887817+0000","last_became_active":"2024-09-10T05:56:23.015986+0000","last_became_peered":"2024-09-10T05:56:23.015986+0000","last_unstale":"2024-09-10T05:57:29.887817+0000","last_undegraded":"2024-09-10T05:57:29.887817+0000","last_fullsized":"2024-09-10T05:57:29.887817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:52:20.881180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889565+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:57:29.889565+0000","last_peered":"2024-09-10T05:57:29.889565+0000","last_clean":"2024-09-10T05:57:29.889565+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:57:29.889565+0000","last_undegraded":"2024-09-10T05:57:29.889565+0000","last_fullsized":"2024-09-10T05:57:29.889565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802037+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:57:29.802037+0000","last_peered":"2024-09-10T05:57:29.802037+0000","last_clean":"2024-09-10T05:57:29.802037+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:57:29.802037+0000","last_undegraded":"2024-09-10T05:57:29.802037+0000","last_fullsized":"2024-09-10T05:57:29.802037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"74'5","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809274+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:57:29.809274+0000","last_peered":"2024-09-10T05:57:29.809274+0000","last_clean":"2024-09-10T05:57:29.809274+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:57:29.809274+0000","last_undegraded":"2024-09-10T05:57:29.809274+0000","last_fullsized":"2024-09-10T05:57:29.809274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889187+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:57:29.889187+0000","last_peered":"2024-09-10T05:57:29.889187+0000","last_clean":"2024-09-10T05:57:29.889187+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:57:29.889187+0000","last_undegraded":"2024-09-10T05:57:29.889187+0000","last_fullsized":"2024-09-10T05:57:29.889187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897963+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:57:29.897963+0000","last_peered":"2024-09-10T05:57:29.897963+0000","last_clean":"2024-09-10T05:57:29.897963+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:57:29.897963+0000","last_undegraded":"2024-09-10T05:57:29.897963+0000","last_fullsized":"2024-09-10T05:57:29.897963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"80'104","reported_seq":246,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803220+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:57:29.803220+0000","last_peered":"2024-09-10T05:57:29.803220+0000","last_clean":"2024-09-10T05:57:29.803220+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:57:29.803220+0000","last_undegraded":"2024-09-10T05:57:29.803220+0000","last_fullsized":"2024-09-10T05:57:29.803220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.810783+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:57:30.810783+0000","last_peered":"2024-09-10T05:57:30.810783+0000","last_clean":"2024-09-10T05:57:30.810783+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:57:30.810783+0000","last_undegraded":"2024-09-10T05:57:30.810783+0000","last_fullsized":"2024-09-10T05:57:30.810783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893072+0000","last_change":"2024-09-10T05:56:23.057534+0000","last_active":"2024-09-10T05:57:29.893072+0000","last_peered":"2024-09-10T05:57:29.893072+0000","last_clean":"2024-09-10T05:57:29.893072+0000","last_became_active":"2024-09-10T05:56:23.055973+0000","last_became_peered":"2024-09-10T05:56:23.055973+0000","last_unstale":"2024-09-10T05:57:29.893072+0000","last_undegraded":"2024-09-10T05:57:29.893072+0000","last_fullsized":"2024-09-10T05:57:29.893072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:25.497531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"74'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891286+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:57:29.891286+0000","last_peered":"2024-09-10T05:57:29.891286+0000","last_clean":"2024-09-10T05:57:29.891286+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:57:29.891286+0000","last_undegraded":"2024-09-10T05:57:29.891286+0000","last_fullsized":"2024-09-10T05:57:29.891286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811659+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:57:30.811659+0000","last_peered":"2024-09-10T05:57:30.811659+0000","last_clean":"2024-09-10T05:57:30.811659+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:57:30.811659+0000","last_undegraded":"2024-09-10T05:57:30.811659+0000","last_fullsized":"2024-09-10T05:57:30.811659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"74'44","reported_seq":200,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890002+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:57:29.890002+0000","last_peered":"2024-09-10T05:57:29.890002+0000","last_clean":"2024-09-10T05:57:29.890002+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:57:29.890002+0000","last_undegraded":"2024-09-10T05:57:29.890002+0000","last_fullsized":"2024-09-10T05:57:29.890002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807504+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:57:29.807504+0000","last_peered":"2024-09-10T05:57:29.807504+0000","last_clean":"2024-09-10T05:57:29.807504+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:57:29.807504+0000","last_undegraded":"2024-09-10T05:57:29.807504+0000","last_fullsized":"2024-09-10T05:57:29.807504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":117,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.813522+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:57:30.813522+0000","last_peered":"2024-09-10T05:57:30.813522+0000","last_clean":"2024-09-10T05:57:30.813522+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:57:30.813522+0000","last_undegraded":"2024-09-10T05:57:30.813522+0000","last_fullsized":"2024-09-10T05:57:30.813522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"66'2","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893458+0000","last_change":"2024-09-10T05:56:59.849209+0000","last_active":"2024-09-10T05:57:29.893458+0000","last_peered":"2024-09-10T05:57:29.893458+0000","last_clean":"2024-09-10T05:57:29.893458+0000","last_became_active":"2024-09-10T05:56:59.844131+0000","last_became_peered":"2024-09-10T05:56:59.844131+0000","last_unstale":"2024-09-10T05:57:29.893458+0000","last_undegraded":"2024-09-10T05:57:29.893458+0000","last_fullsized":"2024-09-10T05:57:29.893458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:41.776545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"73'3","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893270+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:57:29.893270+0000","last_peered":"2024-09-10T05:57:29.893270+0000","last_clean":"2024-09-10T05:57:29.893270+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:57:29.893270+0000","last_undegraded":"2024-09-10T05:57:29.893270+0000","last_fullsized":"2024-09-10T05:57:29.893270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889753+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:57:29.889753+0000","last_peered":"2024-09-10T05:57:29.889753+0000","last_clean":"2024-09-10T05:57:29.889753+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:57:29.889753+0000","last_undegraded":"2024-09-10T05:57:29.889753+0000","last_fullsized":"2024-09-10T05:57:29.889753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"74'20","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.807507+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:57:29.807507+0000","last_peered":"2024-09-10T05:57:29.807507+0000","last_clean":"2024-09-10T05:57:29.807507+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:57:29.807507+0000","last_undegraded":"2024-09-10T05:57:29.807507+0000","last_fullsized":"2024-09-10T05:57:29.807507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801953+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:57:29.801953+0000","last_peered":"2024-09-10T05:57:29.801953+0000","last_clean":"2024-09-10T05:57:29.801953+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:57:29.801953+0000","last_undegraded":"2024-09-10T05:57:29.801953+0000","last_fullsized":"2024-09-10T05:57:29.801953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890853+0000","last_change":"2024-09-10T05:56:23.034843+0000","last_active":"2024-09-10T05:57:29.890853+0000","last_peered":"2024-09-10T05:57:29.890853+0000","last_clean":"2024-09-10T05:57:29.890853+0000","last_became_active":"2024-09-10T05:56:23.033226+0000","last_became_peered":"2024-09-10T05:56:23.033226+0000","last_unstale":"2024-09-10T05:57:29.890853+0000","last_undegraded":"2024-09-10T05:57:29.890853+0000","last_fullsized":"2024-09-10T05:57:29.890853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:40.377323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":87,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888020+0000","last_change":"2024-09-10T05:56:23.034224+0000","last_active":"2024-09-10T05:57:29.888020+0000","last_peered":"2024-09-10T05:57:29.888020+0000","last_clean":"2024-09-10T05:57:29.888020+0000","last_became_active":"2024-09-10T05:56:23.033976+0000","last_became_peered":"2024-09-10T05:56:23.033976+0000","last_unstale":"2024-09-10T05:57:29.888020+0000","last_undegraded":"2024-09-10T05:57:29.888020+0000","last_fullsized":"2024-09-10T05:57:29.888020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:30.677812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"74'5","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890742+0000","last_change":"2024-09-10T05:56:23.026756+0000","last_active":"2024-09-10T05:57:29.890742+0000","last_peered":"2024-09-10T05:57:29.890742+0000","last_clean":"2024-09-10T05:57:29.890742+0000","last_became_active":"2024-09-10T05:56:23.026265+0000","last_became_peered":"2024-09-10T05:56:23.026265+0000","last_unstale":"2024-09-10T05:57:29.890742+0000","last_undegraded":"2024-09-10T05:57:29.890742+0000","last_fullsized":"2024-09-10T05:57:29.890742+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:00.455768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":126,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888794+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:57:29.888794+0000","last_peered":"2024-09-10T05:57:29.888794+0000","last_clean":"2024-09-10T05:57:29.888794+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:57:29.888794+0000","last_undegraded":"2024-09-10T05:57:29.888794+0000","last_fullsized":"2024-09-10T05:57:29.888794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"74'16","reported_seq":82,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889562+0000","last_change":"2024-09-10T05:56:23.093611+0000","last_active":"2024-09-10T05:57:29.889562+0000","last_peered":"2024-09-10T05:57:29.889562+0000","last_clean":"2024-09-10T05:57:29.889562+0000","last_became_active":"2024-09-10T05:56:23.021588+0000","last_became_peered":"2024-09-10T05:56:23.021588+0000","last_unstale":"2024-09-10T05:57:29.889562+0000","last_undegraded":"2024-09-10T05:57:29.889562+0000","last_fullsized":"2024-09-10T05:57:29.889562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:05.418407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892041+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:57:29.892041+0000","last_peered":"2024-09-10T05:57:29.892041+0000","last_clean":"2024-09-10T05:57:29.892041+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:57:29.892041+0000","last_undegraded":"2024-09-10T05:57:29.892041+0000","last_fullsized":"2024-09-10T05:57:29.892041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814092+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:57:30.814092+0000","last_peered":"2024-09-10T05:57:30.814092+0000","last_clean":"2024-09-10T05:57:30.814092+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:57:30.814092+0000","last_undegraded":"2024-09-10T05:57:30.814092+0000","last_fullsized":"2024-09-10T05:57:30.814092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889523+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:57:29.889523+0000","last_peered":"2024-09-10T05:57:29.889523+0000","last_clean":"2024-09-10T05:57:29.889523+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:57:29.889523+0000","last_undegraded":"2024-09-10T05:57:29.889523+0000","last_fullsized":"2024-09-10T05:57:29.889523+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"73'2","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802331+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:57:29.802331+0000","last_peered":"2024-09-10T05:57:29.802331+0000","last_clean":"2024-09-10T05:57:29.802331+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:57:29.802331+0000","last_undegraded":"2024-09-10T05:57:29.802331+0000","last_fullsized":"2024-09-10T05:57:29.802331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887930+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:57:29.887930+0000","last_peered":"2024-09-10T05:57:29.887930+0000","last_clean":"2024-09-10T05:57:29.887930+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:57:29.887930+0000","last_undegraded":"2024-09-10T05:57:29.887930+0000","last_fullsized":"2024-09-10T05:57:29.887930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"74'27","reported_seq":168,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892435+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:57:29.892435+0000","last_peered":"2024-09-10T05:57:29.892435+0000","last_clean":"2024-09-10T05:57:29.892435+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:57:29.892435+0000","last_undegraded":"2024-09-10T05:57:29.892435+0000","last_fullsized":"2024-09-10T05:57:29.892435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":118,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809055+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:57:29.809055+0000","last_peered":"2024-09-10T05:57:29.809055+0000","last_clean":"2024-09-10T05:57:29.809055+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:57:29.809055+0000","last_undegraded":"2024-09-10T05:57:29.809055+0000","last_fullsized":"2024-09-10T05:57:29.809055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.897732+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:57:29.897732+0000","last_peered":"2024-09-10T05:57:29.897732+0000","last_clean":"2024-09-10T05:57:29.897732+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:57:29.897732+0000","last_undegraded":"2024-09-10T05:57:29.897732+0000","last_fullsized":"2024-09-10T05:57:29.897732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"66'2","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890077+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:57:29.890077+0000","last_peered":"2024-09-10T05:57:29.890077+0000","last_clean":"2024-09-10T05:57:29.890077+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:57:29.890077+0000","last_undegraded":"2024-09-10T05:57:29.890077+0000","last_fullsized":"2024-09-10T05:57:29.890077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'5","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802113+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:57:29.802113+0000","last_peered":"2024-09-10T05:57:29.802113+0000","last_clean":"2024-09-10T05:57:29.802113+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:57:29.802113+0000","last_undegraded":"2024-09-10T05:57:29.802113+0000","last_fullsized":"2024-09-10T05:57:29.802113+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":162,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890466+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:57:29.890466+0000","last_peered":"2024-09-10T05:57:29.890466+0000","last_clean":"2024-09-10T05:57:29.890466+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:57:29.890466+0000","last_undegraded":"2024-09-10T05:57:29.890466+0000","last_fullsized":"2024-09-10T05:57:29.890466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"74'3","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801356+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:57:29.801356+0000","last_peered":"2024-09-10T05:57:29.801356+0000","last_clean":"2024-09-10T05:57:29.801356+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:57:29.801356+0000","last_undegraded":"2024-09-10T05:57:29.801356+0000","last_fullsized":"2024-09-10T05:57:29.801356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'3","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892602+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:57:29.892602+0000","last_peered":"2024-09-10T05:57:29.892602+0000","last_clean":"2024-09-10T05:57:29.892602+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:57:29.892602+0000","last_undegraded":"2024-09-10T05:57:29.892602+0000","last_fullsized":"2024-09-10T05:57:29.892602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"74'3","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890795+0000","last_change":"2024-09-10T05:56:23.060633+0000","last_active":"2024-09-10T05:57:29.890795+0000","last_peered":"2024-09-10T05:57:29.890795+0000","last_clean":"2024-09-10T05:57:29.890795+0000","last_became_active":"2024-09-10T05:56:23.059675+0000","last_became_peered":"2024-09-10T05:56:23.059675+0000","last_unstale":"2024-09-10T05:57:29.890795+0000","last_undegraded":"2024-09-10T05:57:29.890795+0000","last_fullsized":"2024-09-10T05:57:29.890795+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:54.126172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888566+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:57:29.888566+0000","last_peered":"2024-09-10T05:57:29.888566+0000","last_clean":"2024-09-10T05:57:29.888566+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:57:29.888566+0000","last_undegraded":"2024-09-10T05:57:29.888566+0000","last_fullsized":"2024-09-10T05:57:29.888566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"74'4","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809563+0000","last_change":"2024-09-10T05:56:23.047159+0000","last_active":"2024-09-10T05:57:29.809563+0000","last_peered":"2024-09-10T05:57:29.809563+0000","last_clean":"2024-09-10T05:57:29.809563+0000","last_became_active":"2024-09-10T05:56:23.046548+0000","last_became_peered":"2024-09-10T05:56:23.046548+0000","last_unstale":"2024-09-10T05:57:29.809563+0000","last_undegraded":"2024-09-10T05:57:29.809563+0000","last_fullsized":"2024-09-10T05:57:29.809563+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:39.908493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808947+0000","last_change":"2024-09-10T05:56:54.822912+0000","last_active":"2024-09-10T05:57:29.808947+0000","last_peered":"2024-09-10T05:57:29.808947+0000","last_clean":"2024-09-10T05:57:29.808947+0000","last_became_active":"2024-09-10T05:56:54.820694+0000","last_became_peered":"2024-09-10T05:56:54.820694+0000","last_unstale":"2024-09-10T05:57:29.808947+0000","last_undegraded":"2024-09-10T05:57:29.808947+0000","last_fullsized":"2024-09-10T05:57:29.808947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:16.363744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"74'7","reported_seq":76,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890027+0000","last_change":"2024-09-10T05:56:23.028796+0000","last_active":"2024-09-10T05:57:29.890027+0000","last_peered":"2024-09-10T05:57:29.890027+0000","last_clean":"2024-09-10T05:57:29.890027+0000","last_became_active":"2024-09-10T05:56:23.028497+0000","last_became_peered":"2024-09-10T05:56:23.028497+0000","last_unstale":"2024-09-10T05:57:29.890027+0000","last_undegraded":"2024-09-10T05:57:29.890027+0000","last_fullsized":"2024-09-10T05:57:29.890027+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:09.207385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"67'6","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893991+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:57:29.893991+0000","last_peered":"2024-09-10T05:57:29.893991+0000","last_clean":"2024-09-10T05:57:29.893991+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:57:29.893991+0000","last_undegraded":"2024-09-10T05:57:29.893991+0000","last_fullsized":"2024-09-10T05:57:29.893991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"74'7","reported_seq":153,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.889393+0000","last_change":"2024-09-10T05:56:23.037012+0000","last_active":"2024-09-10T05:57:29.889393+0000","last_peered":"2024-09-10T05:57:29.889393+0000","last_clean":"2024-09-10T05:57:29.889393+0000","last_became_active":"2024-09-10T05:56:23.036730+0000","last_became_peered":"2024-09-10T05:56:23.036730+0000","last_unstale":"2024-09-10T05:57:29.889393+0000","last_undegraded":"2024-09-10T05:57:29.889393+0000","last_fullsized":"2024-09-10T05:57:29.889393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:47.789902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.887852+0000","last_change":"2024-09-10T05:56:23.049294+0000","last_active":"2024-09-10T05:57:29.887852+0000","last_peered":"2024-09-10T05:57:29.887852+0000","last_clean":"2024-09-10T05:57:29.887852+0000","last_became_active":"2024-09-10T05:56:23.049026+0000","last_became_peered":"2024-09-10T05:56:23.049026+0000","last_unstale":"2024-09-10T05:57:29.887852+0000","last_undegraded":"2024-09-10T05:57:29.887852+0000","last_fullsized":"2024-09-10T05:57:29.887852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:42.468350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"74'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803806+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:57:29.803806+0000","last_peered":"2024-09-10T05:57:29.803806+0000","last_clean":"2024-09-10T05:57:29.803806+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:57:29.803806+0000","last_undegraded":"2024-09-10T05:57:29.803806+0000","last_fullsized":"2024-09-10T05:57:29.803806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":148,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801992+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:57:29.801992+0000","last_peered":"2024-09-10T05:57:29.801992+0000","last_clean":"2024-09-10T05:57:29.801992+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:57:29.801992+0000","last_undegraded":"2024-09-10T05:57:29.801992+0000","last_fullsized":"2024-09-10T05:57:29.801992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'3","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.892234+0000","last_change":"2024-09-10T05:56:23.055385+0000","last_active":"2024-09-10T05:57:29.892234+0000","last_peered":"2024-09-10T05:57:29.892234+0000","last_clean":"2024-09-10T05:57:29.892234+0000","last_became_active":"2024-09-10T05:56:23.053209+0000","last_became_peered":"2024-09-10T05:56:23.053209+0000","last_unstale":"2024-09-10T05:57:29.892234+0000","last_undegraded":"2024-09-10T05:57:29.892234+0000","last_fullsized":"2024-09-10T05:57:29.892234+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:12.695061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808576+0000","last_change":"2024-09-10T05:56:23.043354+0000","last_active":"2024-09-10T05:57:29.808576+0000","last_peered":"2024-09-10T05:57:29.808576+0000","last_clean":"2024-09-10T05:57:29.808576+0000","last_became_active":"2024-09-10T05:56:23.042470+0000","last_became_peered":"2024-09-10T05:56:23.042470+0000","last_unstale":"2024-09-10T05:57:29.808576+0000","last_undegraded":"2024-09-10T05:57:29.808576+0000","last_fullsized":"2024-09-10T05:57:29.808576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:34.970506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"74'3","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890258+0000","last_change":"2024-09-10T05:56:23.065960+0000","last_active":"2024-09-10T05:57:29.890258+0000","last_peered":"2024-09-10T05:57:29.890258+0000","last_clean":"2024-09-10T05:57:29.890258+0000","last_became_active":"2024-09-10T05:56:23.064580+0000","last_became_peered":"2024-09-10T05:56:23.064580+0000","last_unstale":"2024-09-10T05:57:29.890258+0000","last_undegraded":"2024-09-10T05:57:29.890258+0000","last_fullsized":"2024-09-10T05:57:29.890258+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:54.286114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"80'6","reported_seq":150,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.898187+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:57:29.898187+0000","last_peered":"2024-09-10T05:57:29.898187+0000","last_clean":"2024-09-10T05:57:29.898187+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:57:29.898187+0000","last_undegraded":"2024-09-10T05:57:29.898187+0000","last_fullsized":"2024-09-10T05:57:29.898187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"74'3","reported_seq":72,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888131+0000","last_change":"2024-09-10T05:56:23.039970+0000","last_active":"2024-09-10T05:57:29.888131+0000","last_peered":"2024-09-10T05:57:29.888131+0000","last_clean":"2024-09-10T05:57:29.888131+0000","last_became_active":"2024-09-10T05:56:23.028702+0000","last_became_peered":"2024-09-10T05:56:23.028702+0000","last_unstale":"2024-09-10T05:57:29.888131+0000","last_undegraded":"2024-09-10T05:57:29.888131+0000","last_fullsized":"2024-09-10T05:57:29.888131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:00.770967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.801954+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:57:29.801954+0000","last_peered":"2024-09-10T05:57:29.801954+0000","last_clean":"2024-09-10T05:57:29.801954+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:57:29.801954+0000","last_undegraded":"2024-09-10T05:57:29.801954+0000","last_fullsized":"2024-09-10T05:57:29.801954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"74'9","reported_seq":143,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.890726+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:57:29.890726+0000","last_peered":"2024-09-10T05:57:29.890726+0000","last_clean":"2024-09-10T05:57:29.890726+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:57:29.890726+0000","last_undegraded":"2024-09-10T05:57:29.890726+0000","last_fullsized":"2024-09-10T05:57:29.890726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.896950+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:57:29.896950+0000","last_peered":"2024-09-10T05:57:29.896950+0000","last_clean":"2024-09-10T05:57:29.896950+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:57:29.896950+0000","last_undegraded":"2024-09-10T05:57:29.896950+0000","last_fullsized":"2024-09-10T05:57:29.896950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"72'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.809680+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:57:29.809680+0000","last_peered":"2024-09-10T05:57:29.809680+0000","last_clean":"2024-09-10T05:57:29.809680+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:57:29.809680+0000","last_undegraded":"2024-09-10T05:57:29.809680+0000","last_fullsized":"2024-09-10T05:57:29.809680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'2","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.812638+0000","last_change":"2024-09-10T05:56:23.041678+0000","last_active":"2024-09-10T05:57:30.812638+0000","last_peered":"2024-09-10T05:57:30.812638+0000","last_clean":"2024-09-10T05:57:30.812638+0000","last_became_active":"2024-09-10T05:56:23.040913+0000","last_became_peered":"2024-09-10T05:56:23.040913+0000","last_unstale":"2024-09-10T05:57:30.812638+0000","last_undegraded":"2024-09-10T05:57:30.812638+0000","last_fullsized":"2024-09-10T05:57:30.812638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:42.175576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'2","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.803578+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:57:29.803578+0000","last_peered":"2024-09-10T05:57:29.803578+0000","last_clean":"2024-09-10T05:57:29.803578+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:57:29.803578+0000","last_undegraded":"2024-09-10T05:57:29.803578+0000","last_fullsized":"2024-09-10T05:57:29.803578+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808009+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:57:29.808009+0000","last_peered":"2024-09-10T05:57:29.808009+0000","last_clean":"2024-09-10T05:57:29.808009+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:57:29.808009+0000","last_undegraded":"2024-09-10T05:57:29.808009+0000","last_fullsized":"2024-09-10T05:57:29.808009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'4","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.814765+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:57:30.814765+0000","last_peered":"2024-09-10T05:57:30.814765+0000","last_clean":"2024-09-10T05:57:30.814765+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:57:30.814765+0000","last_undegraded":"2024-09-10T05:57:30.814765+0000","last_fullsized":"2024-09-10T05:57:30.814765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888294+0000","last_change":"2024-09-10T05:56:23.040862+0000","last_active":"2024-09-10T05:57:29.888294+0000","last_peered":"2024-09-10T05:57:29.888294+0000","last_clean":"2024-09-10T05:57:29.888294+0000","last_became_active":"2024-09-10T05:56:23.040554+0000","last_became_peered":"2024-09-10T05:56:23.040554+0000","last_unstale":"2024-09-10T05:57:29.888294+0000","last_undegraded":"2024-09-10T05:57:29.888294+0000","last_fullsized":"2024-09-10T05:57:29.888294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:05.730570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"74'3","reported_seq":137,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.802256+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:57:29.802256+0000","last_peered":"2024-09-10T05:57:29.802256+0000","last_clean":"2024-09-10T05:57:29.802256+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:57:29.802256+0000","last_undegraded":"2024-09-10T05:57:29.802256+0000","last_fullsized":"2024-09-10T05:57:29.802256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-10T05:57:30.811133+0000","last_change":"2024-09-10T05:56:23.022264+0000","last_active":"2024-09-10T05:57:30.811133+0000","last_peered":"2024-09-10T05:57:30.811133+0000","last_clean":"2024-09-10T05:57:30.811133+0000","last_became_active":"2024-09-10T05:56:23.021493+0000","last_became_peered":"2024-09-10T05:56:23.021493+0000","last_unstale":"2024-09-10T05:57:30.811133+0000","last_undegraded":"2024-09-10T05:57:30.811133+0000","last_fullsized":"2024-09-10T05:57:30.811133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:17.610734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"73'4","reported_seq":138,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.893585+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:57:29.893585+0000","last_peered":"2024-09-10T05:57:29.893585+0000","last_clean":"2024-09-10T05:57:29.893585+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:57:29.893585+0000","last_undegraded":"2024-09-10T05:57:29.893585+0000","last_fullsized":"2024-09-10T05:57:29.893585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'8","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.800998+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:57:29.800998+0000","last_peered":"2024-09-10T05:57:29.800998+0000","last_clean":"2024-09-10T05:57:29.800998+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:57:29.800998+0000","last_undegraded":"2024-09-10T05:57:29.800998+0000","last_fullsized":"2024-09-10T05:57:29.800998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"67'2","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.808596+0000","last_change":"2024-09-10T05:56:23.043355+0000","last_active":"2024-09-10T05:57:29.808596+0000","last_peered":"2024-09-10T05:57:29.808596+0000","last_clean":"2024-09-10T05:57:29.808596+0000","last_became_active":"2024-09-10T05:56:23.042207+0000","last_became_peered":"2024-09-10T05:56:23.042207+0000","last_unstale":"2024-09-10T05:57:29.808596+0000","last_undegraded":"2024-09-10T05:57:29.808596+0000","last_fullsized":"2024-09-10T05:57:29.808596+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:01.926326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"74'2","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.888323+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:57:29.888323+0000","last_peered":"2024-09-10T05:57:29.888323+0000","last_clean":"2024-09-10T05:57:29.888323+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:57:29.888323+0000","last_undegraded":"2024-09-10T05:57:29.888323+0000","last_fullsized":"2024-09-10T05:57:29.888323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T05:57:29.891385+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:57:29.891385+0000","last_peered":"2024-09-10T05:57:29.891385+0000","last_clean":"2024-09-10T05:57:29.891385+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:57:29.891385+0000","last_undegraded":"2024-09-10T05:57:29.891385+0000","last_fullsized":"2024-09-10T05:57:29.891385+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":264,"num_write":236,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":836,"ondisk_log_size":836,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":83511,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1089,"num_read_kb":816,"num_write":635,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":2090,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":127162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":826,"ondisk_log_size":826,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1136,"num_read_kb":1116,"num_write":239,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":307,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368692,"kb_used_data":337500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94003148,"statfs":{"total":96636764160,"available":96259223552,"internally_reserved":0,"allocated":345600000,"data_stored":345101396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241124,"kb_used_data":209932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94130716,"statfs":{"total":96636764160,"available":96389853184,"internally_reserved":0,"allocated":214970368,"data_stored":214488493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284248,"kb_used_data":253052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94087592,"statfs":{"total":96636764160,"available":96345694208,"internally_reserved":0,"allocated":259125248,"data_stored":258587317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542176,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300492,"kb_used_data":269300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94071348,"statfs":{"total":96636764160,"available":96329060352,"internally_reserved":0,"allocated":275763200,"data_stored":275297942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337460,"kb_used_data":302108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94034380,"statfs":{"total":96636764160,"available":96291205120,"internally_reserved":0,"allocated":309358592,"data_stored":308853868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251396,"kb_used_data":216044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94120444,"statfs":{"total":96636764160,"available":96379334656,"internally_reserved":0,"allocated":221229056,"data_stored":220770282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231016,"kb_used_data":195660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94140824,"statfs":{"total":96636764160,"available":96400203776,"internally_reserved":0,"allocated":200355840,"data_stored":199857876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542176,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350296,"kb_used_data":314944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94021544,"statfs":{"total":96636764160,"available":96278061056,"internally_reserved":0,"allocated":322502656,"data_stored":322024692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":320864256,"data_stored":320864256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":199229440,"data_stored":199229440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":220200960,"data_stored":220200960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":274726912,"data_stored":274726912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":257949696,"data_stored":257949696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":213909504,"data_stored":213909504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":343932928,"data_stored":343932928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":59227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":60781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:57:32.721 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-10T05:57:32.722 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T05:57:32.722 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 4, 5, 6, 7, 3] 2024-09-10T05:57:32.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-10T05:57:32.723 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:32.720+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:32.756 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:32.756 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:32.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:32.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:32.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:57:32.835 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:32.830+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:32.926 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:32.920+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:32.941 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:32.941 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:32.944 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:32.944 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:32.959 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:32.963 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:32.981 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:32.981 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:32.996 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:33.015 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:33.016 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:33.034 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:33.034 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:33.047 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:33.044+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:33.054 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:33.054 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:33.063 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-10T05:57:33.058+0000 7fa00a078640 -1 mon.a@0(leader).osd e89 definitely_dead 0 2024-09-10T05:57:33.074 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:33.074 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:33.127 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:33.122+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 146.14533057899999, 2024-09-10T05:57:33.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:57:33.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:57:33.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:57:33.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 144.18978604399999, 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018129757, 2024-09-10T05:57:33.140 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938334+0000", 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938335+0000", 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.077e-06 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938345+0000", 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0339999999999999e-05 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938363+0000", 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.819e-05 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.938376+0000", 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3176000000000001e-05 2024-09-10T05:57:33.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954476+0000", 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016099558999999999 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954601+0000", 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000124623 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.954809+0000", 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020784899999999999 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956220+0000", 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014112440000000001 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956299+0000", 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9010000000000004e-05 2024-09-10T05:57:33.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956400+0000", 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010133599999999999 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.956463+0000", 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3353000000000001e-05 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.570174414, 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:57:33.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:33.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.152 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.673562156000003, 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.153 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:57:33.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:57:33.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1950 3.11 3:89848d6d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.705912804, 2024-09-10T05:57:33.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020018444999999999, 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1950 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422207+0000", 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.422209+0000", 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.419e-06 2024-09-10T05:57:33.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426537+0000", 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043276149999999999 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426567+0000", 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0301999999999999e-05 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426580+0000", 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2917e-05 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426672+0000", 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2218000000000004e-05 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.426843+0000", 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017047699999999999 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.427340+0000", 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049682899999999996 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442068+0000", 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01472853 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442088+0000", 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:57:33.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442160+0000", 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2138000000000006e-05 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:48.442225+0000", 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5186999999999998e-05 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2698 3.d 3:b2e26eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.504509370000001, 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019089317000000001, 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2698 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.166 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623610+0000", 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.623614+0000", 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.614e-06 2024-09-10T05:57:33.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628427+0000", 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048128399999999997 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628456+0000", 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9379000000000001e-05 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628473+0000", 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6436e-05 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628541+0000", 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8375999999999997e-05 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628668+0000", 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012706699999999999 2024-09-10T05:57:33.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.628770+0000", 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102012 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636407+0000", 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076366639999999996 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642629+0000", 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062227059999999997 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642670+0000", 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0228999999999997e-05 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.642700+0000", 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9994000000000001e-05 2024-09-10T05:57:33.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2715 3.3b 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.328512304, 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024491215, 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.172 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2715 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799607+0000", 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.799611+0000", 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4740000000000001e-06 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803674+0000", 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040627750000000002 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803699+0000", 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4998999999999999e-05 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803716+0000", 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.713e-05 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.803861+0000", 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:33.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804271+0000", 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000410782 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.804670+0000", 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039885499999999999 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823762+0000", 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01909168 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823814+0000", 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2293000000000002e-05 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.823978+0000", 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016379799999999999 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.824099+0000", 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120677 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2716 3.3b 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.318556628000003, 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021381936000000001, 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.178 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2716 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809563+0000", 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.809566+0000", 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4700000000000001e-06 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814350+0000", 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047846349999999998 2024-09-10T05:57:33.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814391+0000", 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0881999999999999e-05 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.814417+0000", 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.816891+0000", 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024744400000000001 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817142+0000", 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025102600000000001 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.817376+0000", 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234267 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.826993+0000", 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096162609999999992 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830661+0000", 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036685229999999999 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830823+0000", 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016209899999999999 2024-09-10T05:57:33.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.830945+0000", 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012169 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2736 3.15 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.113239897, 2024-09-10T05:57:33.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021012902999999999, 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2736 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014880+0000", 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014883+0000", 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1269999999999999e-06 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019463+0000", 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045800299999999997 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019510+0000", 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7361999999999998e-05 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019530+0000", 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.997e-05 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019681+0000", 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015094500000000001 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.019911+0000", 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022981400000000001 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020130+0000", 2024-09-10T05:57:33.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021882 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.032856+0000", 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012725670999999999 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035613+0000", 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027571359999999999 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035768+0000", 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015560199999999999 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035893+0000", 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012442599999999999 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2735 3.2a e74/24 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head v 74'7, mlcod=73'5)", 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.112308024000001, 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018481485999999998, 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015812+0000", 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015813+0000", 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1699999999999997e-07 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020431+0000", 2024-09-10T05:57:33.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046181900000000003 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020481+0000", 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0204999999999998e-05 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020504+0000", 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3193e-05 2024-09-10T05:57:33.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020625+0000", 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012044600000000001 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.020660+0000", 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5865999999999998e-05 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034217+0000", 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013556558 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034293+0000", 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6211000000000006e-05 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.103853268000002, 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:57:33.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:57:33.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2738 3.39 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.091349055000002, 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439545999999999, 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2738 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.202 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036771+0000", 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.036773+0000", 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5000000000000002e-06 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042338+0000", 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055647520000000001 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042369+0000", 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1009000000000001e-05 2024-09-10T05:57:33.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042388+0000", 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8612999999999999e-05 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042526+0000", 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138806 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.042842+0000", 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000315295 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.043126+0000", 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028447800000000001 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.052457+0000", 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093312510000000005 2024-09-10T05:57:33.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.056914+0000", 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044569600000000003 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057087+0000", 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017276499999999999 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.057210+0000", 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012311700000000001 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2754 3.2a e74/24 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head v 74'9, mlcod=74'7)", 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.926520978999999, 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020956794000000001, 2024-09-10T05:57:33.208 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201599+0000", 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201602+0000", 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1130000000000001e-06 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204828+0000", 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032265219999999999 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204882+0000", 2024-09-10T05:57:33.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3205000000000003e-05 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204909+0000", 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7138999999999999e-05 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205102+0000", 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019347099999999999 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.205161+0000", 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8291999999999997e-05 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222429+0000", 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017268480999999999 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222556+0000", 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012657099999999999 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.212 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.923374672000001, 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.213 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:57:33.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:57:33.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:57:33.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2760 3.37 3:ee0dd768:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.874680183999999, 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021061340000000001, 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2760 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253440+0000", 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.253444+0000", 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6229999999999996e-06 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258934+0000", 2024-09-10T05:57:33.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005489524 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.258985+0000", 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0986000000000003e-05 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259001+0000", 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6541999999999998e-05 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259120+0000", 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118564 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259374+0000", 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025416600000000001 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.259600+0000", 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225563 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.269405+0000", 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098055409999999992 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274344+0000", 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049393040000000003 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274432+0000", 2024-09-10T05:57:33.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7616999999999998e-05 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274501+0000", 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8910000000000003e-05 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:33.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.853798671, 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:57:33.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:57:33.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2765 3.e 3:7051b691:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_228:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.823171566999999, 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019300435000000001, 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.230 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2765 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304948+0000", 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.304951+0000", 2024-09-10T05:57:33.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8169999999999999e-06 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308937+0000", 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039864169999999999 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308970+0000", 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2965e-05 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.308987+0000", 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6710000000000001e-05 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309116+0000", 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012852800000000001 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309342+0000", 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000225942 2024-09-10T05:57:33.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.309553+0000", 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021175999999999999 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.320354+0000", 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010800535999999999 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.323937+0000", 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035836290000000001 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324118+0000", 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000180695 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.324249+0000", 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130436 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2767 3.37 3:ef27b18b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.799085335000001, 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019966886, 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2767 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329034+0000", 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.329038+0000", 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3299999999999999e-06 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333904+0000", 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048659869999999996 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333944+0000", 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0735000000000002e-05 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.333964+0000", 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9443e-05 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334121+0000", 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015721499999999999 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334365+0000", 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024407000000000001 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.334588+0000", 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022284 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.346368+0000", 2024-09-10T05:57:33.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011780255 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348673+0000", 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023048080000000002 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.348858+0000", 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184904 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.349001+0000", 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143299 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2773 3.3f 3:fca9534a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.733268079999998, 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018274233000000001, 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2773 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394852+0000", 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.394855+0000", 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4630000000000001e-06 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399567+0000", 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047114490000000004 2024-09-10T05:57:33.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399609+0000", 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2082999999999997e-05 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399627+0000", 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8532000000000001e-05 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.399768+0000", 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141216 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400014+0000", 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000245947 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.400243+0000", 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022854 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.408899+0000", 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086558520000000003 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412825+0000", 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039261599999999997 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.412993+0000", 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016819099999999999 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.413126+0000", 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001328 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2780 3.15 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.249 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.651615283000002, 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020859142000000001, 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2780 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476504+0000", 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.476525+0000", 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669000000000001e-05 2024-09-10T05:57:33.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480305+0000", 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037793739999999998 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480340+0000", 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5082000000000001e-05 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480356+0000", 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5985999999999999e-05 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480444+0000", 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8898000000000002e-05 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480600+0000", 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155685 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.480746+0000", 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014611 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.487929+0000", 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071829750000000003 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497194+0000", 2024-09-10T05:57:33.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092649140000000008 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497294+0000", 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100134 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.497364+0000", 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9314999999999996e-05 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.255 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:33.256 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:33.256 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:33.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:33.258 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:33.254+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:33.358 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:33.354+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:33.376 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:33.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:33.377 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:33.377 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:33.390 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:33.476 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:33.474+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:33.546 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:33.546 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:33.546 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:33.546 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:33.547 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:33.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:33.560 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:33.554+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:33.660 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:33.658+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:33.721 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:33.721 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:33.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:33.721 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:33.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.721 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 120.10241297499999, 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010822066, 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 206 2024-09-10T05:57:33.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616498+0000", 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616502+0000", 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0860000000000004e-06 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616518+0000", 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6189999999999999e-05 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.724 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616556+0000", 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7982999999999999e-05 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616582+0000", 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5809999999999999e-05 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.725 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616740+0000", 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158462 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.616751+0000", 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0677e-05 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623402+0000", 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066507019999999997 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.726 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.623721+0000", 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031919400000000002 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.624415+0000", 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00069446799999999995 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.626011+0000", 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001595398 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.727 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627079+0000", 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001067938 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627219+0000", 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014055900000000001 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627320+0000", 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100599 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.728 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.729 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.729 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1947 3.3 e66/24 3:c2a08664:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:33.729 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:33.729 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.314717318, 2024-09-10T05:57:33.729 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013054759000000001, 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.730 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404194+0000", 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.404196+0000", 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.731 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409810+0000", 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056139830000000003 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409851+0000", 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0615000000000003e-05 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409874+0000", 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3476e-05 2024-09-10T05:57:33.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.733 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.733 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.733 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409997+0000", 2024-09-10T05:57:33.733 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000122745 2024-09-10T05:57:33.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.410025+0000", 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7559000000000002e-05 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417196+0000", 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071715090000000004 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.734 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417248+0000", 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2225999999999998e-05 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2675 3.1 3:808dd43d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.382734917000001, 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016454241000000001, 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.735 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2675 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.736 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336179+0000", 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337951+0000", 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017720329999999999 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.737 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337984+0000", 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3022000000000003e-05 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337999+0000", 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4942e-05 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338081+0000", 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1463000000000003e-05 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.738 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338193+0000", 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111705 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338294+0000", 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101019 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.739 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.347997+0000", 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097033069999999996 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352514+0000", 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045167970000000003 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.740 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352577+0000", 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3260000000000001e-05 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352630+0000", 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3208999999999998e-05 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2681 3.3a e73/24 3:5e71f715:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_144:head v 73'5, mlcod=66'3)", 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.296914541, 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011684702999999999, 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.742 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421996+0000", 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.421997+0000", 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6800000000000001e-07 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427043+0000", 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005046498 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427064+0000", 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1158999999999999e-05 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427078+0000", 2024-09-10T05:57:33.744 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3239e-05 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427168+0000", 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0364000000000004e-05 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.427198+0000", 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.745 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433637+0000", 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0064382279999999998 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433681+0000", 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4484000000000003e-05 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.746 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2682 3.20 e73/24 3:072f3612:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_145:head v 73'4, mlcod=72'2)", 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.285124902, 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010326201, 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.747 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433786+0000", 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.433806+0000", 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0290999999999999e-05 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437646+0000", 2024-09-10T05:57:33.748 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038398439999999998 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437669+0000", 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3298e-05 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437684+0000", 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.438e-05 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.749 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437777+0000", 2024-09-10T05:57:33.750 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3194000000000003e-05 2024-09-10T05:57:33.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.750 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.750 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.750 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.437809+0000", 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2131000000000001e-05 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444041+0000", 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062315460000000001 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.444112+0000", 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1517e-05 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.751 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2686 3.3 e73/24 3:c107c1dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_149:head v 73'4, mlcod=71'2)", 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.234086640000001, 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010201259000000001, 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:33.752 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484824+0000", 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.484826+0000", 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.86e-06 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.753 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488806+0000", 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797879999999997 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488834+0000", 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8004000000000002e-05 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488848+0000", 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4344e-05 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488944+0000", 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5981000000000001e-05 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.488975+0000", 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0510000000000001e-05 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.494982+0000", 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060074969999999997 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.495025+0000", 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3275000000000002e-05 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2700 3.1b 3:db80fad5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.756 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.075635603999999, 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503279, 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2700 2024-09-10T05:57:33.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643275+0000", 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.643278+0000", 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3470000000000001e-06 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644670+0000", 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013922209999999999 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644698+0000", 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8152000000000001e-05 2024-09-10T05:57:33.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644711+0000", 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3495999999999999e-05 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644816+0000", 2024-09-10T05:57:33.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010404 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.644945+0000", 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129939 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645082+0000", 2024-09-10T05:57:33.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013664999999999999 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.649392+0000", 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043094989999999996 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656648+0000", 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072568629999999997 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656720+0000", 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1913000000000001e-05 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656779+0000", 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8158999999999997e-05 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2701 3.3d 3:bc92f7d4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.064524302999999, 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013087995, 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2701 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654387+0000", 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.654389+0000", 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2000000000000001e-06 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655645+0000", 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012560150000000001 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655669+0000", 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3845999999999998e-05 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655679+0000", 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.004e-05 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655738+0000", 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8989000000000001e-05 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655897+0000", 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015926800000000001 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.655995+0000", 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7600000000000001e-05 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666093+0000", 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010098452000000001 2024-09-10T05:57:33.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666169+0000", 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6196e-05 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666236+0000", 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7260000000000003e-05 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.667475+0000", 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012381289999999999 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2705 3.17 3:eba32b22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:33.770 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.026541643000002, 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017940067000000001, 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692372+0000", 2024-09-10T05:57:33.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693889+0000", 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015172370000000001 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693920+0000", 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1291999999999998e-05 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693933+0000", 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2693e-05 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694001+0000", 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830000000000006e-05 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694130+0000", 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129114 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694285+0000", 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015531599999999999 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.698265+0000", 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797950000000004 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710231+0000", 2024-09-10T05:57:33.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011966348999999999 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710272+0000", 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1193999999999999e-05 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710309+0000", 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6888000000000003e-05 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.776 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.875662929999997, 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:57:33.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:57:33.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.783 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2729 3.3 e74/24 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.762592126000001, 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011635193, 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.956319+0000", 2024-09-10T05:57:33.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.41e-07 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962186+0000", 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058669120000000002 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962213+0000", 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7018000000000001e-05 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962225+0000", 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1836e-05 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962541+0000", 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031584199999999999 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.962569+0000", 2024-09-10T05:57:33.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8175e-05 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967897+0000", 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053282190000000004 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967954+0000", 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6950000000000002e-05 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.723493232999999, 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.790 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:57:33.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.790 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:57:33.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:57:33.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2738 3.39 e74/24 3:9e4ba406:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_201:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.674722109000001, 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013163921, 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044189+0000", 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.044191+0000", 2024-09-10T05:57:33.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.396e-06 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050959+0000", 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067675360000000002 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050982+0000", 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3275999999999999e-05 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.050995+0000", 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2873e-05 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051071+0000", 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5782000000000001e-05 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.051099+0000", 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7895999999999999e-05 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057285+0000", 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.006186067 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.057353+0000", 2024-09-10T05:57:33.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8095000000000004e-05 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2742 3.1 3:81622134:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.643490642000003, 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016996092000000001, 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.801 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2742 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075424+0000", 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3380000000000001e-06 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077125+0000", 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001701504 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077157+0000", 2024-09-10T05:57:33.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1665000000000003e-05 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077172+0000", 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379e-05 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077245+0000", 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2706000000000005e-05 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077418+0000", 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017356399999999999 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077574+0000", 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015575499999999999 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.082224+0000", 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046503439999999998 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092275+0000", 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010050738 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092356+0000", 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0822999999999995e-05 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092416+0000", 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0275999999999997e-05 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2746 3.23 3:c7325450:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.603540590999998, 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011885972999999999, 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2746 2024-09-10T05:57:33.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115370+0000", 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.115373+0000", 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7920000000000001e-06 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117159+0000", 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017863670000000001 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117189+0000", 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9201e-05 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117203+0000", 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117288+0000", 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5383000000000006e-05 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117416+0000", 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012752799999999999 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.117552+0000", 2024-09-10T05:57:33.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013568900000000001 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.124143+0000", 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065914249999999997 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127122+0000", 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029785509999999999 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127197+0000", 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5593000000000006e-05 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.127256+0000", 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9051000000000001e-05 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.813 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2750 3.1b 3:da716242:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.56260975, 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016402756000000001, 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2750 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.814 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156304+0000", 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7590000000000002e-06 2024-09-10T05:57:33.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157544+0000", 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012403900000000001 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157569+0000", 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5133000000000001e-05 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157580+0000", 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0953e-05 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157672+0000", 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1685000000000001e-05 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157859+0000", 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694499999999999 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.158038+0000", 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017913299999999999 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.163265+0000", 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052268569999999997 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172626+0000", 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093605370000000004 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172667+0000", 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1764999999999997e-05 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172704+0000", 2024-09-10T05:57:33.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6599e-05 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2771 3.23 3:c48b55d9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.345855317999998, 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010835595999999999, 2024-09-10T05:57:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2771 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373056+0000", 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.373059+0000", 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1650000000000002e-06 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374820+0000", 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017613310000000001 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374853+0000", 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2728999999999998e-05 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374868+0000", 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5591999999999999e-05 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.374966+0000", 2024-09-10T05:57:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7194999999999994e-05 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375153+0000", 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018719799999999999 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.375332+0000", 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017948500000000001 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.381064+0000", 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057316939999999999 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383759+0000", 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026946779999999998 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383833+0000", 2024-09-10T05:57:33.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4826999999999994e-05 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383891+0000", 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7701999999999997e-05 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2777 3.1b 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.280527051999997, 2024-09-10T05:57:33.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019570203000000001, 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2777 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438387+0000", 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9009999999999998e-06 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439946+0000", 2024-09-10T05:57:33.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00155905 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439975+0000", 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9311000000000001e-05 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439988+0000", 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3319000000000001e-05 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440057+0000", 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8208999999999997e-05 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440175+0000", 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118261 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440286+0000", 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111242 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.444527+0000", 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042409800000000001 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457848+0000", 2024-09-10T05:57:33.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013320702 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457903+0000", 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457954+0000", 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1319000000000001e-05 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2781 3.6 3:62f67cea:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.231569114000003, 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012768417000000001, 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.833 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2781 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487342+0000", 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.487346+0000", 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4279999999999998e-06 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489317+0000", 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019705460000000001 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489360+0000", 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3350999999999999e-05 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489382+0000", 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1744000000000001e-05 2024-09-10T05:57:33.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489504+0000", 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012243599999999999 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489754+0000", 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000249425 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.489995+0000", 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000241151 2024-09-10T05:57:33.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.498069+0000", 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080742499999999998 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500028+0000", 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019588600000000002 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500078+0000", 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0157000000000001e-05 2024-09-10T05:57:33.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.500110+0000", 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2069000000000001e-05 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2785 3.12 3:49663187:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:33.839 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.179237684, 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015080374000000001, 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2785 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539676+0000", 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542236+0000", 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025599830000000001 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542273+0000", 2024-09-10T05:57:33.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7063000000000001e-05 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542288+0000", 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.518e-05 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542365+0000", 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7292999999999993e-05 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542494+0000", 2024-09-10T05:57:33.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012883099999999999 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542615+0000", 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012126899999999999 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.546794+0000", 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041788149999999998 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:33.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554636+0000", 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078412470000000008 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554707+0000", 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1899999999999999e-05 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554754+0000", 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6103999999999998e-05 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.845 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.846 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:33.846 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:33.846 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:33.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:33.847 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:57:33.850 INFO:teuthology.orchestra.run.smithi070.stderr:marked out osd.3. 2024-09-10T05:57:33.853 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:33.842+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:33.948 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:33.944+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:33.979 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:33.979 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:33.979 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:33.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:34.048 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:34.046+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:34.118 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:34.118 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:34.118 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:34.118 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:34.118 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:34.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:34.176 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:34.174+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:34.251 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:34.248+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:34.306 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:34.306 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:34.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:34.306 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:34.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 127.747547978, 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:57:34.307 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:57:34.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:57:34.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.313 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:1948 3.19 3:9ae3dc4d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.4__shadow_.EsrSLMsJgUzkfr-oEBL3vfrZB61aSbD_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.894105830999997, 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010681995999999999, 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 1948 2024-09-10T05:57:34.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409644+0000", 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.409648+0000", 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.411e-06 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411596+0000", 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019481749999999999 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411627+0000", 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1130000000000002e-05 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411642+0000", 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5102e-05 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411726+0000", 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4006999999999997e-05 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.411888+0000", 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016162500000000001 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.412039+0000", 2024-09-10T05:57:34.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000151848 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.417810+0000", 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057708580000000002 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420232+0000", 2024-09-10T05:57:34.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024214610000000002 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420290+0000", 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8136e-05 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:48.420326+0000", 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6242999999999998e-05 2024-09-10T05:57:34.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2688 3.19 3:9a5c5cc5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.798857962, 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099290669999999998, 2024-09-10T05:57:34.321 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2688 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504892+0000", 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.504896+0000", 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8249999999999998e-06 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506826+0000", 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019305049999999999 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506850+0000", 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3751999999999999e-05 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506863+0000", 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2989999999999999e-05 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.506961+0000", 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8059000000000004e-05 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.507146+0000", 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018474400000000001 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.507311+0000", 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164697 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.513952+0000", 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066411070000000003 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514712+0000", 2024-09-10T05:57:34.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00076031000000000004 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514774+0000", 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1544000000000006e-05 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.514821+0000", 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7534000000000003e-05 2024-09-10T05:57:34.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2689 3.19 3:99575c67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.783031324, 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01027197, 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2689 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520719+0000", 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.520722+0000", 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3739999999999998e-06 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522419+0000", 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016969960000000001 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522441+0000", 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1698000000000001e-05 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522455+0000", 2024-09-10T05:57:34.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3828e-05 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522549+0000", 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4091000000000004e-05 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522727+0000", 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000178204 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.522887+0000", 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015975200000000001 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530377+0000", 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007490493 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530872+0000", 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00049481000000000004 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530938+0000", 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6459999999999997e-05 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.530991+0000", 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2264e-05 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2695 3.4 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.711723192999997, 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013307572, 2024-09-10T05:57:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592030+0000", 2024-09-10T05:57:34.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8650000000000001e-06 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594049+0000", 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002019449 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594078+0000", 2024-09-10T05:57:34.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9376000000000001e-05 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594092+0000", 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3505e-05 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594168+0000", 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6063999999999995e-05 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594293+0000", 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012461899999999999 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594406+0000", 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112983 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.341 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605086+0000", 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010680383999999999 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605259+0000", 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172659 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605303+0000", 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4651000000000003e-05 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605334+0000", 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1016999999999998e-05 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.343 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2699 3.25 3:a7585b47:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.670050179, 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011556090999999999, 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2699 2024-09-10T05:57:34.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633700+0000", 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.633701+0000", 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.55e-06 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635063+0000", 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001361473 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635086+0000", 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3175000000000001e-05 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635099+0000", 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.274e-05 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635179+0000", 2024-09-10T05:57:34.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0327999999999994e-05 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635295+0000", 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011636 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.635412+0000", 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000116941 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.640453+0000", 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050403840000000002 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645131+0000", 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046778169999999999 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645201+0000", 2024-09-10T05:57:34.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0526999999999997e-05 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.645256+0000", 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4796000000000002e-05 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2717 3.25 3:a515f872:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:34.350 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.483778749999999, 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011604369, 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2717 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819975+0000", 2024-09-10T05:57:34.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821866+0000", 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00189079 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821899+0000", 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809000000000001e-05 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821914+0000", 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5e-05 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822002+0000", 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7892999999999993e-05 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822154+0000", 2024-09-10T05:57:34.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015216200000000001 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822295+0000", 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014084899999999999 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830948+0000", 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086527919999999994 2024-09-10T05:57:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831454+0000", 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050560199999999996 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831520+0000", 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6017000000000002e-05 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831576+0000", 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5825000000000002e-05 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2726 3.3e 3:7ca2d2f7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:34.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.387356201000003, 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010261348, 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2726 2024-09-10T05:57:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916394+0000", 2024-09-10T05:57:34.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.916397+0000", 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0240000000000002e-06 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917892+0000", 2024-09-10T05:57:34.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014948850000000001 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917917+0000", 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5622999999999998e-05 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.917930+0000", 2024-09-10T05:57:34.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2567e-05 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918060+0000", 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000130588 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918224+0000", 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000163585 2024-09-10T05:57:34.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.918309+0000", 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4944999999999994e-05 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.925501+0000", 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071920430000000004 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926533+0000", 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010318090000000001 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926601+0000", 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8473000000000007e-05 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.926655+0000", 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3805999999999999e-05 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2730 3.19 3:99f0627c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:34.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.348383357000003, 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012565949999999999, 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2730 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.366 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955370+0000", 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3620000000000002e-06 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957409+0000", 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020391720000000001 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957452+0000", 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2895000000000002e-05 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957466+0000", 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4311000000000001e-05 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957588+0000", 2024-09-10T05:57:34.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121663 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957792+0000", 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203792 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957975+0000", 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183678 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965498+0000", 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075228700000000001 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967831+0000", 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023322590000000002 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967882+0000", 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1598000000000003e-05 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967933+0000", 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0349999999999997e-05 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.372 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2731 3.4 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.338598503999997, 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013157917999999999, 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2731 2024-09-10T05:57:34.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965155+0000", 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5889999999999999e-06 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966586+0000", 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001430618 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966603+0000", 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7059999999999999e-05 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966614+0000", 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1141999999999999e-05 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966689+0000", 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5574000000000005e-05 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966819+0000", 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129558 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966944+0000", 2024-09-10T05:57:34.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012527799999999999 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975490+0000", 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085459999999999998 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978216+0000", 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027259879999999999 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978268+0000", 2024-09-10T05:57:34.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1493000000000003e-05 2024-09-10T05:57:34.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978309+0000", 2024-09-10T05:57:34.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1618e-05 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2733 3.0 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.317327976999998, 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012015477, 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2733 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986425+0000", 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988599+0000", 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021740489999999999 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988621+0000", 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1922000000000001e-05 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988633+0000", 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1758e-05 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988727+0000", 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3867000000000001e-05 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988922+0000", 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019508500000000001 2024-09-10T05:57:34.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989099+0000", 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017668299999999999 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.996748+0000", 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007649159 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998318+0000", 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015705090000000001 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998382+0000", 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4036999999999997e-05 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998437+0000", 2024-09-10T05:57:34.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207000000000002e-05 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2740 3.4 3:23fd3bef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.249111305, 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011027009000000001, 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.388 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2740 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054639+0000", 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.054641+0000", 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.813e-06 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056322+0000", 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016803530000000001 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056368+0000", 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6044999999999997e-05 2024-09-10T05:57:34.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056388+0000", 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0418999999999999e-05 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056451+0000", 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2236000000000005e-05 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056584+0000", 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000133771 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.056711+0000", 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000127009 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.062350+0000", 2024-09-10T05:57:34.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056391669999999996 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065551+0000", 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003200179 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065617+0000", 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6821000000000003e-05 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.065666+0000", 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8195999999999997e-05 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2756 3.1a e74/24 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.083357413999998, 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012940208, 2024-09-10T05:57:34.395 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226300+0000", 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059069400000000003 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226316+0000", 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6509000000000001e-05 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226325+0000", 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7439999999999996e-06 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226425+0000", 2024-09-10T05:57:34.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100188 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226452+0000", 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7140000000000001e-05 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233268+0000", 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068155660000000003 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233333+0000", 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4789000000000006e-05 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2768 3.4 3:206588f5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.963208354000002, 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011512440000000001, 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2768 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340542+0000", 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.340545+0000", 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3359999999999999e-06 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342133+0000", 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001587771 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342159+0000", 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6554e-05 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342171+0000", 2024-09-10T05:57:34.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1956999999999999e-05 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342248+0000", 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6791000000000004e-05 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342372+0000", 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012425500000000001 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.342470+0000", 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7721999999999997e-05 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351396+0000", 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089259419999999992 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.351961+0000", 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00056521100000000003 2024-09-10T05:57:34.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.352021+0000", 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0003999999999997e-05 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.352054+0000", 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2897e-05 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2772 3.0 3:02cde5ff:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.920099378000003, 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010850436, 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2772 2024-09-10T05:57:34.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383651+0000", 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.383654+0000", 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.67e-06 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385466+0000", 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001811549 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385495+0000", 2024-09-10T05:57:34.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9488999999999998e-05 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385510+0000", 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5116000000000001e-05 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385617+0000", 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010702299999999999 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385796+0000", 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017860700000000001 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.385950+0000", 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015417600000000001 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.391450+0000", 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054996660000000003 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394434+0000", 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0029838529999999999 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394471+0000", 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6976e-05 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.394501+0000", 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0311000000000002e-05 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2776 3.31 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.875317299000002, 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019117624, 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2776 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428435+0000", 2024-09-10T05:57:34.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6019999999999998e-06 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429944+0000", 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001509095 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429973+0000", 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8558e-05 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429986+0000", 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3591000000000001e-05 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430053+0000", 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430167+0000", 2024-09-10T05:57:34.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114243 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430257+0000", 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9386000000000001e-05 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.434734+0000", 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044769909999999996 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447370+0000", 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012636214 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447476+0000", 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105844 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447550+0000", 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4622000000000005e-05 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2782 3.25 3:a5d3e292:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.801304407000003, 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012424736, 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2782 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502448+0000", 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505248+0000", 2024-09-10T05:57:34.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027999470000000001 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505285+0000", 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.68e-05 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505304+0000", 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9423999999999999e-05 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505417+0000", 2024-09-10T05:57:34.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011298000000000001 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505608+0000", 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019085900000000001 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505785+0000", 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176832 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.511556+0000", 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057704219999999999 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514735+0000", 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031793749999999999 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514811+0000", 2024-09-10T05:57:34.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6129000000000002e-05 2024-09-10T05:57:34.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514870+0000", 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9250999999999999e-05 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2783 3.3e 3:7c6034eb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:34.428 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 32.790222794999998, 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503764, 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2783 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513531+0000", 2024-09-10T05:57:34.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1520000000000002e-06 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516867+0000", 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033353800000000002 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516900+0000", 2024-09-10T05:57:34.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3414999999999998e-05 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516917+0000", 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867999999999998e-05 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516998+0000", 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0851000000000002e-05 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517142+0000", 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144671 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517248+0000", 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105319 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526098+0000", 2024-09-10T05:57:34.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088501629999999994 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526838+0000", 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074033699999999998 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526948+0000", 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109647 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.527031+0000", 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2960999999999994e-05 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2997 3.4 3:2257915f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:34.435 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.23502524999999999, 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015853236, 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2997 2024-09-10T05:57:34.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068729+0000", 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9790000000000004e-06 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071067+0000", 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002338363 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071102+0000", 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4694999999999999e-05 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071116+0000", 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4212e-05 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071192+0000", 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6440000000000007e-05 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071318+0000", 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012571699999999999 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071411+0000", 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2799000000000004e-05 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079634+0000", 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082235420000000004 2024-09-10T05:57:34.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084461+0000", 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048270240000000001 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084527+0000", 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5273999999999999e-05 2024-09-10T05:57:34.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084578+0000", 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1190999999999998e-05 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2998 3.0 3:00581a26:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.22465359500000001, 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011652958, 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2998 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079099+0000", 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.588e-06 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081434+0000", 2024-09-10T05:57:34.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002335213 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081462+0000", 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8107999999999999e-05 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081479+0000", 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6809000000000001e-05 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081564+0000", 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5258000000000003e-05 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081694+0000", 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129214 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081846+0000", 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000152881 2024-09-10T05:57:34.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.087780+0000", 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059333980000000003 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090625+0000", 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028450480000000002 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090689+0000", 2024-09-10T05:57:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3739999999999996e-05 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090749+0000", 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0701e-05 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.448 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:34.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:34.450 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:34.444+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:34.551 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:34.548+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:34.575 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2995 7.3 7.31099063 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.037762+0000", 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53762563799999996, 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.53766486700000005, 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.576 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2995 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037762+0000", 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037762+0000", 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037764+0000", 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1430000000000001e-06 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037772+0000", 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2879999999999993e-06 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037793+0000", 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0326000000000002e-05 2024-09-10T05:57:34.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037803+0000", 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8560000000000002e-06 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037885+0000", 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2133999999999997e-05 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037897+0000", 2024-09-10T05:57:34.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2846e-05 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2996 7.14 7.97c520d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.037831+0000", 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.53755703399999999, 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.53770465999999995, 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for peered", 2024-09-10T05:57:34.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2996 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037831+0000", 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037831+0000", 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037831+0000", 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4200000000000001e-07 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037834+0000", 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8059999999999999e-06 2024-09-10T05:57:34.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037842+0000", 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0539999999999995e-06 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037846+0000", 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7900000000000001e-06 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037888+0000", 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2177e-05 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.037897+0000", 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0080000000000008e-06 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 2 2024-09-10T05:57:34.584 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:34.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:34.651 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:34.648+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:34.708 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:34.708 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:34.708 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:34.708 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:34.708 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:34.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:34.768 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:34.766+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:34.851 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2683 3.9 e73/24 3:92807282:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_146:head v 73'3, mlcod=71'1)", 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.446850+0000", 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.399129451, 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096763019999999995, 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.852 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.446850+0000", 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.446850+0000", 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.446852+0000", 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2800000000000002e-06 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450818+0000", 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039655150000000002 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450848+0000", 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0360000000000001e-05 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450862+0000", 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4338999999999999e-05 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450961+0000", 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8301999999999995e-05 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.450989+0000", 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8365999999999999e-05 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.456450+0000", 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054605840000000001 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.456526+0000", 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6556000000000004e-05 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2684 3.3b e73/24 3:ded4c328:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_147:head v 73'6, mlcod=73'4)", 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.461033+0000", 2024-09-10T05:57:34.856 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.384946360000001, 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010447488, 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.461033+0000", 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.461033+0000", 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.461035+0000", 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.722e-06 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465834+0000", 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047998240000000003 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465856+0000", 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1441e-05 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465868+0000", 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2300000000000001e-05 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465947+0000", 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8512999999999999e-05 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.465974+0000", 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7209e-05 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.471427+0000", 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054533389999999998 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.471480+0000", 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3140000000000003e-05 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2695 3.4 e73/24 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.594518+0000", 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.251461149000001, 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098667310000000001, 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594518+0000", 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594518+0000", 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594520+0000", 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6199999999999999e-06 2024-09-10T05:57:34.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596709+0000", 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021889409999999998 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596736+0000", 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7810999999999999e-05 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596750+0000", 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.34e-05 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596815+0000", 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5597000000000002e-05 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.596837+0000", 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1880999999999999e-05 2024-09-10T05:57:34.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.604314+0000", 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074762830000000002 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.604385+0000", 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1198000000000005e-05 2024-09-10T05:57:34.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2701 3.3d e73/24 3:bc92f7d4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_164:head v 73'4, mlcod=72'2)", 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.656075+0000", 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.189904124999998, 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086565640000000003, 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656075+0000", 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656075+0000", 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.656077+0000", 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6360000000000001e-06 2024-09-10T05:57:34.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657478+0000", 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014012670000000001 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657496+0000", 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7978e-05 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657508+0000", 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1603000000000001e-05 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657582+0000", 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4315999999999998e-05 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.657612+0000", 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0596000000000003e-05 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664656+0000", 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070437950000000003 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664732+0000", 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5372999999999998e-05 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2715 3.3b e73/24 3:dd47ddd8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_178:head v 73'7, mlcod=73'5)", 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.805657+0000", 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.040322154999998, 2024-09-10T05:57:34.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010096371, 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.805657+0000", 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.805657+0000", 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.805659+0000", 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.739e-06 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810651+0000", 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049917970000000001 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810676+0000", 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5769e-05 2024-09-10T05:57:34.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810689+0000", 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2445e-05 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810767+0000", 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8417000000000005e-05 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.810794+0000", 2024-09-10T05:57:34.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.815690+0000", 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048956709999999999 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.815753+0000", 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3880999999999994e-05 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2716 3.3b e73/24 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head v 73'8, mlcod=73'5)", 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 34.027603061000001, 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012669998999999999, 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818378+0000", 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.607e-06 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822721+0000", 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043427550000000002 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822741+0000", 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0820000000000001e-05 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822750+0000", 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969999999999999e-06 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822826+0000", 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5488000000000006e-05 2024-09-10T05:57:34.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822850+0000", 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4328000000000002e-05 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830980+0000", 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081304089999999999 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831046+0000", 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5895000000000005e-05 2024-09-10T05:57:34.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2720 3.9 e73/24 3:90160a04:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_183:head v 73'4, mlcod=73'2)", 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.860974+0000", 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.985005129000001, 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010555658000000001, 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.860974+0000", 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.860974+0000", 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.860977+0000", 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6529999999999998e-06 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865618+0000", 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046415010000000001 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865636+0000", 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8162e-05 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.881 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865646+0000", 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.825e-06 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865709+0000", 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2687000000000005e-05 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865738+0000", 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8921999999999999e-05 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.871475+0000", 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057366589999999999 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.871530+0000", 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5248999999999999e-05 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.883 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2721 3.9 e73/24 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head v 73'5, mlcod=73'3)", 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.971997633000001, 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011236408, 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873983+0000", 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6729999999999999e-06 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878223+0000", 2024-09-10T05:57:34.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042396789999999997 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878246+0000", 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3326e-05 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878304+0000", 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7794000000000003e-05 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878368+0000", 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4005999999999997e-05 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878391+0000", 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2909e-05 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.887 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885156+0000", 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067645680000000003 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885218+0000", 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2453000000000007e-05 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2724 3.3b e73/24 3:de2d4288:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_187:head v 73'9, mlcod=73'7)", 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.901245+0000", 2024-09-10T05:57:34.888 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.944734081999997, 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010036058, 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901245+0000", 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.889 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901245+0000", 2024-09-10T05:57:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.890 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901248+0000", 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6429999999999999e-06 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906079+0000", 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048312299999999997 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.891 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906122+0000", 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3090000000000002e-05 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906138+0000", 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906230+0000", 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2584999999999995e-05 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.892 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.906262+0000", 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1541000000000002e-05 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.911225+0000", 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049628340000000002 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.911281+0000", 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-05 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2725 3.21 3:856ed7cd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.940282291000003, 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018910211999999999, 2024-09-10T05:57:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2725 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.896 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905702+0000", 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908098+0000", 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023965269999999999 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.897 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908124+0000", 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899000000000001e-05 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908139+0000", 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5026e-05 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908222+0000", 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.898 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908417+0000", 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195026 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908573+0000", 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155849 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.913471+0000", 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048985469999999996 2024-09-10T05:57:34.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924490+0000", 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011019167999999999 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924557+0000", 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6925e-05 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.900 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924607+0000", 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9932000000000002e-05 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2731 3.4 e74/24 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head v 74'5, mlcod=73'3)", 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.967074+0000", 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.878905015000001, 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086595500000000002, 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.901 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967074+0000", 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967074+0000", 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967075+0000", 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7800000000000002e-07 2024-09-10T05:57:34.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969682+0000", 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026072629999999999 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969713+0000", 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1010999999999998e-05 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969728+0000", 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4688000000000001e-05 2024-09-10T05:57:34.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969812+0000", 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4023000000000005e-05 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.969838+0000", 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6769000000000001e-05 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975673+0000", 2024-09-10T05:57:34.904 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058346750000000001 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975734+0000", 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0742999999999998e-05 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2733 3.0 e74/24 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head v 74'3, mlcod=72'1)", 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.989218+0000", 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.856761327999997, 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089400929999999997, 2024-09-10T05:57:34.905 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989218+0000", 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989218+0000", 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.906 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989220+0000", 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.711e-06 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990539+0000", 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013190159999999999 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990558+0000", 2024-09-10T05:57:34.907 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9006000000000001e-05 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990567+0000", 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7710000000000001e-06 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990645+0000", 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7213999999999996e-05 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.908 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.990671+0000", 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6798e-05 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998123+0000", 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074515240000000002 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998158+0000", 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5052999999999998e-05 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.909 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2748 3.3b e74/24 3:deadbbb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_211:head v 74'10, mlcod=73'8)", 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.703502292000003, 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011669703999999999, 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.910 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142478+0000", 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999997e-07 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.911 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148304+0000", 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058267570000000001 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148327+0000", 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2921e-05 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.912 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148338+0000", 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294999999999999e-05 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148403+0000", 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4332999999999995e-05 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148421+0000", 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7991000000000001e-05 2024-09-10T05:57:34.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154104+0000", 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005683385 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154147+0000", 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2446e-05 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.914 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2751 3.21 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.679401490000004, 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019591372999999999, 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2751 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.915 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.916 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166581+0000", 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.167981+0000", 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00139999 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168020+0000", 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8980000000000003e-05 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168036+0000", 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6568000000000001e-05 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168113+0000", 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6417999999999999e-05 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168228+0000", 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115161 2024-09-10T05:57:34.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168349+0000", 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012086 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175149+0000", 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068000150000000004 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186073+0000", 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010924411 2024-09-10T05:57:34.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186119+0000", 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5550999999999998e-05 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186169+0000", 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0603000000000003e-05 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.920 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2753 3.21 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.659430767000003, 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019351368000000001, 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2753 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.921 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186551+0000", 2024-09-10T05:57:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5059999999999998e-06 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.187974+0000", 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014233259999999999 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188000+0000", 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188011+0000", 2024-09-10T05:57:34.923 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188082+0000", 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1061000000000003e-05 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188225+0000", 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014240499999999999 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:34.924 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188343+0000", 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118019 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192712+0000", 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043687309999999998 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205798+0000", 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013086191 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.925 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205849+0000", 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205900+0000", 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1174999999999997e-05 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2757 3.2e 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.926 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.621935153999999, 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021228316000000001, 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2757 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.927 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224047+0000", 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.531e-06 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.928 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225876+0000", 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018291119999999999 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225905+0000", 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9615999999999999e-05 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225921+0000", 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5338000000000001e-05 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.929 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226002+0000", 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1521999999999996e-05 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226149+0000", 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147031 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226249+0000", 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9671000000000002e-05 2024-09-10T05:57:34.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.232949+0000", 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067004150000000004 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245149+0000", 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012199468 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245220+0000", 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0990999999999998e-05 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.931 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245272+0000", 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2621000000000003e-05 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2769 3.c 3:32936715:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.353171+0000", 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 33.492808318000002, 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010342775, 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2769 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.353171+0000", 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.933 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.353171+0000", 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.353173+0000", 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.95e-06 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354821+0000", 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0016480869999999999 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354853+0000", 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1826999999999999e-05 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354867+0000", 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4577e-05 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.354973+0000", 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105157 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.935 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.355153+0000", 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018055999999999999 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.355297+0000", 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014362199999999999 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.360662+0000", 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053651519999999998 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.363379+0000", 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027172849999999998 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.937 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.363455+0000", 2024-09-10T05:57:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5495999999999997e-05 2024-09-10T05:57:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.363514+0000", 2024-09-10T05:57:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9061999999999998e-05 2024-09-10T05:57:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2997 3.4 e90/24 3:2257915f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_1:head v 90'8, mlcod=74'6)", 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.072854+0000", 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.77312509699999998, 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0096086829999999998, 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.939 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.072854+0000", 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.072854+0000", 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.072856+0000", 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2539999999999999e-06 2024-09-10T05:57:34.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.075554+0000", 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026976639999999998 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.075584+0000", 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0218000000000001e-05 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.075598+0000", 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3832000000000001e-05 2024-09-10T05:57:34.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.075688+0000", 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0210999999999994e-05 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.075716+0000", 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7212e-05 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.942 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.082403+0000", 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066877029999999997 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.082463+0000", 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9589000000000002e-05 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3003 3.3b e90/24 3:de7cc7af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_7:head v 90'11, mlcod=73'9)", 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.68376194099999998, 2024-09-10T05:57:34.943 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013130332999999999, 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:34.944 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162219+0000", 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168244+0000", 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060244879999999997 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168303+0000", 2024-09-10T05:57:34.945 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8974999999999997e-05 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168321+0000", 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168405+0000", 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189999999999995e-05 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168431+0000", 2024-09-10T05:57:34.946 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6271e-05 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175260+0000", 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068292320000000002 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175348+0000", 2024-09-10T05:57:34.947 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7458000000000002e-05 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3008 3.9 e90/24 3:905d4b1a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_12:head v 90'6, mlcod=73'4)", 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.62904084100000002, 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011104477, 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:34.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.949 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216940+0000", 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222832+0000", 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058914040000000003 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222856+0000", 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4006999999999999e-05 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.950 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222867+0000", 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1191e-05 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222943+0000", 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.64e-05 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222967+0000", 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-05 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.951 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.227972+0000", 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050046989999999996 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.228043+0000", 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1073000000000002e-05 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:34.952 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:34.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:34.956 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:34.950+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:35.054 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:35.050+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:35.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:35.144 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:35.144 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:35.145 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:35.155 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:35.152+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:35.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:35.256 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:35.252+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:35.345 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:35.345 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:35.346 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:35.346 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:35.346 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:35.349 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:35.349 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:35.357 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:35.352+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:35.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:35.383 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:35.383 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:35.409 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:35.409 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:35.439 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:35.439 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:35.457 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:35.454+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:35.481 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:35.481 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:35.517 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:35.517 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:35.554 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:35.554 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:35.557 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:35.557 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:35.558 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:35.554+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:35.579 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:35.582 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:35.659 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:35.654+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:35.735 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:35.735 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:35.755 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:35.759 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:35.754+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:35.860 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:35.858+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:35.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:57:35.924 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:35.924 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:35.947 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:35.991 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:35.988+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:36.062 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:36.058+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:36.087 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:36.087 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:36.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:36.195 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:36.192+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:36.263 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:36.258+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:36.287 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:36.288 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:36.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:36.391 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:36.388+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:36.466 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:36.460+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:36.490 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:36.490 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:36.506 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:36.566 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:36.562+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:36.667 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:36.664+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:36.693 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:36.693 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:36.711 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:36.803 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:36.800+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:36.869 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:36.864+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:36.893 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:57:36.895 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:36.895 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:36.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:36.972 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:36.970+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:37.071 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:37.064+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:37.081 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:37.081 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:37.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:37.172 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:37.166+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:37.273 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:37.268+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:37.280 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:37.280 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:37.296 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:37.374 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:37.370+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:37.467 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:37.468 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:37.475 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:37.468+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:37.482 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:37.575 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:37.572+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:37.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:37.667 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:37.667 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:37.676 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:37.674+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:37.684 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:37.776 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:37.774+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:37.782 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:37.782 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:37.806 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:37.807 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:37.828 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:37.828 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:37.851 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:37.852 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:37.867 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:37.867 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:37.875 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:37.875 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:37.877 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:37.874+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:37.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:37.916 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:37.916 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:37.950 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:37.975 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:37.978 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:37.972+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:38.035 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:38.036 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:38.036 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:38.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:38.066 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 1Gb. 2024-09-10T05:57:38.066 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:57:38.066 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:57:38.067 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-09-10T05:57:38.067 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:57:38.079 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:38.072+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:38.179 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:38.174+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:38.194 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:38.194 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:38.194 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:38.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:38.280 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:38.276+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:38.369 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:57:38.370 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2675 3.1 3:808dd43d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:38.374 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.036344972999999, 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016454241000000001, 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2675 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:38.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336179+0000", 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337951+0000", 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017720329999999999 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337984+0000", 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3022000000000003e-05 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337999+0000", 2024-09-10T05:57:38.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4942e-05 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338081+0000", 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1463000000000003e-05 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338193+0000", 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111705 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338294+0000", 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101019 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.347997+0000", 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097033069999999996 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352514+0000", 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045167970000000003 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352577+0000", 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3260000000000001e-05 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352630+0000", 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3208999999999998e-05 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2705 3.17 3:eba32b22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:38.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.680151699, 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017940067000000001, 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:38.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692372+0000", 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693889+0000", 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015172370000000001 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693920+0000", 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1291999999999998e-05 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693933+0000", 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2693e-05 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694001+0000", 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830000000000006e-05 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694130+0000", 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129114 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694285+0000", 2024-09-10T05:57:38.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015531599999999999 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.698265+0000", 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797950000000004 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710231+0000", 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011966348999999999 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710272+0000", 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1193999999999999e-05 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710309+0000", 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6888000000000003e-05 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.529272986000002, 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:57:38.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:57:38.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:57:38.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:38.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.377103288999997, 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:57:38.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:57:38.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2742 3.1 3:81622134:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.297100698000001, 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016996092000000001, 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.400 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2742 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075424+0000", 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3380000000000001e-06 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077125+0000", 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001701504 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077157+0000", 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1665000000000003e-05 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077172+0000", 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379e-05 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077245+0000", 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2706000000000005e-05 2024-09-10T05:57:38.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077418+0000", 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017356399999999999 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077574+0000", 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015575499999999999 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.082224+0000", 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046503439999999998 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092275+0000", 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010050738 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092356+0000", 2024-09-10T05:57:38.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0822999999999995e-05 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092416+0000", 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0275999999999997e-05 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2750 3.1b 3:da716242:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.216219805999998, 2024-09-10T05:57:38.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016402756000000001, 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2750 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156304+0000", 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7590000000000002e-06 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157544+0000", 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012403900000000001 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157569+0000", 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5133000000000001e-05 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157580+0000", 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0953e-05 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157672+0000", 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1685000000000001e-05 2024-09-10T05:57:38.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157859+0000", 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694499999999999 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.158038+0000", 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017913299999999999 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.163265+0000", 2024-09-10T05:57:38.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052268569999999997 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172626+0000", 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093605370000000004 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172667+0000", 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1764999999999997e-05 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172704+0000", 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6599e-05 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2777 3.1b 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.934137108000002, 2024-09-10T05:57:38.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019570203000000001, 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2777 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:38.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438387+0000", 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9009999999999998e-06 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439946+0000", 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00155905 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439975+0000", 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9311000000000001e-05 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439988+0000", 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3319000000000001e-05 2024-09-10T05:57:38.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440057+0000", 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8208999999999997e-05 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440175+0000", 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118261 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440286+0000", 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111242 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.444527+0000", 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042409800000000001 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457848+0000", 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013320702 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457903+0000", 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457954+0000", 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1319000000000001e-05 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2785 3.12 3:49663187:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 36.832847739999998, 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015080374000000001, 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2785 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539676+0000", 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542236+0000", 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025599830000000001 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542273+0000", 2024-09-10T05:57:38.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7063000000000001e-05 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542288+0000", 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.518e-05 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542365+0000", 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7292999999999993e-05 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542494+0000", 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012883099999999999 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542615+0000", 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012126899999999999 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.546794+0000", 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041788149999999998 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554636+0000", 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078412470000000008 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554707+0000", 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1899999999999999e-05 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554754+0000", 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6103999999999998e-05 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3006 3.b 3:d167e876:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.1841505110000003, 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.73997048700000001, 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.426 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3006 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:57:38.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188374+0000", 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4970000000000001e-06 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.428 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190071+0000", 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00169713 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190105+0000", 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3581000000000003e-05 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190122+0000", 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7016000000000001e-05 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190223+0000", 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010094000000000001 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190238+0000", 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5583e-05 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908275+0000", 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.71803706099999998 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908586+0000", 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031096200000000002 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908871+0000", 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028523900000000001 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915859+0000", 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069872830000000004 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928177+0000", 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012318513999999999 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928243+0000", 2024-09-10T05:57:38.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5297999999999997e-05 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928341+0000", 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8382999999999996e-05 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3012 3.24 e91/90 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head v 91'8, mlcod=0'0)", 2024-09-10T05:57:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.886421+0000", 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.486099759, 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017811443, 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.886421+0000", 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.886421+0000", 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.886422+0000", 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-07 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893681+0000", 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072591310000000003 2024-09-10T05:57:38.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893689+0000", 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2949999999999994e-06 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893695+0000", 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7450000000000001e-06 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893741+0000", 2024-09-10T05:57:38.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5977999999999999e-05 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893765+0000", 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3824000000000001e-05 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.904189+0000", 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010424319 2024-09-10T05:57:38.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.904233+0000", 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3686000000000002e-05 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3010 3.7 e91/90 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head v 91'3, mlcod=0'0)", 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4557232130000002, 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023300923000000001, 2024-09-10T05:57:38.438 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8599999999999998e-07 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931447+0000", 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014648899999999999 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931467+0000", 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0061999999999999e-05 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931479+0000", 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931547+0000", 2024-09-10T05:57:38.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8113000000000003e-05 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931578+0000", 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0669000000000001e-05 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936627+0000", 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050490830000000002 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.940099+0000", 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034719429999999999 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3015 3.3d 3:bd148ba2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4535860920000001, 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020562475, 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3015 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:57:38.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918938+0000", 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.791e-06 2024-09-10T05:57:38.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.921985+0000", 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030470240000000002 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922010+0000", 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5726999999999999e-05 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922027+0000", 2024-09-10T05:57:38.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6741000000000001e-05 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922151+0000", 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012387699999999999 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922302+0000", 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150827 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922440+0000", 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138491 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930425+0000", 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079845079999999995 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939338+0000", 2024-09-10T05:57:38.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089127400000000006 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939431+0000", 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2980999999999996e-05 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939497+0000", 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6767999999999995e-05 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.449 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3018 3.1 3:8381c127:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.950708+0000", 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.4218125050000001, 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016822143000000001, 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.450 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3018 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950708+0000", 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950708+0000", 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950711+0000", 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2809999999999998e-06 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952519+0000", 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018086790000000001 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952546+0000", 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6687e-05 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952559+0000", 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2901000000000001e-05 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952642+0000", 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2670000000000006e-05 2024-09-10T05:57:38.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952814+0000", 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017191299999999999 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952975+0000", 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161772 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.966956+0000", 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013980978999999999 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.967341+0000", 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038460799999999999 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.967441+0000", 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010028 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.967531+0000", 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9373e-05 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3021 3.b 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.3959691940000001, 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029193581, 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3021 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976554+0000", 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3640000000000002e-06 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978476+0000", 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019221830000000001 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978493+0000", 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6331e-05 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978503+0000", 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0774000000000001e-05 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978582+0000", 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8651000000000003e-05 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978858+0000", 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000276455 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.979018+0000", 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015947800000000001 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.984809+0000", 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057911280000000004 2024-09-10T05:57:38.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005635+0000", 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020826181999999999 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005679+0000", 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3417999999999997e-05 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005745+0000", 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6617000000000003e-05 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3030 3.18 3:1a400f4c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.090346+0000", 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.2821751460000002, 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016792213, 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3030 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.090346+0000", 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.090346+0000", 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.090349+0000", 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.428e-06 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096554+0000", 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062045859999999998 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096635+0000", 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1576000000000006e-05 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096667+0000", 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1245000000000003e-05 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096764+0000", 2024-09-10T05:57:38.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7498999999999996e-05 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096945+0000", 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180872 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097126+0000", 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000181149 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.106882+0000", 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009755896 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.106930+0000", 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7633999999999998e-05 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.107002+0000", 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000001e-05 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.107138+0000", 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000136248 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3032 3.23 3:c5ef921f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.111414+0000", 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.2611074219999998, 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019602378, 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3032 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.111414+0000", 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.111414+0000", 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.111416+0000", 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2809999999999998e-06 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113774+0000", 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023577670000000002 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113796+0000", 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2466000000000001e-05 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113809+0000", 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113887+0000", 2024-09-10T05:57:38.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8190999999999997e-05 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.114017+0000", 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012944599999999999 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.114207+0000", 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019061100000000001 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.121962+0000", 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077542820000000004 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.130804+0000", 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088425210000000008 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.130881+0000", 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6997999999999997e-05 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.131016+0000", 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134824 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3033 3.17 3:ea227143:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.123163+0000", 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.2493578259999998, 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019219914000000001, 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.474 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3033 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.123163+0000", 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.123163+0000", 2024-09-10T05:57:38.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.123166+0000", 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.14e-06 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.124926+0000", 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017598659999999999 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.124954+0000", 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7708e-05 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.124969+0000", 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5157000000000001e-05 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.125045+0000", 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5859000000000007e-05 2024-09-10T05:57:38.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.125218+0000", 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172864 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.125370+0000", 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015196599999999999 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.130715+0000", 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053458350000000002 2024-09-10T05:57:38.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.142265+0000", 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011549271999999999 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.142336+0000", 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0871000000000006e-05 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.142383+0000", 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376000000000002e-05 2024-09-10T05:57:38.479 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3035 3.b 3:d1267ce1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.2276348659999998, 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021701069, 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3035 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144889+0000", 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146859+0000", 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019707790000000002 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146897+0000", 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7713000000000003e-05 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146914+0000", 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6558999999999998e-05 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147007+0000", 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3190999999999996e-05 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147200+0000", 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193084 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147389+0000", 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188543 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.153536+0000", 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061479179999999996 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166419+0000", 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01288215 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166489+0000", 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321000000000007e-05 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166587+0000", 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8165000000000006e-05 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3041 3.b 3:d26ad16f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.1619452799999999, 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030467424999999999, 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3041 2024-09-10T05:57:38.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210578+0000", 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6240000000000002e-06 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212335+0000", 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00175713 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212364+0000", 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8208000000000002e-05 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212378+0000", 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4255e-05 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212469+0000", 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1051000000000006e-05 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212656+0000", 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018742699999999999 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212834+0000", 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000177298 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.219661+0000", 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068273070000000003 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240871+0000", 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021210184 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240938+0000", 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6637999999999995e-05 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.241043+0000", 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105303 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3254 3.1b 3:d8995d6f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:38.491 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.905840+0000", 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.46668137100000001, 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016463552999999999, 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3254 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.905840+0000", 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.905840+0000", 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.905843+0000", 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.287e-06 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908146+0000", 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023034990000000001 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908163+0000", 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867e-05 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908175+0000", 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1463e-05 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908323+0000", 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014831600000000001 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908501+0000", 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017782400000000001 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908657+0000", 2024-09-10T05:57:38.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000156164 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.914820+0000", 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061630230000000001 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.922199+0000", 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073787790000000002 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.922248+0000", 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9122999999999997e-05 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.922303+0000", 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207999999999997e-05 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.497 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.498 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.498 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:38.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:38.500 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:38.496+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:38.600 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:38.598+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:38.622 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:38.622 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:38.622 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:38.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:38.732 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:38.730+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:38.801 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:38.798+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:38.805 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:38.805 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:38.805 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:38.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:38.916 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:38.914+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:38.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:57:38.990 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.990 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 132.431757801, 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:57:38.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:38.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2695 3.4 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.395933016000001, 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013307572, 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:38.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592030+0000", 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8650000000000001e-06 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594049+0000", 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002019449 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594078+0000", 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9376000000000001e-05 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594092+0000", 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3505e-05 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594168+0000", 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6063999999999995e-05 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:38.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594293+0000", 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012461899999999999 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594406+0000", 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112983 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605086+0000", 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010680383999999999 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605259+0000", 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172659 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605303+0000", 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4651000000000003e-05 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605334+0000", 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1016999999999998e-05 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2717 3.25 3:a515f872:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:39.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.167988573000002, 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011604369, 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2717 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:39.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819975+0000", 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821866+0000", 2024-09-10T05:57:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00189079 2024-09-10T05:57:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821899+0000", 2024-09-10T05:57:39.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809000000000001e-05 2024-09-10T05:57:39.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821914+0000", 2024-09-10T05:57:39.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5e-05 2024-09-10T05:57:39.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822002+0000", 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7892999999999993e-05 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822154+0000", 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015216200000000001 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822295+0000", 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014084899999999999 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830948+0000", 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086527919999999994 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831454+0000", 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050560199999999996 2024-09-10T05:57:39.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831520+0000", 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6017000000000002e-05 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831576+0000", 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5825000000000002e-05 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2730 3.19 3:99f0627c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.032593179999999, 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012565949999999999, 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2730 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.010 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955370+0000", 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3620000000000002e-06 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957409+0000", 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020391720000000001 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957452+0000", 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2895000000000002e-05 2024-09-10T05:57:39.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957466+0000", 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4311000000000001e-05 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957588+0000", 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121663 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957792+0000", 2024-09-10T05:57:39.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203792 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957975+0000", 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183678 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965498+0000", 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075228700000000001 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967831+0000", 2024-09-10T05:57:39.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023322590000000002 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967882+0000", 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1598000000000003e-05 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967933+0000", 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0349999999999997e-05 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.015 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2731 3.4 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.022808327, 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013157917999999999, 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.016 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2731 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965155+0000", 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5889999999999999e-06 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966586+0000", 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001430618 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966603+0000", 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7059999999999999e-05 2024-09-10T05:57:39.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966614+0000", 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1141999999999999e-05 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966689+0000", 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5574000000000005e-05 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966819+0000", 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129558 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966944+0000", 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012527799999999999 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975490+0000", 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085459999999999998 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978216+0000", 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027259879999999999 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978268+0000", 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1493000000000003e-05 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978309+0000", 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1618e-05 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2733 3.0 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.001537800000001, 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012015477, 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2733 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986425+0000", 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988599+0000", 2024-09-10T05:57:39.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021740489999999999 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988621+0000", 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1922000000000001e-05 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988633+0000", 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1758e-05 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988727+0000", 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3867000000000001e-05 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988922+0000", 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019508500000000001 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989099+0000", 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017668299999999999 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.996748+0000", 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007649159 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998318+0000", 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015705090000000001 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998382+0000", 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4036999999999997e-05 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998437+0000", 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207000000000002e-05 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2756 3.1a e74/24 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.767567237000002, 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012940208, 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226300+0000", 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059069400000000003 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226316+0000", 2024-09-10T05:57:39.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6509000000000001e-05 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226325+0000", 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7439999999999996e-06 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226425+0000", 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100188 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226452+0000", 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7140000000000001e-05 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233268+0000", 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068155660000000003 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233333+0000", 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4789000000000006e-05 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2776 3.31 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.559527121999999, 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019117624, 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.033 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2776 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428435+0000", 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6019999999999998e-06 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429944+0000", 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001509095 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429973+0000", 2024-09-10T05:57:39.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8558e-05 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429986+0000", 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3591000000000001e-05 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430053+0000", 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430167+0000", 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114243 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430257+0000", 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9386000000000001e-05 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.434734+0000", 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044769909999999996 2024-09-10T05:57:39.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447370+0000", 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012636214 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447476+0000", 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105844 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447550+0000", 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4622000000000005e-05 2024-09-10T05:57:39.038 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2782 3.25 3:a5d3e292:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.48551423, 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012424736, 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.039 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2782 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502448+0000", 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505248+0000", 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027999470000000001 2024-09-10T05:57:39.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505285+0000", 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.68e-05 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505304+0000", 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9423999999999999e-05 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505417+0000", 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011298000000000001 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505608+0000", 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019085900000000001 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505785+0000", 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176832 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.511556+0000", 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057704219999999999 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514735+0000", 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031793749999999999 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514811+0000", 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6129000000000002e-05 2024-09-10T05:57:39.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514870+0000", 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9250999999999999e-05 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2783 3.3e 3:7c6034eb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 37.474432618000002, 2024-09-10T05:57:39.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503764, 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2783 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513531+0000", 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1520000000000002e-06 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516867+0000", 2024-09-10T05:57:39.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033353800000000002 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516900+0000", 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3414999999999998e-05 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516917+0000", 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867999999999998e-05 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516998+0000", 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0851000000000002e-05 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517142+0000", 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144671 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517248+0000", 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105319 2024-09-10T05:57:39.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526098+0000", 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088501629999999994 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526838+0000", 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074033699999999998 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526948+0000", 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109647 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.527031+0000", 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2960999999999994e-05 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2997 3.4 3:2257915f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:39.051 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9192350730000003, 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015853236, 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2997 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068729+0000", 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9790000000000004e-06 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071067+0000", 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002338363 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071102+0000", 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4694999999999999e-05 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071116+0000", 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4212e-05 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071192+0000", 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6440000000000007e-05 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071318+0000", 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012571699999999999 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071411+0000", 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2799000000000004e-05 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079634+0000", 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082235420000000004 2024-09-10T05:57:39.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084461+0000", 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048270240000000001 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084527+0000", 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5273999999999999e-05 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084578+0000", 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1190999999999998e-05 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2998 3.0 3:00581a26:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.9088634180000001, 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011652958, 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2998 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079099+0000", 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.588e-06 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081434+0000", 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002335213 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081462+0000", 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8107999999999999e-05 2024-09-10T05:57:39.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081479+0000", 2024-09-10T05:57:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6809000000000001e-05 2024-09-10T05:57:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081564+0000", 2024-09-10T05:57:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5258000000000003e-05 2024-09-10T05:57:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081694+0000", 2024-09-10T05:57:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129214 2024-09-10T05:57:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081846+0000", 2024-09-10T05:57:39.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000152881 2024-09-10T05:57:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.087780+0000", 2024-09-10T05:57:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059333980000000003 2024-09-10T05:57:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090625+0000", 2024-09-10T05:57:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028450480000000002 2024-09-10T05:57:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090689+0000", 2024-09-10T05:57:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3739999999999996e-05 2024-09-10T05:57:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090749+0000", 2024-09-10T05:57:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0701e-05 2024-09-10T05:57:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3009 3.33 e91/90 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head v 91'7, mlcod=0'0)", 2024-09-10T05:57:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.0722503889999997, 2024-09-10T05:57:39.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021229792000000001, 2024-09-10T05:57:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915710+0000", 2024-09-10T05:57:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-10T05:57:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925190+0000", 2024-09-10T05:57:39.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094797909999999996 2024-09-10T05:57:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925205+0000", 2024-09-10T05:57:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4749999999999999e-05 2024-09-10T05:57:39.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925214+0000", 2024-09-10T05:57:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1889999999999996e-06 2024-09-10T05:57:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925307+0000", 2024-09-10T05:57:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3121000000000005e-05 2024-09-10T05:57:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925347+0000", 2024-09-10T05:57:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0170000000000003e-05 2024-09-10T05:57:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936873+0000", 2024-09-10T05:57:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011525409 2024-09-10T05:57:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936939+0000", 2024-09-10T05:57:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6383000000000005e-05 2024-09-10T05:57:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.079 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3016 3.4 3:22f6155f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.056972021, 2024-09-10T05:57:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015593559999999999, 2024-09-10T05:57:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.080 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3016 2024-09-10T05:57:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:39.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930990+0000", 2024-09-10T05:57:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3769999999999999e-06 2024-09-10T05:57:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.933999+0000", 2024-09-10T05:57:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003008911 2024-09-10T05:57:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934019+0000", 2024-09-10T05:57:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0258000000000002e-05 2024-09-10T05:57:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934033+0000", 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3723999999999999e-05 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934110+0000", 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6977999999999994e-05 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934265+0000", 2024-09-10T05:57:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155305 2024-09-10T05:57:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934413+0000", 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014791199999999999 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.943327+0000", 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089134539999999995 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946445+0000", 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031179100000000002 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946529+0000", 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4636999999999996e-05 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946581+0000", 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2094e-05 2024-09-10T05:57:39.090 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3029 3.29 e91/90 3:94a1ebfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_31:head v 91'4, mlcod=0'0)", 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.9028719499999998, 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012013543999999999, 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085089+0000", 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-10T05:57:39.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091607+0000", 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065175650000000003 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091635+0000", 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8127999999999999e-05 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091650+0000", 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4543e-05 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091768+0000", 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117859 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091809+0000", 2024-09-10T05:57:39.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1304999999999998e-05 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097031+0000", 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052216909999999997 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097101+0000", 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0832000000000002e-05 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3039 3.3e 3:7c01ab0e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8019905870000001, 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011728011, 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.096 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3039 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185972+0000", 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188219+0000", 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002246783 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188237+0000", 2024-09-10T05:57:39.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7798000000000001e-05 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188247+0000", 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0543000000000001e-05 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188918+0000", 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067044700000000001 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.189263+0000", 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034507500000000003 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.189430+0000", 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016748699999999999 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197213+0000", 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077831469999999998 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197564+0000", 2024-09-10T05:57:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035080199999999999 2024-09-10T05:57:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197647+0000", 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2392999999999995e-05 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197697+0000", 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0531999999999997e-05 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.103 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.103 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3040 3.3e 3:7d5213dd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:39.103 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:39.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7919151549999999, 2024-09-10T05:57:39.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013364289999999999, 2024-09-10T05:57:39.104 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.104 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.105 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3040 2024-09-10T05:57:39.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.105 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:39.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:39.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196048+0000", 2024-09-10T05:57:39.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1870000000000001e-06 2024-09-10T05:57:39.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199734+0000", 2024-09-10T05:57:39.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036858400000000001 2024-09-10T05:57:39.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199758+0000", 2024-09-10T05:57:39.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3978e-05 2024-09-10T05:57:39.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199770+0000", 2024-09-10T05:57:39.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2272999999999999e-05 2024-09-10T05:57:39.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199855+0000", 2024-09-10T05:57:39.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5451000000000006e-05 2024-09-10T05:57:39.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.200021+0000", 2024-09-10T05:57:39.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016566500000000001 2024-09-10T05:57:39.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:39.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.200201+0000", 2024-09-10T05:57:39.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018035999999999999 2024-09-10T05:57:39.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209028+0000", 2024-09-10T05:57:39.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088263330000000004 2024-09-10T05:57:39.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209299+0000", 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027105299999999999 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209359+0000", 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0106999999999999e-05 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209409+0000", 2024-09-10T05:57:39.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:57:39.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.115 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3051 3.25 3:a5ff5638:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.6555066649999999, 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013385912, 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.116 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3051 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332456+0000", 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.469e-06 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334763+0000", 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023073899999999999 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334790+0000", 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6957999999999998e-05 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334803+0000", 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3205e-05 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334878+0000", 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4840999999999997e-05 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.335068+0000", 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019012400000000001 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.335279+0000", 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021051199999999999 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345755+0000", 2024-09-10T05:57:39.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010476328 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345763+0000", 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1470000000000001e-06 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345804+0000", 2024-09-10T05:57:39.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0652999999999999e-05 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345839+0000", 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5284999999999998e-05 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3248 3.31 3:8fb1b3a5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:39.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.145770988, 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017678678, 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3248 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:39.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842192+0000", 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2660000000000002e-06 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843248+0000", 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010555079999999999 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843280+0000", 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2869e-05 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843296+0000", 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5116000000000001e-05 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843378+0000", 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2936999999999996e-05 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843589+0000", 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000210571 2024-09-10T05:57:39.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843713+0000", 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012438299999999999 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.848697+0000", 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049832549999999998 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859767+0000", 2024-09-10T05:57:39.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01107059 2024-09-10T05:57:39.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859833+0000", 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5338000000000004e-05 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859867+0000", 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4845000000000003e-05 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3256 3.4 3:23355cdd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.057715532, 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015740632000000001, 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3256 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930247+0000", 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0589999999999998e-06 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.931973+0000", 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017261799999999999 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.931998+0000", 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4671000000000001e-05 2024-09-10T05:57:39.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932011+0000", 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2884000000000001e-05 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932095+0000", 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4191999999999996e-05 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:39.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932103+0000", 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5569999999999998e-06 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936309+0000", 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042062499999999999 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936474+0000", 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164895 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:39.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936567+0000", 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2838999999999997e-05 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.944773+0000", 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082062230000000003 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945871+0000", 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001097867 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945935+0000", 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4141999999999997e-05 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945985+0000", 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9873000000000002e-05 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.136 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:39.138 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:39.138 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:39.134+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:39.238 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:39.234+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:39.298 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:39.298 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:39.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:39.360 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:39.358+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:39.441 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:39.436+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:39.470 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:39.470 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:39.470 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:39.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:39.542 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:39.538+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2716 3.3b e73/24 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head v 73'8, mlcod=73'5)", 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.781095757999999, 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012669998999999999, 2024-09-10T05:57:39.601 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818378+0000", 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.607e-06 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822721+0000", 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043427550000000002 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822741+0000", 2024-09-10T05:57:39.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0820000000000001e-05 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822750+0000", 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969999999999999e-06 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822826+0000", 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5488000000000006e-05 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822850+0000", 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4328000000000002e-05 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830980+0000", 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081304089999999999 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831046+0000", 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5895000000000005e-05 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2721 3.9 e73/24 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head v 73'5, mlcod=73'3)", 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.72549033, 2024-09-10T05:57:39.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011236408, 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873983+0000", 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6729999999999999e-06 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878223+0000", 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042396789999999997 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878246+0000", 2024-09-10T05:57:39.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3326e-05 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878304+0000", 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7794000000000003e-05 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878368+0000", 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4005999999999997e-05 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878391+0000", 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2909e-05 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885156+0000", 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067645680000000003 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885218+0000", 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2453000000000007e-05 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.610 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2725 3.21 3:856ed7cd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.693774988000001, 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018910211999999999, 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.611 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2725 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905702+0000", 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908098+0000", 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023965269999999999 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908124+0000", 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899000000000001e-05 2024-09-10T05:57:39.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908139+0000", 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5026e-05 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908222+0000", 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908417+0000", 2024-09-10T05:57:39.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195026 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908573+0000", 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155849 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.913471+0000", 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048985469999999996 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924490+0000", 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011019167999999999 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924557+0000", 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6925e-05 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924607+0000", 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9932000000000002e-05 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2748 3.3b e74/24 3:deadbbb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_211:head v 74'10, mlcod=73'8)", 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.456994989000002, 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011669703999999999, 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142478+0000", 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999997e-07 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148304+0000", 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058267570000000001 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148327+0000", 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2921e-05 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148338+0000", 2024-09-10T05:57:39.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294999999999999e-05 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148403+0000", 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4332999999999995e-05 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148421+0000", 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7991000000000001e-05 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154104+0000", 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005683385 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154147+0000", 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2446e-05 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2751 3.21 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.622 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.432894187000002, 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019591372999999999, 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2751 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166581+0000", 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.167981+0000", 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00139999 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168020+0000", 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8980000000000003e-05 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168036+0000", 2024-09-10T05:57:39.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6568000000000001e-05 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168113+0000", 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6417999999999999e-05 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168228+0000", 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115161 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168349+0000", 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012086 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175149+0000", 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068000150000000004 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186073+0000", 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010924411 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186119+0000", 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5550999999999998e-05 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186169+0000", 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0603000000000003e-05 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.628 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2753 3.21 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.412923464000002, 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019351368000000001, 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.629 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2753 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186551+0000", 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5059999999999998e-06 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.187974+0000", 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014233259999999999 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188000+0000", 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188011+0000", 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188082+0000", 2024-09-10T05:57:39.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1061000000000003e-05 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188225+0000", 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014240499999999999 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188343+0000", 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118019 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192712+0000", 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043687309999999998 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205798+0000", 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013086191 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205849+0000", 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-10T05:57:39.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205900+0000", 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1174999999999997e-05 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2757 3.2e 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:39.635 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 38.375427850999998, 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021228316000000001, 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2757 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.636 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:39.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224047+0000", 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.531e-06 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225876+0000", 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018291119999999999 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225905+0000", 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9615999999999999e-05 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225921+0000", 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5338000000000001e-05 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226002+0000", 2024-09-10T05:57:39.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1521999999999996e-05 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226149+0000", 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147031 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226249+0000", 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9671000000000002e-05 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.232949+0000", 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067004150000000004 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245149+0000", 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012199468 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245220+0000", 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0990999999999998e-05 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245272+0000", 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2621000000000003e-05 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3003 3.3b e90/24 3:de7cc7af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_7:head v 90'11, mlcod=73'9)", 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.4372546379999998, 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013130332999999999, 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162219+0000", 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168244+0000", 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060244879999999997 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168303+0000", 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8974999999999997e-05 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168321+0000", 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168405+0000", 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189999999999995e-05 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168431+0000", 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6271e-05 2024-09-10T05:57:39.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175260+0000", 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068292320000000002 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175348+0000", 2024-09-10T05:57:39.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7458000000000002e-05 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3008 3.9 e90/24 3:905d4b1a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_12:head v 90'6, mlcod=73'4)", 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.3825335379999997, 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011104477, 2024-09-10T05:57:39.647 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:39.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216940+0000", 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222832+0000", 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058914040000000003 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222856+0000", 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4006999999999999e-05 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222867+0000", 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1191e-05 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222943+0000", 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.64e-05 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222967+0000", 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-05 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.227972+0000", 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050046989999999996 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.228043+0000", 2024-09-10T05:57:39.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1073000000000002e-05 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3015 3.3d e91/24 3:bd148ba2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_17:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6764890159999997, 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013567879, 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.652 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922984+0000", 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.051e-06 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924550+0000", 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001566226 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924566+0000", 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5722999999999998e-05 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924577+0000", 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0634e-05 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925330+0000", 2024-09-10T05:57:39.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075334999999999996 2024-09-10T05:57:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925375+0000", 2024-09-10T05:57:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4631e-05 2024-09-10T05:57:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936507+0000", 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011132856 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936551+0000", 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3408000000000002e-05 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3017 3.3b e91/24 3:dd236608:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_19:head v 91'12, mlcod=74'10)", 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6547793359999998, 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014972480999999999, 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-07 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950568+0000", 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058748680000000001 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950590+0000", 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2096e-05 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950600+0000", 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0291e-05 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950677+0000", 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6171e-05 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950702+0000", 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5633999999999999e-05 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959561+0000", 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088584089999999994 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959665+0000", 2024-09-10T05:57:39.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104448 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3019 3.1f 3:fa47017c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.64061039, 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021984574999999999, 2024-09-10T05:57:39.663 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3019 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958865+0000", 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961571+0000", 2024-09-10T05:57:39.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002706052 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961590+0000", 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9028000000000001e-05 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961602+0000", 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2342e-05 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961725+0000", 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012271 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961895+0000", 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017041300000000001 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961998+0000", 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102068 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.968323+0000", 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063252869999999997 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980751+0000", 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012427745 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980800+0000", 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9048999999999997e-05 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980846+0000", 2024-09-10T05:57:39.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6517999999999997e-05 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3023 3.3b e91/24 3:de37cb64:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_25:head v 91'13, mlcod=90'11)", 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.5909986060000003, 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011245872000000001, 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.670 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008474+0000", 2024-09-10T05:57:39.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9599999999999998e-07 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014097+0000", 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056226690000000003 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014109+0000", 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2156e-05 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014116+0000", 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0230000000000004e-06 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014169+0000", 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2777e-05 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014190+0000", 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0812e-05 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019638+0000", 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054488619999999996 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019719+0000", 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0777000000000003e-05 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3034 3.21 3:85b134c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:39.674 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4643799399999997, 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013922285, 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3034 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:39.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135095+0000", 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6120000000000001e-06 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.136970+0000", 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001875551 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137000+0000", 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9634000000000001e-05 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137015+0000", 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4999e-05 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137102+0000", 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7155000000000002e-05 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137278+0000", 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176193 2024-09-10T05:57:39.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137441+0000", 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016302999999999999 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144714+0000", 2024-09-10T05:57:39.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072732439999999999 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148890+0000", 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041755910000000002 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148964+0000", 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4047000000000004e-05 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.149014+0000", 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0229000000000003e-05 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3038 3.9 e91/24 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head v 91'7, mlcod=73'5)", 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.4254474009999996, 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023213424999999999, 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179953+0000", 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059275639999999997 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179968+0000", 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5121e-05 2024-09-10T05:57:39.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179980+0000", 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1773000000000001e-05 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180059+0000", 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180085+0000", 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6227000000000001e-05 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197005+0000", 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016919975 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197238+0000", 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023277500000000001 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.685 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3046 3.1e e91/90 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3233991559999998, 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018313788000000001, 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:39.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276074+0000", 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0219999999999999e-06 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287890+0000", 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181626 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287919+0000", 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8493e-05 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287931+0000", 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1990999999999999e-05 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288006+0000", 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5612999999999996e-05 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288030+0000", 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3998999999999998e-05 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294328+0000", 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062977299999999996 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294387+0000", 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8680000000000001e-05 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.690 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3052 3.21 3:84f20414:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.2557653709999999, 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017826086000000001, 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3052 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343709+0000", 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345869+0000", 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002160159 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345883+0000", 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345891+0000", 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4150000000000002e-06 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345960+0000", 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8885000000000002e-05 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346142+0000", 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000182039 2024-09-10T05:57:39.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346292+0000", 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150865 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.353142+0000", 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068494100000000002 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361408+0000", 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008266219 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361474+0000", 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6347999999999996e-05 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361533+0000", 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8223000000000001e-05 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.696 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3249 3.2e 3:747b1d17:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.748723942, 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017772942999999999, 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:39.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3249 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850750+0000", 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4530000000000001e-06 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852297+0000", 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546609 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852318+0000", 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0525000000000001e-05 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852332+0000", 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4705000000000001e-05 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852417+0000", 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5220000000000001e-05 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852595+0000", 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017759699999999999 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852756+0000", 2024-09-10T05:57:39.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016041699999999999 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.857792+0000", 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050367830000000004 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868397+0000", 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604255999999999 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868467+0000", 2024-09-10T05:57:39.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0444000000000005e-05 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868521+0000", 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3934000000000002e-05 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3250 3.2d e93/24 3:b5d1db82:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_239:head v 93'8, mlcod=92'6)", 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7320638719999999, 2024-09-10T05:57:39.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010751937, 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867411+0000", 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872662+0000", 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052508920000000001 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872689+0000", 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7007000000000001e-05 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872701+0000", 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2346e-05 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872802+0000", 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100962 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872836+0000", 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3674000000000003e-05 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878100+0000", 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052643380000000004 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878160+0000", 2024-09-10T05:57:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9917000000000002e-05 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3253 3.28 e93/90 3:17a9055b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_242:head v 93'7, mlcod=92'5)", 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.701066653, 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014804029999999999, 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:39.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:39.709 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898407+0000", 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8050000000000001e-06 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903094+0000", 2024-09-10T05:57:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046872809999999997 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903107+0000", 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2842e-05 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903118+0000", 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0557000000000001e-05 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903206+0000", 2024-09-10T05:57:39.711 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8678999999999996e-05 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903230+0000", 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3632e-05 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913156+0000", 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099255690000000004 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:39.712 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913209+0000", 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3665000000000002e-05 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:39.713 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:39.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:39.715 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:39.708+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:39.815 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:39.814+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:39.872 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:39.872 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:39.872 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:39.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:39.908 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:57:39.916 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:39.912+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:39.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:40.017 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:40.018 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:40.018 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:40.018 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:40.014+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:40.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:40.120 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:40.118+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:40.129 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:40.129 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:40.145 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:40.145 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:40.161 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:40.177 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:40.177 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:40.184 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:40.184 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:40.196 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:40.197 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:40.197 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:40.219 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:40.214+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:40.222 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:40.222 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:40.242 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:40.242 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:40.262 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:40.262 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:40.320 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:40.316+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:40.325 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:40.325 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:40.339 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:40.427 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:40.424+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:40.507 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:40.507 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:40.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:40.522 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:40.516+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:40.623 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:40.616+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:40.688 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:40.688 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:40.702 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:40.743 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:40.740+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:40.824 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:40.820+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:40.865 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:40.865 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:40.879 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:40.925 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:40.922+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:41.025 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:41.020+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:41.046 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:41.046 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:41.061 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:41.126 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:41.122+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:41.226 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:41.226 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:41.226 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:41.222+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:41.240 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:41.328 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:41.326+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:41.359 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:41.359 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:41.373 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:41.429 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:41.426+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:41.501 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:41.501 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:41.515 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:41.530 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:41.526+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:41.631 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:41.628+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:41.633 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:41.633 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:41.647 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:41.735 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:41.732+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:41.817 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:41.818 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:41.832 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:41.832 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:41.828+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:41.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:57:41.933 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:41.930+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:41.997 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:41.997 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:42.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:42.034 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:42.030+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:42.126 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:42.126 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:42.135 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:42.132+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:42.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:42.236 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:42.234+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:42.258 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:42.258 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:42.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:42.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:42.364 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:42.362+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:42.437 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:42.434+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:42.440 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:42.440 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:42.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:42.458 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:42.459 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:42.476 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:42.477 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:42.492 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:42.492 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:42.509 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:42.509 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:42.530 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:42.530 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:42.539 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:42.536+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:42.552 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:42.552 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:42.573 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:42.573 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2675 3.1 3:808dd43d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.238953486, 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016454241000000001, 2024-09-10T05:57:42.579 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2675 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336176+0000", 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.336179+0000", 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.484e-06 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337951+0000", 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017720329999999999 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337984+0000", 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3022000000000003e-05 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.337999+0000", 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4942e-05 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338081+0000", 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1463000000000003e-05 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338193+0000", 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111705 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.338294+0000", 2024-09-10T05:57:42.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000101019 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.347997+0000", 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097033069999999996 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352514+0000", 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045167970000000003 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352577+0000", 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3260000000000001e-05 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.352630+0000", 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3208999999999998e-05 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2705 3.17 3:eba32b22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.882760212000001, 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017940067000000001, 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2705 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692369+0000", 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.692372+0000", 2024-09-10T05:57:42.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3590000000000002e-06 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693889+0000", 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015172370000000001 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693920+0000", 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1291999999999998e-05 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.693933+0000", 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2693e-05 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694001+0000", 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7830000000000006e-05 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694130+0000", 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129114 2024-09-10T05:57:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.694285+0000", 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015531599999999999 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.698265+0000", 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0039797950000000004 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710231+0000", 2024-09-10T05:57:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011966348999999999 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710272+0000", 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1193999999999999e-05 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.710309+0000", 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6888000000000003e-05 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.731881498999996, 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:57:42.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.579711801999998, 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:57:42.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.604 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2742 3.1 3:81622134:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.499709211000003, 2024-09-10T05:57:42.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016996092000000001, 2024-09-10T05:57:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2742 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075420+0000", 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.075424+0000", 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3380000000000001e-06 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077125+0000", 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001701504 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077157+0000", 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1665000000000003e-05 2024-09-10T05:57:42.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077172+0000", 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5379e-05 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077245+0000", 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2706000000000005e-05 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077418+0000", 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017356399999999999 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.077574+0000", 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015575499999999999 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.082224+0000", 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046503439999999998 2024-09-10T05:57:42.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092275+0000", 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010050738 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092356+0000", 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0822999999999995e-05 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.092416+0000", 2024-09-10T05:57:42.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0275999999999997e-05 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2750 3.1b 3:da716242:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.418828318999999, 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016402756000000001, 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2750 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156301+0000", 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.156304+0000", 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7590000000000002e-06 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157544+0000", 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0012403900000000001 2024-09-10T05:57:42.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157569+0000", 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5133000000000001e-05 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157580+0000", 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0953e-05 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157672+0000", 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1685000000000001e-05 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.157859+0000", 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018694499999999999 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.158038+0000", 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017913299999999999 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.163265+0000", 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052268569999999997 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172626+0000", 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093605370000000004 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172667+0000", 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1764999999999997e-05 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.172704+0000", 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6599e-05 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2777 3.1b 3:d93a8c15:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.136745621000003, 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019570203000000001, 2024-09-10T05:57:42.620 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2777 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438384+0000", 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.438387+0000", 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9009999999999998e-06 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439946+0000", 2024-09-10T05:57:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00155905 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439975+0000", 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9311000000000001e-05 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.439988+0000", 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3319000000000001e-05 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440057+0000", 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8208999999999997e-05 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440175+0000", 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118261 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.440286+0000", 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000111242 2024-09-10T05:57:42.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.444527+0000", 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042409800000000001 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457848+0000", 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013320702 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.625 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457903+0000", 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4908999999999999e-05 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.457954+0000", 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1319000000000001e-05 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2785 3.12 3:49663187:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:42.626 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.035456253, 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015080374000000001, 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2785 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539673+0000", 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.539676+0000", 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.689e-06 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542236+0000", 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025599830000000001 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542273+0000", 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7063000000000001e-05 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542288+0000", 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.518e-05 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542365+0000", 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7292999999999993e-05 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542494+0000", 2024-09-10T05:57:42.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012883099999999999 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.542615+0000", 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012126899999999999 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.546794+0000", 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041788149999999998 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554636+0000", 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0078412470000000008 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554707+0000", 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1899999999999999e-05 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.554754+0000", 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6103999999999998e-05 2024-09-10T05:57:42.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3006 3.b 3:d167e876:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.3867590239999998, 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.73997048700000001, 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.633 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3006 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188374+0000", 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4970000000000001e-06 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190071+0000", 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00169713 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190105+0000", 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3581000000000003e-05 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190122+0000", 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7016000000000001e-05 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190223+0000", 2024-09-10T05:57:42.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010094000000000001 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190238+0000", 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5583e-05 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908275+0000", 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.71803706099999998 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908586+0000", 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031096200000000002 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908871+0000", 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028523900000000001 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915859+0000", 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069872830000000004 2024-09-10T05:57:42.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928177+0000", 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012318513999999999 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928243+0000", 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5297999999999997e-05 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928341+0000", 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8382999999999996e-05 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3012 3.24 e91/90 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head v 91'8, mlcod=0'0)", 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.886421+0000", 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.6887082719999995, 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017811443, 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.886421+0000", 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.886421+0000", 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.886422+0000", 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6499999999999999e-07 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893681+0000", 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072591310000000003 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893689+0000", 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2949999999999994e-06 2024-09-10T05:57:42.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893695+0000", 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7450000000000001e-06 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893741+0000", 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5977999999999999e-05 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.893765+0000", 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3824000000000001e-05 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.904189+0000", 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010424319 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.904233+0000", 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3686000000000002e-05 2024-09-10T05:57:42.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3010 3.7 e91/90 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head v 91'3, mlcod=0'0)", 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.6583317260000001, 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023300923000000001, 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:57:42.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8599999999999998e-07 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931447+0000", 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014648899999999999 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931467+0000", 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0061999999999999e-05 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931479+0000", 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931547+0000", 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8113000000000003e-05 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931578+0000", 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0669000000000001e-05 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936627+0000", 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050490830000000002 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.940099+0000", 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034719429999999999 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3015 3.3d 3:bd148ba2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.6561946049999996, 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020562475, 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3015 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918938+0000", 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.791e-06 2024-09-10T05:57:42.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.921985+0000", 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030470240000000002 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922010+0000", 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5726999999999999e-05 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922027+0000", 2024-09-10T05:57:42.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6741000000000001e-05 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922151+0000", 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012387699999999999 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922302+0000", 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150827 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922440+0000", 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138491 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930425+0000", 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079845079999999995 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939338+0000", 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089127400000000006 2024-09-10T05:57:42.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939431+0000", 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2980999999999996e-05 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939497+0000", 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6767999999999995e-05 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.655 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3018 3.1 3:8381c127:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.950708+0000", 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.6244210179999996, 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016822143000000001, 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3018 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950708+0000", 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950708+0000", 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950711+0000", 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2809999999999998e-06 2024-09-10T05:57:42.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952519+0000", 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018086790000000001 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952546+0000", 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6687e-05 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952559+0000", 2024-09-10T05:57:42.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2901000000000001e-05 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952642+0000", 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2670000000000006e-05 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952814+0000", 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017191299999999999 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.952975+0000", 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000161772 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.966956+0000", 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013980978999999999 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.967341+0000", 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00038460799999999999 2024-09-10T05:57:42.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.967441+0000", 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010028 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.967531+0000", 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9373e-05 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3021 3.b 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.5985777070000005, 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029193581, 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.662 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3021 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976554+0000", 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3640000000000002e-06 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978476+0000", 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019221830000000001 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978493+0000", 2024-09-10T05:57:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6331e-05 2024-09-10T05:57:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978503+0000", 2024-09-10T05:57:42.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0774000000000001e-05 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978582+0000", 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8651000000000003e-05 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978858+0000", 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000276455 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.979018+0000", 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015947800000000001 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.984809+0000", 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057911280000000004 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005635+0000", 2024-09-10T05:57:42.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020826181999999999 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005679+0000", 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3417999999999997e-05 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005745+0000", 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6617000000000003e-05 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.668 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3030 3.18 3:1a400f4c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.090346+0000", 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4847836589999996, 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016792213, 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.669 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3030 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.090346+0000", 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.090346+0000", 2024-09-10T05:57:42.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.090349+0000", 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.428e-06 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096554+0000", 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062045859999999998 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096635+0000", 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1576000000000006e-05 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096667+0000", 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1245000000000003e-05 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096764+0000", 2024-09-10T05:57:42.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7498999999999996e-05 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.096945+0000", 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000180872 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097126+0000", 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000181149 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.106882+0000", 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009755896 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.106930+0000", 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7633999999999998e-05 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.107002+0000", 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2080000000000001e-05 2024-09-10T05:57:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.107138+0000", 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000136248 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3032 3.23 3:c5ef921f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.111414+0000", 2024-09-10T05:57:42.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4637159349999997, 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019602378, 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3032 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.111414+0000", 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.111414+0000", 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.111416+0000", 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2809999999999998e-06 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.677 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113774+0000", 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023577670000000002 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113796+0000", 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2466000000000001e-05 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113809+0000", 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.113887+0000", 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8190999999999997e-05 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.114017+0000", 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012944599999999999 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.114207+0000", 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019061100000000001 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.121962+0000", 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077542820000000004 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.130804+0000", 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088425210000000008 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.130881+0000", 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6997999999999997e-05 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.131016+0000", 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000134824 2024-09-10T05:57:42.681 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3033 3.17 3:ea227143:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.123163+0000", 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4519663390000002, 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019219914000000001, 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.682 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3033 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.123163+0000", 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.683 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.123163+0000", 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.123166+0000", 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.14e-06 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.124926+0000", 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017598659999999999 2024-09-10T05:57:42.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.124954+0000", 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7708e-05 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.124969+0000", 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5157000000000001e-05 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.125045+0000", 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5859000000000007e-05 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.125218+0000", 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172864 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.125370+0000", 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015196599999999999 2024-09-10T05:57:42.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.130715+0000", 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053458350000000002 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.142265+0000", 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011549271999999999 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.142336+0000", 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0871000000000006e-05 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.142383+0000", 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7376000000000002e-05 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3035 3.b 3:d1267ce1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.688 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.4302433790000002, 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021701069, 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3035 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.689 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144889+0000", 2024-09-10T05:57:42.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146859+0000", 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019707790000000002 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146897+0000", 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7713000000000003e-05 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146914+0000", 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6558999999999998e-05 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147007+0000", 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3190999999999996e-05 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147200+0000", 2024-09-10T05:57:42.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193084 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147389+0000", 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188543 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.153536+0000", 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061479179999999996 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166419+0000", 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01288215 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166489+0000", 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321000000000007e-05 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166587+0000", 2024-09-10T05:57:42.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8165000000000006e-05 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3041 3.b 3:d26ad16f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.3645537929999998, 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030467424999999999, 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3041 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210578+0000", 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6240000000000002e-06 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212335+0000", 2024-09-10T05:57:42.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00175713 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212364+0000", 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8208000000000002e-05 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212378+0000", 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4255e-05 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212469+0000", 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1051000000000006e-05 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212656+0000", 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018742699999999999 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212834+0000", 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000177298 2024-09-10T05:57:42.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.219661+0000", 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068273070000000003 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240871+0000", 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021210184 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240938+0000", 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6637999999999995e-05 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.241043+0000", 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105303 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.701 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3254 3.1b 3:d8995d6f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.905840+0000", 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6692898840000003, 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016463552999999999, 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3254 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.702 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.905840+0000", 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.905840+0000", 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.905843+0000", 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.287e-06 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908146+0000", 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023034990000000001 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908163+0000", 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867e-05 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908175+0000", 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1463e-05 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908323+0000", 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014831600000000001 2024-09-10T05:57:42.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908501+0000", 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017782400000000001 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.908657+0000", 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000156164 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:42.706 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.914820+0000", 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061630230000000001 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.922199+0000", 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073787790000000002 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.922248+0000", 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9122999999999997e-05 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:42.707 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.922303+0000", 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207999999999997e-05 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:42.708 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:42.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:42.710 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:42.711 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:42.706+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:42.811 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:42.808+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:42.886 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:42.886 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:42.887 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:42.887 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:42.902 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:42.912 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:42.908+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:42.960 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:57:43.013 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:43.008+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:43.026 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:43.026 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:43.026 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:43.026 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:43.026 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:43.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:43.113 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:43.108+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:43.159 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:43.159 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:57:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 136.598610138, 2024-09-10T05:57:43.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:57:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:57:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:57:43.161 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:57:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:57:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:57:43.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:57:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:57:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:57:43.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:57:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:57:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:57:43.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:57:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:57:43.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:57:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:57:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:57:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2695 3.4 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:43.171 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.562785353000002, 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013307572, 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592030+0000", 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8650000000000001e-06 2024-09-10T05:57:43.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594049+0000", 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002019449 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594078+0000", 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9376000000000001e-05 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594092+0000", 2024-09-10T05:57:43.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3505e-05 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594168+0000", 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6063999999999995e-05 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594293+0000", 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012461899999999999 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594406+0000", 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112983 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605086+0000", 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010680383999999999 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605259+0000", 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172659 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605303+0000", 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4651000000000003e-05 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605334+0000", 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1016999999999998e-05 2024-09-10T05:57:43.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2717 3.25 3:a515f872:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.334840909999997, 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011604369, 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2717 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819975+0000", 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821866+0000", 2024-09-10T05:57:43.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00189079 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821899+0000", 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809000000000001e-05 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821914+0000", 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5e-05 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822002+0000", 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7892999999999993e-05 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822154+0000", 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015216200000000001 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822295+0000", 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014084899999999999 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830948+0000", 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086527919999999994 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831454+0000", 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050560199999999996 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831520+0000", 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6017000000000002e-05 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831576+0000", 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5825000000000002e-05 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2730 3.19 3:99f0627c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.199445517000001, 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012565949999999999, 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2730 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955370+0000", 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3620000000000002e-06 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957409+0000", 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020391720000000001 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957452+0000", 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2895000000000002e-05 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957466+0000", 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4311000000000001e-05 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957588+0000", 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121663 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957792+0000", 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203792 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957975+0000", 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183678 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965498+0000", 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075228700000000001 2024-09-10T05:57:43.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967831+0000", 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023322590000000002 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967882+0000", 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1598000000000003e-05 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967933+0000", 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0349999999999997e-05 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2731 3.4 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.189660664000002, 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013157917999999999, 2024-09-10T05:57:43.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2731 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965155+0000", 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5889999999999999e-06 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966586+0000", 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001430618 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966603+0000", 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7059999999999999e-05 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966614+0000", 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1141999999999999e-05 2024-09-10T05:57:43.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966689+0000", 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5574000000000005e-05 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966819+0000", 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129558 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966944+0000", 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012527799999999999 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975490+0000", 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085459999999999998 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978216+0000", 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027259879999999999 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978268+0000", 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1493000000000003e-05 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978309+0000", 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1618e-05 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2733 3.0 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.168390137000003, 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012015477, 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2733 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986425+0000", 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988599+0000", 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021740489999999999 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988621+0000", 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1922000000000001e-05 2024-09-10T05:57:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988633+0000", 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1758e-05 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988727+0000", 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3867000000000001e-05 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988922+0000", 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019508500000000001 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989099+0000", 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017668299999999999 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.996748+0000", 2024-09-10T05:57:43.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007649159 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998318+0000", 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015705090000000001 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998382+0000", 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4036999999999997e-05 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998437+0000", 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207000000000002e-05 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2756 3.1a e74/24 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.934419574000003, 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012940208, 2024-09-10T05:57:43.203 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226300+0000", 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059069400000000003 2024-09-10T05:57:43.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226316+0000", 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6509000000000001e-05 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226325+0000", 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7439999999999996e-06 2024-09-10T05:57:43.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226425+0000", 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100188 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226452+0000", 2024-09-10T05:57:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7140000000000001e-05 2024-09-10T05:57:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233268+0000", 2024-09-10T05:57:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068155660000000003 2024-09-10T05:57:43.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233333+0000", 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4789000000000006e-05 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2776 3.31 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.726379459, 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019117624, 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2776 2024-09-10T05:57:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428435+0000", 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6019999999999998e-06 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429944+0000", 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001509095 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429973+0000", 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8558e-05 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429986+0000", 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3591000000000001e-05 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430053+0000", 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-10T05:57:43.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430167+0000", 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114243 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430257+0000", 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9386000000000001e-05 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.434734+0000", 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044769909999999996 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447370+0000", 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012636214 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447476+0000", 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105844 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447550+0000", 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4622000000000005e-05 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2782 3.25 3:a5d3e292:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.652366567000001, 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012424736, 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2782 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502448+0000", 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-10T05:57:43.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505248+0000", 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027999470000000001 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505285+0000", 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.68e-05 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505304+0000", 2024-09-10T05:57:43.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9423999999999999e-05 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505417+0000", 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011298000000000001 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505608+0000", 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019085900000000001 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505785+0000", 2024-09-10T05:57:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176832 2024-09-10T05:57:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.511556+0000", 2024-09-10T05:57:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057704219999999999 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514735+0000", 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031793749999999999 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514811+0000", 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6129000000000002e-05 2024-09-10T05:57:43.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514870+0000", 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9250999999999999e-05 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2783 3.3e 3:7c6034eb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 41.641284955000003, 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503764, 2024-09-10T05:57:43.226 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2783 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513531+0000", 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1520000000000002e-06 2024-09-10T05:57:43.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516867+0000", 2024-09-10T05:57:43.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033353800000000002 2024-09-10T05:57:43.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516900+0000", 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3414999999999998e-05 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516917+0000", 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867999999999998e-05 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516998+0000", 2024-09-10T05:57:43.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0851000000000002e-05 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517142+0000", 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144671 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517248+0000", 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105319 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526098+0000", 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088501629999999994 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526838+0000", 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074033699999999998 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526948+0000", 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109647 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.527031+0000", 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2960999999999994e-05 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2997 3.4 3:2257915f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0860874099999993, 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015853236, 2024-09-10T05:57:43.233 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2997 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:43.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068729+0000", 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9790000000000004e-06 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071067+0000", 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002338363 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071102+0000", 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4694999999999999e-05 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071116+0000", 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4212e-05 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071192+0000", 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6440000000000007e-05 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071318+0000", 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012571699999999999 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071411+0000", 2024-09-10T05:57:43.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2799000000000004e-05 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079634+0000", 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082235420000000004 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084461+0000", 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048270240000000001 2024-09-10T05:57:43.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084527+0000", 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5273999999999999e-05 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084578+0000", 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1190999999999998e-05 2024-09-10T05:57:43.239 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2998 3.0 3:00581a26:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.0757157549999992, 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011652958, 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.240 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2998 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079099+0000", 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.588e-06 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081434+0000", 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002335213 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081462+0000", 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8107999999999999e-05 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081479+0000", 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6809000000000001e-05 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081564+0000", 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5258000000000003e-05 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081694+0000", 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129214 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081846+0000", 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000152881 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.087780+0000", 2024-09-10T05:57:43.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059333980000000003 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090625+0000", 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028450480000000002 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090689+0000", 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3739999999999996e-05 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090749+0000", 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0701e-05 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3009 3.33 e91/90 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head v 91'7, mlcod=0'0)", 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.2391027260000005, 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021229792000000001, 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.246 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915710+0000", 2024-09-10T05:57:43.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925190+0000", 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094797909999999996 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925205+0000", 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4749999999999999e-05 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925214+0000", 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1889999999999996e-06 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925307+0000", 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3121000000000005e-05 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925347+0000", 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0170000000000003e-05 2024-09-10T05:57:43.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936873+0000", 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011525409 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936939+0000", 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6383000000000005e-05 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3016 3.4 3:22f6155f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.2238243579999999, 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015593559999999999, 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3016 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.251 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930990+0000", 2024-09-10T05:57:43.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3769999999999999e-06 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.933999+0000", 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003008911 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934019+0000", 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0258000000000002e-05 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934033+0000", 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3723999999999999e-05 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934110+0000", 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6977999999999994e-05 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934265+0000", 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155305 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934413+0000", 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014791199999999999 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.943327+0000", 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089134539999999995 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946445+0000", 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031179100000000002 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946529+0000", 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4636999999999996e-05 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946581+0000", 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2094e-05 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3029 3.29 e91/90 3:94a1ebfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_31:head v 91'4, mlcod=0'0)", 2024-09-10T05:57:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.0697242869999997, 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012013543999999999, 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085089+0000", 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091607+0000", 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065175650000000003 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091635+0000", 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8127999999999999e-05 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091650+0000", 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4543e-05 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091768+0000", 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117859 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091809+0000", 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1304999999999998e-05 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097031+0000", 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052216909999999997 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097101+0000", 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0832000000000002e-05 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3039 3.3e 3:7c01ab0e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.9688429240000005, 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011728011, 2024-09-10T05:57:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3039 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185972+0000", 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188219+0000", 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002246783 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188237+0000", 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7798000000000001e-05 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188247+0000", 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0543000000000001e-05 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188918+0000", 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067044700000000001 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.189263+0000", 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034507500000000003 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.189430+0000", 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016748699999999999 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197213+0000", 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077831469999999998 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197564+0000", 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035080199999999999 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197647+0000", 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2392999999999995e-05 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197697+0000", 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0531999999999997e-05 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3040 3.3e 3:7d5213dd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.9587674919999998, 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013364289999999999, 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3040 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196048+0000", 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1870000000000001e-06 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199734+0000", 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036858400000000001 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199758+0000", 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3978e-05 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199770+0000", 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2272999999999999e-05 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199855+0000", 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5451000000000006e-05 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.200021+0000", 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016566500000000001 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.200201+0000", 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018035999999999999 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209028+0000", 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088263330000000004 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209299+0000", 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027105299999999999 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209359+0000", 2024-09-10T05:57:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0106999999999999e-05 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209409+0000", 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3051 3.25 3:a5ff5638:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 7.8223590019999998, 2024-09-10T05:57:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013385912, 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3051 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332456+0000", 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.469e-06 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334763+0000", 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023073899999999999 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334790+0000", 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6957999999999998e-05 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334803+0000", 2024-09-10T05:57:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3205e-05 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334878+0000", 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4840999999999997e-05 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.335068+0000", 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019012400000000001 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.335279+0000", 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021051199999999999 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345755+0000", 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010476328 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345763+0000", 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1470000000000001e-06 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345804+0000", 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0652999999999999e-05 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345839+0000", 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5284999999999998e-05 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3248 3.31 3:8fb1b3a5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.3126233249999997, 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017678678, 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3248 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842192+0000", 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2660000000000002e-06 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843248+0000", 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010555079999999999 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843280+0000", 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2869e-05 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843296+0000", 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5116000000000001e-05 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843378+0000", 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2936999999999996e-05 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843589+0000", 2024-09-10T05:57:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000210571 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843713+0000", 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012438299999999999 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.848697+0000", 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049832549999999998 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859767+0000", 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01107059 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859833+0000", 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5338000000000004e-05 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859867+0000", 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4845000000000003e-05 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3256 3.4 3:23355cdd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.2245678690000004, 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015740632000000001, 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3256 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930247+0000", 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0589999999999998e-06 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.931973+0000", 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017261799999999999 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.931998+0000", 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4671000000000001e-05 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932011+0000", 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2884000000000001e-05 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932095+0000", 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4191999999999996e-05 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932103+0000", 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5569999999999998e-06 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936309+0000", 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042062499999999999 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936474+0000", 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164895 2024-09-10T05:57:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936567+0000", 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2838999999999997e-05 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.944773+0000", 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082062230000000003 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945871+0000", 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001097867 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945935+0000", 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4141999999999997e-05 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945985+0000", 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9873000000000002e-05 2024-09-10T05:57:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.294 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:43.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:43.296 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:43.292+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:43.397 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:43.392+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:43.431 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:43.431 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:43.431 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:43.431 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:43.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:43.498 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:43.494+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:43.564 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:43.564 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:43.564 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:43.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:43.599 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:43.596+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:43.700 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:43.698+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:43.752 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:43.752 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2716 3.3b e73/24 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head v 73'8, mlcod=73'5)", 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.930954092999997, 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012669998999999999, 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.753 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818378+0000", 2024-09-10T05:57:43.754 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.607e-06 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822721+0000", 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043427550000000002 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822741+0000", 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0820000000000001e-05 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.755 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822750+0000", 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969999999999999e-06 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822826+0000", 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5488000000000006e-05 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822850+0000", 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4328000000000002e-05 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.756 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830980+0000", 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081304089999999999 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831046+0000", 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5895000000000005e-05 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2721 3.9 e73/24 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head v 73'5, mlcod=73'3)", 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.875348664999997, 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011236408, 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873983+0000", 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6729999999999999e-06 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.759 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878223+0000", 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042396789999999997 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878246+0000", 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3326e-05 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878304+0000", 2024-09-10T05:57:43.760 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7794000000000003e-05 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878368+0000", 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4005999999999997e-05 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878391+0000", 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2909e-05 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.761 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885156+0000", 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067645680000000003 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885218+0000", 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2453000000000007e-05 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.762 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2725 3.21 3:856ed7cd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.843633322999999, 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018910211999999999, 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2725 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905702+0000", 2024-09-10T05:57:43.764 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908098+0000", 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023965269999999999 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908124+0000", 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899000000000001e-05 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.765 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908139+0000", 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5026e-05 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908222+0000", 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908417+0000", 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195026 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908573+0000", 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155849 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.913471+0000", 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048985469999999996 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924490+0000", 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011019167999999999 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924557+0000", 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6925e-05 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924607+0000", 2024-09-10T05:57:43.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9932000000000002e-05 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2748 3.3b e74/24 3:deadbbb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_211:head v 74'10, mlcod=73'8)", 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.606853323999999, 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011669703999999999, 2024-09-10T05:57:43.769 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.770 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142478+0000", 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999997e-07 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148304+0000", 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058267570000000001 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148327+0000", 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2921e-05 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148338+0000", 2024-09-10T05:57:43.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294999999999999e-05 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148403+0000", 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4332999999999995e-05 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148421+0000", 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7991000000000001e-05 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.773 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154104+0000", 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005683385 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154147+0000", 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2446e-05 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.774 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2751 3.21 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.582752522, 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019591372999999999, 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2751 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166581+0000", 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.167981+0000", 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00139999 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168020+0000", 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8980000000000003e-05 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168036+0000", 2024-09-10T05:57:43.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6568000000000001e-05 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168113+0000", 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6417999999999999e-05 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168228+0000", 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115161 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:43.778 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168349+0000", 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012086 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175149+0000", 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068000150000000004 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186073+0000", 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010924411 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186119+0000", 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5550999999999998e-05 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186169+0000", 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0603000000000003e-05 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2753 3.21 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.780 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.562781799, 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019351368000000001, 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2753 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186551+0000", 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5059999999999998e-06 2024-09-10T05:57:43.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.187974+0000", 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014233259999999999 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188000+0000", 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188011+0000", 2024-09-10T05:57:43.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188082+0000", 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1061000000000003e-05 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188225+0000", 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014240499999999999 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188343+0000", 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118019 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192712+0000", 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043687309999999998 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205798+0000", 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013086191 2024-09-10T05:57:43.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205849+0000", 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205900+0000", 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1174999999999997e-05 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2757 3.2e 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.525286186000002, 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021228316000000001, 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2757 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.787 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224047+0000", 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.531e-06 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225876+0000", 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018291119999999999 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225905+0000", 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9615999999999999e-05 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225921+0000", 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5338000000000001e-05 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226002+0000", 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1521999999999996e-05 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226149+0000", 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147031 2024-09-10T05:57:43.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226249+0000", 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9671000000000002e-05 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.232949+0000", 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067004150000000004 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245149+0000", 2024-09-10T05:57:43.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012199468 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245220+0000", 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0990999999999998e-05 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245272+0000", 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2621000000000003e-05 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3003 3.3b e90/24 3:de7cc7af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_7:head v 90'11, mlcod=73'9)", 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.587112973, 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013130332999999999, 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162219+0000", 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-10T05:57:43.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168244+0000", 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060244879999999997 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168303+0000", 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8974999999999997e-05 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168321+0000", 2024-09-10T05:57:43.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168405+0000", 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189999999999995e-05 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168431+0000", 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6271e-05 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.796 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175260+0000", 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068292320000000002 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175348+0000", 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7458000000000002e-05 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.797 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3008 3.9 e90/24 3:905d4b1a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_12:head v 90'6, mlcod=73'4)", 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.5323918729999999, 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011104477, 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216940+0000", 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222832+0000", 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058914040000000003 2024-09-10T05:57:43.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222856+0000", 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4006999999999999e-05 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222867+0000", 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1191e-05 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222943+0000", 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.64e-05 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222967+0000", 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-05 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.227972+0000", 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050046989999999996 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.228043+0000", 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1073000000000002e-05 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3015 3.3d e91/24 3:bd148ba2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_17:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.8263473510000008, 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013567879, 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922984+0000", 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.051e-06 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924550+0000", 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001566226 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924566+0000", 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5722999999999998e-05 2024-09-10T05:57:43.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924577+0000", 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0634e-05 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925330+0000", 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075334999999999996 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925375+0000", 2024-09-10T05:57:43.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4631e-05 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936507+0000", 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011132856 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936551+0000", 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3408000000000002e-05 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.806 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3017 3.3b e91/24 3:dd236608:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_19:head v 91'12, mlcod=74'10)", 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.8046376710000001, 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014972480999999999, 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:43.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-07 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950568+0000", 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058748680000000001 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950590+0000", 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2096e-05 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950600+0000", 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0291e-05 2024-09-10T05:57:43.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950677+0000", 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6171e-05 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950702+0000", 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5633999999999999e-05 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959561+0000", 2024-09-10T05:57:43.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088584089999999994 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959665+0000", 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104448 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3019 3.1f 3:fa47017c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:43.811 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7904687250000002, 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021984574999999999, 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3019 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958865+0000", 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:57:43.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961571+0000", 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002706052 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961590+0000", 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9028000000000001e-05 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961602+0000", 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2342e-05 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961725+0000", 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012271 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961895+0000", 2024-09-10T05:57:43.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017041300000000001 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961998+0000", 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102068 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.968323+0000", 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063252869999999997 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.816 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980751+0000", 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012427745 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980800+0000", 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9048999999999997e-05 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980846+0000", 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6517999999999997e-05 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.817 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3023 3.3b e91/24 3:de37cb64:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_25:head v 91'13, mlcod=90'11)", 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.7408569410000005, 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011245872000000001, 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008474+0000", 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9599999999999998e-07 2024-09-10T05:57:43.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014097+0000", 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056226690000000003 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014109+0000", 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2156e-05 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014116+0000", 2024-09-10T05:57:43.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0230000000000004e-06 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014169+0000", 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2777e-05 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014190+0000", 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0812e-05 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019638+0000", 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054488619999999996 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019719+0000", 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0777000000000003e-05 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3034 3.21 3:85b134c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:43.822 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.6142382749999999, 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013922285, 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3034 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135095+0000", 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6120000000000001e-06 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.136970+0000", 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001875551 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137000+0000", 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9634000000000001e-05 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137015+0000", 2024-09-10T05:57:43.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4999e-05 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137102+0000", 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7155000000000002e-05 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137278+0000", 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176193 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137441+0000", 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016302999999999999 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144714+0000", 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072732439999999999 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148890+0000", 2024-09-10T05:57:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041755910000000002 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148964+0000", 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4047000000000004e-05 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.149014+0000", 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0229000000000003e-05 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3038 3.9 e91/24 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head v 91'7, mlcod=73'5)", 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.5753057360000007, 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023213424999999999, 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-10T05:57:43.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179953+0000", 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059275639999999997 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179968+0000", 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5121e-05 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179980+0000", 2024-09-10T05:57:43.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1773000000000001e-05 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180059+0000", 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180085+0000", 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6227000000000001e-05 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197005+0000", 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016919975 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197238+0000", 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023277500000000001 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3046 3.1e e91/90 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:43.833 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.473257491, 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018313788000000001, 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.834 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276074+0000", 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0219999999999999e-06 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287890+0000", 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181626 2024-09-10T05:57:43.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287919+0000", 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8493e-05 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287931+0000", 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1990999999999999e-05 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288006+0000", 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5612999999999996e-05 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288030+0000", 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3998999999999998e-05 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294328+0000", 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062977299999999996 2024-09-10T05:57:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294387+0000", 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8680000000000001e-05 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3052 3.21 3:84f20414:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 8.4056237060000001, 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017826086000000001, 2024-09-10T05:57:43.838 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3052 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343709+0000", 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.840 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345869+0000", 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002160159 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345883+0000", 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345891+0000", 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4150000000000002e-06 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345960+0000", 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8885000000000002e-05 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346142+0000", 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000182039 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346292+0000", 2024-09-10T05:57:43.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150865 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.353142+0000", 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068494100000000002 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361408+0000", 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008266219 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361474+0000", 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6347999999999996e-05 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361533+0000", 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8223000000000001e-05 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.844 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3249 3.2e 3:747b1d17:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.898582277, 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017772942999999999, 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3249 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.845 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850750+0000", 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4530000000000001e-06 2024-09-10T05:57:43.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852297+0000", 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546609 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852318+0000", 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0525000000000001e-05 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852332+0000", 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4705000000000001e-05 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852417+0000", 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5220000000000001e-05 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852595+0000", 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017759699999999999 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852756+0000", 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016041699999999999 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.857792+0000", 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050367830000000004 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868397+0000", 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604255999999999 2024-09-10T05:57:43.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868467+0000", 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0444000000000005e-05 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868521+0000", 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3934000000000002e-05 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.850 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3250 3.2d e93/24 3:b5d1db82:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_239:head v 93'8, mlcod=92'6)", 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.8819222069999997, 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010751937, 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.851 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867411+0000", 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872662+0000", 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052508920000000001 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872689+0000", 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7007000000000001e-05 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872701+0000", 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2346e-05 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872802+0000", 2024-09-10T05:57:43.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100962 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872836+0000", 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3674000000000003e-05 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878100+0000", 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052643380000000004 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878160+0000", 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9917000000000002e-05 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3253 3.28 e93/90 3:17a9055b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_242:head v 93'7, mlcod=92'5)", 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.850924988, 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014804029999999999, 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:43.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898407+0000", 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8050000000000001e-06 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903094+0000", 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046872809999999997 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903107+0000", 2024-09-10T05:57:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2842e-05 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903118+0000", 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0557000000000001e-05 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903206+0000", 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8678999999999996e-05 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:43.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903230+0000", 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3632e-05 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913156+0000", 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099255690000000004 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913209+0000", 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3665000000000002e-05 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.859 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:43.860 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:43.860 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:43.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:43.862 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:43.858+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:43.962 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:43.956+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:44.035 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:44.035 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:44.035 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:44.035 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:44.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:44.096 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:44.094+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:44.165 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:44.160+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:44.172 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:44.173 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:44.173 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:44.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:44.272 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:44.270+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 130.736955239, 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.370 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:57:44.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.931433237, 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:57:44.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.379 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.962855091000002, 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.380 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:57:44.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.700137214000002, 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:57:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.389 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:57:44.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.644838575000001, 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:57:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:44.397 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.615527606999997, 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:44.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:57:44.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:57:44.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:44.403 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.593772432999998, 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:57:44.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.407 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:57:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.488192894000001, 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:57:44.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.477385017000003, 2024-09-10T05:57:44.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:57:44.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:57:44.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.343015586, 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:57:44.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:57:44.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.258302231999998, 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.433 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.188780897999997, 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.434 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:44.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.436 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:57:44.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:57:44.438 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:57:44.439 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:44.440 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.092568047, 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.441 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.442 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:57:44.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.444 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.092421688999998, 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.446 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:57:44.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.448 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.449 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:57:44.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.076283199999999, 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:57:44.451 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.453 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.454 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 43.071442257000001, 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.456 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.457 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:57:44.458 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.459 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.460 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:57:44.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.960365867999997, 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.462 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.463 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:57:44.464 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.465 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.466 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:57:44.467 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.908602518999999, 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.468 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.469 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.472 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.882802816999998, 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:57:44.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:57:44.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 42.840801794999997, 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:44.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:57:44.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:44.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:44.482 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:57:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:57:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:44.483 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:44.483 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:44.484 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:44.364+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:44.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:44.485 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:44.482+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:44.585 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:44.582+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:44.618 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:44.618 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:44.618 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:44.618 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:44.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:44.687 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:44.680+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:44.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:44.756 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:44.756 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:44.757 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:44.770 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:44.788 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:44.786+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:44.868 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:44.869 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:44.885 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:44.885 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:44.889 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:44.886+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:44.901 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:44.901 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:44.920 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:44.920 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:44.939 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:44.939 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:44.940 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:44.954 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:44.958 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:44.977 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:44.977 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:44.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:57:44.996 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:44.996 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:44.994+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:45.077 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:45.091 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:45.092 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:45.084+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:45.191 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:45.188+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:45.257 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:45.257 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:45.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:45.292 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:45.290+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:45.393 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:45.390+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:45.438 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:45.438 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:45.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:45.494 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:45.490+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:45.576 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:45.576 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:45.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:45.595 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:45.594+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:45.696 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:45.694+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:45.715 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:45.715 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:45.729 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:45.797 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:45.794+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:45.854 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:45.854 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:45.868 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:45.897 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:45.894+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:45.973 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:57:45.992 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:45.992 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:45.998 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:45.992+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:46.006 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:46.099 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:46.096+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:46.174 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:46.174 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:46.188 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:46.231 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:46.228+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:46.300 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:46.296+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:46.354 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:46.354 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:46.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:46.411 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:46.408+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:46.501 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:46.502 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:46.502 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:46.496+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:46.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:46.603 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:46.598+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:46.645 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:46.645 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:46.659 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:46.748 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:46.746+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:46.807 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:46.804+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:46.822 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:46.822 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:46.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:46.908 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:46.904+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:47.002 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:47.002 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:47.009 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:47.004+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:47.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:47.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:47.110 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:47.104+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:47.158 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:47.159 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:47.175 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:47.175 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:47.177 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:47.177 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:47.177 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:47.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:47.192 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:47.192 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:47.209 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:47.210 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:47.208+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:47.230 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:47.230 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:47.252 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:47.252 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:47.272 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:47.273 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:47.293 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:47.293 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4385.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 140.750110444, 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020489864999999999, 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "reached pg", 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4385", 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/1398891693", 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556202+0000", 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556204+0000", 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2120000000000002e-06 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556217+0000", 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2904999999999999e-05 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556236+0000", 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8830000000000001e-05 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556251+0000", 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5342999999999999e-05 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556364+0000", 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011270299999999999 2024-09-10T05:57:47.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.556372+0000", 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2460000000000003e-06 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559551+0000", 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003178424 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:57:47.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.559564+0000", 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3057999999999999e-05 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576548+0000", 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016984558 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:26.576692+0000", 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014358599999999999 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.314 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2695 3.4 3:21ec6d67:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.714285658999998, 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013307572, 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2695 2024-09-10T05:57:47.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592027+0000", 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.592030+0000", 2024-09-10T05:57:47.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8650000000000001e-06 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594049+0000", 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002019449 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594078+0000", 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9376000000000001e-05 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594092+0000", 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3505e-05 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594168+0000", 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6063999999999995e-05 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594293+0000", 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012461899999999999 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.594406+0000", 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112983 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605086+0000", 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010680383999999999 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605259+0000", 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172659 2024-09-10T05:57:47.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605303+0000", 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4651000000000003e-05 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.605334+0000", 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1016999999999998e-05 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2717 3.25 3:a515f872:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.486341216, 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011604369, 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2717 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.323 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819971+0000", 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.819975+0000", 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.63e-06 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821866+0000", 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00189079 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821899+0000", 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3809000000000001e-05 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.821914+0000", 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5e-05 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822002+0000", 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7892999999999993e-05 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822154+0000", 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015216200000000001 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822295+0000", 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014084899999999999 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830948+0000", 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0086527919999999994 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831454+0000", 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00050560199999999996 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831520+0000", 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6017000000000002e-05 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831576+0000", 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5825000000000002e-05 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.328 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2730 3.19 3:99f0627c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.350945823000004, 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012565949999999999, 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2730 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955367+0000", 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.955370+0000", 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3620000000000002e-06 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957409+0000", 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0020391720000000001 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957452+0000", 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2895000000000002e-05 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957466+0000", 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4311000000000001e-05 2024-09-10T05:57:47.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957588+0000", 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000121663 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957792+0000", 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000203792 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.957975+0000", 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000183678 2024-09-10T05:57:47.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965498+0000", 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0075228700000000001 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967831+0000", 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023322590000000002 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967882+0000", 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1598000000000003e-05 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.967933+0000", 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0349999999999997e-05 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2731 3.4 3:2073ef40:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:47.334 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.341160969999997, 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013157917999999999, 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2731 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:47.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965151+0000", 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.965155+0000", 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5889999999999999e-06 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966586+0000", 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001430618 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966603+0000", 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7059999999999999e-05 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966614+0000", 2024-09-10T05:57:47.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1141999999999999e-05 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966689+0000", 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5574000000000005e-05 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966819+0000", 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129558 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.966944+0000", 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012527799999999999 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.975490+0000", 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0085459999999999998 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978216+0000", 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027259879999999999 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978268+0000", 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1493000000000003e-05 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.978309+0000", 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1618e-05 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2733 3.0 3:0296d83f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.319890442999998, 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012015477, 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2733 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.341 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986422+0000", 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.986425+0000", 2024-09-10T05:57:47.342 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2009999999999999e-06 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988599+0000", 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021740489999999999 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988621+0000", 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1922000000000001e-05 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.343 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988633+0000", 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1758e-05 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988727+0000", 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3867000000000001e-05 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.988922+0000", 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019508500000000001 2024-09-10T05:57:47.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.989099+0000", 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017668299999999999 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.996748+0000", 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007649159 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998318+0000", 2024-09-10T05:57:47.345 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015705090000000001 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998382+0000", 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4036999999999997e-05 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.998437+0000", 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5207000000000002e-05 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.346 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2756 3.1a e74/24 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.085919879999999, 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012940208, 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.347 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.220393+0000", 2024-09-10T05:57:47.348 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3200000000000001e-07 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226300+0000", 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059069400000000003 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226316+0000", 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6509000000000001e-05 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.349 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226325+0000", 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7439999999999996e-06 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226425+0000", 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100188 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226452+0000", 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7140000000000001e-05 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233268+0000", 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068155660000000003 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.233333+0000", 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4789000000000006e-05 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.351 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2776 3.31 3:8d95f7b7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.877879765000003, 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019117624, 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2776 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.352 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428433+0000", 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.428435+0000", 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6019999999999998e-06 2024-09-10T05:57:47.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429944+0000", 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001509095 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429973+0000", 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8558e-05 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.354 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.429986+0000", 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3591000000000001e-05 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430053+0000", 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6477999999999996e-05 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430167+0000", 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114243 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:47.355 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.430257+0000", 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9386000000000001e-05 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.434734+0000", 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044769909999999996 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447370+0000", 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012636214 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.356 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447476+0000", 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105844 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.447550+0000", 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4622000000000005e-05 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2782 3.25 3:a5d3e292:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:47.357 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.803866872999997, 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012424736, 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2782 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502446+0000", 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.502448+0000", 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.717e-06 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505248+0000", 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0027999470000000001 2024-09-10T05:57:47.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505285+0000", 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.68e-05 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505304+0000", 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9423999999999999e-05 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505417+0000", 2024-09-10T05:57:47.360 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00011298000000000001 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505608+0000", 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019085900000000001 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.505785+0000", 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176832 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.361 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.511556+0000", 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057704219999999999 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514735+0000", 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031793749999999999 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514811+0000", 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6129000000000002e-05 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.362 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.514870+0000", 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9250999999999999e-05 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2783 3.3e 3:7c6034eb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 45.792785260999999, 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013503764, 2024-09-10T05:57:47.363 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2783 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513527+0000", 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.513531+0000", 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1520000000000002e-06 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516867+0000", 2024-09-10T05:57:47.365 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033353800000000002 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516900+0000", 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3414999999999998e-05 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516917+0000", 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6867999999999998e-05 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.366 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.516998+0000", 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0851000000000002e-05 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517142+0000", 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000144671 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.517248+0000", 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105319 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.367 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526098+0000", 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088501629999999994 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526838+0000", 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00074033699999999998 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.368 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526948+0000", 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000109647 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.527031+0000", 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2960999999999994e-05 2024-09-10T05:57:47.369 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2997 3.4 3:2257915f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.237587716, 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015853236, 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.370 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2997 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068725+0000", 2024-09-10T05:57:47.371 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.068729+0000", 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9790000000000004e-06 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071067+0000", 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002338363 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.372 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071102+0000", 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4694999999999999e-05 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071116+0000", 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4212e-05 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071192+0000", 2024-09-10T05:57:47.373 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6440000000000007e-05 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071318+0000", 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012571699999999999 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.071411+0000", 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2799000000000004e-05 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.374 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079634+0000", 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082235420000000004 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084461+0000", 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048270240000000001 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084527+0000", 2024-09-10T05:57:47.375 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5273999999999999e-05 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.084578+0000", 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1190999999999998e-05 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2998 3.0 3:00581a26:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:47.376 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.227216061, 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011652958, 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2998 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.377 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079096+0000", 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.079099+0000", 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.588e-06 2024-09-10T05:57:47.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081434+0000", 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002335213 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081462+0000", 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8107999999999999e-05 2024-09-10T05:57:47.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081479+0000", 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6809000000000001e-05 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081564+0000", 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5258000000000003e-05 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081694+0000", 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129214 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.081846+0000", 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000152881 2024-09-10T05:57:47.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.087780+0000", 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059333980000000003 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090625+0000", 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028450480000000002 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090689+0000", 2024-09-10T05:57:47.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3739999999999996e-05 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.090749+0000", 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0701e-05 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3009 3.33 e91/90 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head v 91'7, mlcod=0'0)", 2024-09-10T05:57:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.390603032, 2024-09-10T05:57:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021229792000000001, 2024-09-10T05:57:47.384 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915709+0000", 2024-09-10T05:57:47.385 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915710+0000", 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7900000000000007e-07 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925190+0000", 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0094797909999999996 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.386 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925205+0000", 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4749999999999999e-05 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925214+0000", 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1889999999999996e-06 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925307+0000", 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3121000000000005e-05 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.387 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925347+0000", 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0170000000000003e-05 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936873+0000", 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011525409 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.388 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936939+0000", 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6383000000000005e-05 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3016 3.4 3:22f6155f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.375324664000001, 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015593559999999999, 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3016 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930988+0000", 2024-09-10T05:57:47.390 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930990+0000", 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3769999999999999e-06 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.933999+0000", 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003008911 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.391 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934019+0000", 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0258000000000002e-05 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934033+0000", 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3723999999999999e-05 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.392 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934110+0000", 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6977999999999994e-05 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934265+0000", 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155305 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.934413+0000", 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014791199999999999 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.943327+0000", 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089134539999999995 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946445+0000", 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0031179100000000002 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946529+0000", 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4636999999999996e-05 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.946581+0000", 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2094e-05 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3029 3.29 e91/90 3:94a1ebfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_31:head v 91'4, mlcod=0'0)", 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.221224593000001, 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012013543999999999, 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085088+0000", 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.085089+0000", 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.621e-06 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.397 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091607+0000", 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065175650000000003 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091635+0000", 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8127999999999999e-05 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.398 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091650+0000", 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4543e-05 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091768+0000", 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000117859 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.091809+0000", 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1304999999999998e-05 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.399 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097031+0000", 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052216909999999997 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.097101+0000", 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0832000000000002e-05 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.400 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3039 3.3e 3:7c01ab0e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.12034323, 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011728011, 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3039 2024-09-10T05:57:47.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185969+0000", 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.402 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.185972+0000", 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188219+0000", 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002246783 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188237+0000", 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7798000000000001e-05 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188247+0000", 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0543000000000001e-05 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.188918+0000", 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00067044700000000001 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.189263+0000", 2024-09-10T05:57:47.404 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00034507500000000003 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.189430+0000", 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016748699999999999 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197213+0000", 2024-09-10T05:57:47.405 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0077831469999999998 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197564+0000", 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00035080199999999999 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197647+0000", 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2392999999999995e-05 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.406 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197697+0000", 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0531999999999997e-05 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3040 3.3e 3:7d5213dd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.110267798000001, 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013364289999999999, 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3040 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:47.408 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196045+0000", 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.196048+0000", 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1870000000000001e-06 2024-09-10T05:57:47.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199734+0000", 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0036858400000000001 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199758+0000", 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3978e-05 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.410 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199770+0000", 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2272999999999999e-05 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.199855+0000", 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5451000000000006e-05 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.200021+0000", 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016566500000000001 2024-09-10T05:57:47.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.200201+0000", 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018035999999999999 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209028+0000", 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088263330000000004 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.412 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209299+0000", 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027105299999999999 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209359+0000", 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0106999999999999e-05 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.209409+0000", 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0043000000000002e-05 2024-09-10T05:57:47.413 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3051 3.25 3:a5ff5638:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 11.973859308, 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013385912, 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.414 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3051 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332453+0000", 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.332456+0000", 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.469e-06 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334763+0000", 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023073899999999999 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.416 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334790+0000", 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6957999999999998e-05 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334803+0000", 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3205e-05 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.334878+0000", 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4840999999999997e-05 2024-09-10T05:57:47.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.335068+0000", 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019012400000000001 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.335279+0000", 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021051199999999999 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.418 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345755+0000", 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010476328 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345763+0000", 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1470000000000001e-06 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345804+0000", 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0652999999999999e-05 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.419 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345839+0000", 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5284999999999998e-05 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3248 3.31 3:8fb1b3a5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.4641236309999996, 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017678678, 2024-09-10T05:57:47.420 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3248 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:47.421 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842189+0000", 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.842192+0000", 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2660000000000002e-06 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.422 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843248+0000", 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0010555079999999999 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843280+0000", 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2869e-05 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843296+0000", 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5116000000000001e-05 2024-09-10T05:57:47.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843378+0000", 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2936999999999996e-05 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843589+0000", 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000210571 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:47.424 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.843713+0000", 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012438299999999999 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.848697+0000", 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049832549999999998 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859767+0000", 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01107059 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.425 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859833+0000", 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5338000000000004e-05 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.859867+0000", 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4845000000000003e-05 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.426 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3256 3.4 3:23355cdd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:57:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:47.427 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 9.3760681750000003, 2024-09-10T05:57:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015740632000000001, 2024-09-10T05:57:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3256 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.429 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930244+0000", 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.930247+0000", 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0589999999999998e-06 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.931973+0000", 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017261799999999999 2024-09-10T05:57:47.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.931998+0000", 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4671000000000001e-05 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932011+0000", 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2884000000000001e-05 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932095+0000", 2024-09-10T05:57:47.431 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4191999999999996e-05 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.932103+0000", 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5569999999999998e-06 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936309+0000", 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042062499999999999 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.432 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936474+0000", 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164895 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.936567+0000", 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2838999999999997e-05 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.944773+0000", 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082062230000000003 2024-09-10T05:57:47.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945871+0000", 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001097867 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945935+0000", 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4141999999999997e-05 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.434 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.945985+0000", 2024-09-10T05:57:47.435 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9873000000000002e-05 2024-09-10T05:57:47.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.435 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.435 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:47.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:47.438 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:47.434+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:47.537 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:47.534+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:47.611 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:47.611 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:47.611 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:47.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:47.639 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:47.636+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:47.740 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:47.738+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:47.794 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:47.794 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:47.794 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:47.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:47.841 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:47.836+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:47.942 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:47.940+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2716 3.3b e73/24 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head v 73'8, mlcod=73'5)", 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.153704642000001, 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012669998999999999, 2024-09-10T05:57:47.975 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.976 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818378+0000", 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.607e-06 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822721+0000", 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043427550000000002 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822741+0000", 2024-09-10T05:57:47.977 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0820000000000001e-05 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822750+0000", 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969999999999999e-06 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822826+0000", 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5488000000000006e-05 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.978 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822850+0000", 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4328000000000002e-05 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830980+0000", 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081304089999999999 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831046+0000", 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5895000000000005e-05 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2721 3.9 e73/24 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head v 73'5, mlcod=73'3)", 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.098099214000001, 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011236408, 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.980 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873983+0000", 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6729999999999999e-06 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.981 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878223+0000", 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042396789999999997 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878246+0000", 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3326e-05 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878304+0000", 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7794000000000003e-05 2024-09-10T05:57:47.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878368+0000", 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4005999999999997e-05 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878391+0000", 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2909e-05 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885156+0000", 2024-09-10T05:57:47.983 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067645680000000003 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885218+0000", 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2453000000000007e-05 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2725 3.21 3:856ed7cd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:47.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.066383872000003, 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018910211999999999, 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2725 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:47.985 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905702+0000", 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.986 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908098+0000", 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023965269999999999 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908124+0000", 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899000000000001e-05 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908139+0000", 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5026e-05 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.987 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908222+0000", 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908417+0000", 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195026 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908573+0000", 2024-09-10T05:57:47.988 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155849 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.913471+0000", 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048985469999999996 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924490+0000", 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011019167999999999 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924557+0000", 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6925e-05 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924607+0000", 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9932000000000002e-05 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.990 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2748 3.3b e74/24 3:deadbbb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_211:head v 74'10, mlcod=73'8)", 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.829603873000003, 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011669703999999999, 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.991 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142478+0000", 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999997e-07 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148304+0000", 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058267570000000001 2024-09-10T05:57:47.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148327+0000", 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2921e-05 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148338+0000", 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294999999999999e-05 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.993 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148403+0000", 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4332999999999995e-05 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148421+0000", 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7991000000000001e-05 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154104+0000", 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005683385 2024-09-10T05:57:47.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154147+0000", 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2446e-05 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2751 3.21 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.805503070999997, 2024-09-10T05:57:47.995 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019591372999999999, 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2751 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:47.996 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166581+0000", 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:47.997 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.167981+0000", 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00139999 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168020+0000", 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8980000000000003e-05 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168036+0000", 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6568000000000001e-05 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.998 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168113+0000", 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6417999999999999e-05 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168228+0000", 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115161 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168349+0000", 2024-09-10T05:57:47.999 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012086 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175149+0000", 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068000150000000004 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186073+0000", 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010924411 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.000 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186119+0000", 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5550999999999998e-05 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186169+0000", 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0603000000000003e-05 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2753 3.21 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.001 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.785532347999997, 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019351368000000001, 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2753 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.002 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186551+0000", 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5059999999999998e-06 2024-09-10T05:57:48.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.187974+0000", 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014233259999999999 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188000+0000", 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.004 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188011+0000", 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188082+0000", 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1061000000000003e-05 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188225+0000", 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014240499999999999 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.005 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188343+0000", 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118019 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192712+0000", 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043687309999999998 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205798+0000", 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013086191 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.006 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205849+0000", 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205900+0000", 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1174999999999997e-05 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.007 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2757 3.2e 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.748036734999999, 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021228316000000001, 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2757 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.008 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224047+0000", 2024-09-10T05:57:48.009 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.531e-06 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225876+0000", 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018291119999999999 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225905+0000", 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9615999999999999e-05 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.010 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225921+0000", 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5338000000000001e-05 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226002+0000", 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1521999999999996e-05 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226149+0000", 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147031 2024-09-10T05:57:48.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226249+0000", 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9671000000000002e-05 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.232949+0000", 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067004150000000004 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.012 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245149+0000", 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012199468 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245220+0000", 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0990999999999998e-05 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245272+0000", 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2621000000000003e-05 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.013 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3003 3.3b e90/24 3:de7cc7af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_7:head v 90'11, mlcod=73'9)", 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.809863522000001, 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013130332999999999, 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.014 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162219+0000", 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-10T05:57:48.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168244+0000", 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060244879999999997 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168303+0000", 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8974999999999997e-05 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.016 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168321+0000", 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168405+0000", 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189999999999995e-05 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168431+0000", 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6271e-05 2024-09-10T05:57:48.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175260+0000", 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068292320000000002 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175348+0000", 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7458000000000002e-05 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3008 3.9 e90/24 3:905d4b1a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_12:head v 90'6, mlcod=73'4)", 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.755142422, 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011104477, 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216940+0000", 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.020 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222832+0000", 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058914040000000003 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222856+0000", 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4006999999999999e-05 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222867+0000", 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1191e-05 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222943+0000", 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.64e-05 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222967+0000", 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-05 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.227972+0000", 2024-09-10T05:57:48.022 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050046989999999996 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.228043+0000", 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1073000000000002e-05 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3015 3.3d e91/24 3:bd148ba2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_17:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:48.023 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.0490979, 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013567879, 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.024 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922984+0000", 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.051e-06 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924550+0000", 2024-09-10T05:57:48.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001566226 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924566+0000", 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5722999999999998e-05 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924577+0000", 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0634e-05 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.026 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925330+0000", 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075334999999999996 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925375+0000", 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4631e-05 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936507+0000", 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011132856 2024-09-10T05:57:48.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936551+0000", 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3408000000000002e-05 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3017 3.3b e91/24 3:dd236608:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_19:head v 91'12, mlcod=74'10)", 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.027388220000001, 2024-09-10T05:57:48.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014972480999999999, 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-07 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950568+0000", 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058748680000000001 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950590+0000", 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2096e-05 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950600+0000", 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0291e-05 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950677+0000", 2024-09-10T05:57:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6171e-05 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950702+0000", 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5633999999999999e-05 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959561+0000", 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088584089999999994 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959665+0000", 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104448 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3019 3.1f 3:fa47017c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 13.013219274000001, 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021984574999999999, 2024-09-10T05:57:48.033 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3019 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958865+0000", 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961571+0000", 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002706052 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961590+0000", 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9028000000000001e-05 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961602+0000", 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2342e-05 2024-09-10T05:57:48.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961725+0000", 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012271 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961895+0000", 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017041300000000001 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:48.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961998+0000", 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102068 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.968323+0000", 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063252869999999997 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980751+0000", 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012427745 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.038 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980800+0000", 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9048999999999997e-05 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980846+0000", 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6517999999999997e-05 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3023 3.3b e91/24 3:de37cb64:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_25:head v 91'13, mlcod=90'11)", 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:48.039 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.963607489999999, 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011245872000000001, 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008474+0000", 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9599999999999998e-07 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014097+0000", 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056226690000000003 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014109+0000", 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2156e-05 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014116+0000", 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0230000000000004e-06 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014169+0000", 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2777e-05 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014190+0000", 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0812e-05 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019638+0000", 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054488619999999996 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019719+0000", 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0777000000000003e-05 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3034 3.21 3:85b134c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:48.044 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.836988824000001, 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013922285, 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3034 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135095+0000", 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6120000000000001e-06 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.136970+0000", 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001875551 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137000+0000", 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9634000000000001e-05 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137015+0000", 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4999e-05 2024-09-10T05:57:48.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137102+0000", 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7155000000000002e-05 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137278+0000", 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176193 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137441+0000", 2024-09-10T05:57:48.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016302999999999999 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144714+0000", 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072732439999999999 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148890+0000", 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041755910000000002 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148964+0000", 2024-09-10T05:57:48.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4047000000000004e-05 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.149014+0000", 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0229000000000003e-05 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3038 3.9 e91/24 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head v 91'7, mlcod=73'5)", 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.798056284999999, 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023213424999999999, 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179953+0000", 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059275639999999997 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179968+0000", 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5121e-05 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179980+0000", 2024-09-10T05:57:48.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1773000000000001e-05 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180059+0000", 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180085+0000", 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6227000000000001e-05 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197005+0000", 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016919975 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197238+0000", 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023277500000000001 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3046 3.1e e91/90 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.696008040000001, 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018313788000000001, 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276074+0000", 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0219999999999999e-06 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287890+0000", 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181626 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287919+0000", 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8493e-05 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287931+0000", 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1990999999999999e-05 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288006+0000", 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5612999999999996e-05 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288030+0000", 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3998999999999998e-05 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294328+0000", 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062977299999999996 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294387+0000", 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8680000000000001e-05 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3052 3.21 3:84f20414:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.628374255000001, 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017826086000000001, 2024-09-10T05:57:48.060 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3052 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343709+0000", 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345869+0000", 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002160159 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345883+0000", 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345891+0000", 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4150000000000002e-06 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345960+0000", 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8885000000000002e-05 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346142+0000", 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000182039 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346292+0000", 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150865 2024-09-10T05:57:48.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.353142+0000", 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068494100000000002 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361408+0000", 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008266219 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361474+0000", 2024-09-10T05:57:48.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6347999999999996e-05 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361533+0000", 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8223000000000001e-05 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3249 3.2e 3:747b1d17:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:48.066 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.121332826, 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017772942999999999, 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3249 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850750+0000", 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4530000000000001e-06 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852297+0000", 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546609 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852318+0000", 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0525000000000001e-05 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852332+0000", 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4705000000000001e-05 2024-09-10T05:57:48.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852417+0000", 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5220000000000001e-05 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852595+0000", 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017759699999999999 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852756+0000", 2024-09-10T05:57:48.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016041699999999999 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.857792+0000", 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050367830000000004 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868397+0000", 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604255999999999 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868467+0000", 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0444000000000005e-05 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868521+0000", 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3934000000000002e-05 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3250 3.2d e93/24 3:b5d1db82:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_239:head v 93'8, mlcod=92'6)", 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:48.072 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.104672755999999, 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010751937, 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867411+0000", 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872662+0000", 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052508920000000001 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872689+0000", 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7007000000000001e-05 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872701+0000", 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2346e-05 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872802+0000", 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100962 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872836+0000", 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3674000000000003e-05 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878100+0000", 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052643380000000004 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878160+0000", 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9917000000000002e-05 2024-09-10T05:57:48.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3253 3.28 e93/90 3:17a9055b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_242:head v 93'7, mlcod=92'5)", 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 10.073675537, 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014804029999999999, 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898407+0000", 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8050000000000001e-06 2024-09-10T05:57:48.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903094+0000", 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046872809999999997 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903107+0000", 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2842e-05 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903118+0000", 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0557000000000001e-05 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903206+0000", 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8678999999999996e-05 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903230+0000", 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3632e-05 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913156+0000", 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099255690000000004 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913209+0000", 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3665000000000002e-05 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.081 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.082 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:48.082 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:57:48.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:48.084 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:48.080+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:48.184 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:48.182+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:48.269 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:48.269 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:48.269 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:48.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:48.286 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:48.280+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:48.387 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:48.380+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:48.454 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:48.454 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:48.454 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:48.454 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:48.454 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:48.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:48.512 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:48.510+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:48.589 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 134.958422646, 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:57:48.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:57:48.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.152900643999999, 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:48.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:57:48.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:57:48.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 48.184322498, 2024-09-10T05:57:48.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:57:48.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.605 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:57:48.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:48.607 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.921604621, 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:57:48.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:57:48.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:57:48.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:48.613 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.866305982, 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:48.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:57:48.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.836995014000003, 2024-09-10T05:57:48.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:57:48.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:57:48.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.815239839999997, 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:57:48.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:57:48.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:57:48.630 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.709660301, 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.631 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:48.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:57:48.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.698852424000002, 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:57:48.639 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.640 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:57:48.641 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.642 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:48.643 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.564482992999999, 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.644 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.645 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:57:48.646 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.647 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.479769638999997, 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.650 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.651 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:48.652 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.653 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.410248305000003, 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:57:48.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.656 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.657 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:57:48.658 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.659 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.660 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.314035453999999, 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.661 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:48.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.663 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:57:48.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.313889095999997, 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:57:48.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.667 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.668 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:57:48.669 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.670 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.671 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.297750606999998, 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:57:48.673 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.674 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.675 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.676 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.292909664, 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.678 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.679 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:57:48.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:57:48.681 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.181833275000002, 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:57:48.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.684 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:57:48.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.686 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:57:48.688 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.130069925999997, 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.689 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.690 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.691 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:57:48.692 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.693 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.104270223999997, 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.694 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:57:48.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.696 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.697 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:48.698 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.062269202000003, 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.699 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:57:48.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:48.701 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.702 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.703 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:48.704 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:48.705 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:48.705 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:48.586+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:48.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:48.749 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:48.746+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:48.808 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:48.804+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:48.837 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:48.837 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:48.837 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:48.838 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:48.852 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:48.909 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:48.906+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:48.991 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:57:49.010 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:49.004+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:49.019 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:49.019 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:49.019 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:49.033 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:49.123 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:49.120+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:49.202 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 140.64062580199999, 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:57:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:57:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.737079156, 2024-09-10T05:57:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:57:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2721 3.9 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.332299079999999, 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021537937, 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2721 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866311+0000", 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7260000000000002e-06 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872270+0000", 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059589939999999996 2024-09-10T05:57:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872300+0000", 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0023e-05 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872321+0000", 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1005999999999998e-05 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872492+0000", 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017168500000000001 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872729+0000", 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236357 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872962+0000", 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023289299999999999 2024-09-10T05:57:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883222+0000", 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010260607 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887676+0000", 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044541950000000002 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887772+0000", 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6089999999999996e-05 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887844+0000", 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1360999999999997e-05 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2727 3.1c e74/24 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.261664035999999, 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020405939000000001, 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936942+0000", 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6300000000000004e-07 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940348+0000", 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034059559999999999 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940389+0000", 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1173e-05 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940411+0000", 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2546000000000001e-05 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940673+0000", 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026151599999999999 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940736+0000", 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2707999999999997e-05 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957202+0000", 2024-09-10T05:57:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016466524999999999 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957347+0000", 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.261483534999996, 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:57:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.252488872999997, 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:57:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:57:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2743 3.34 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 48.112709922999997, 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020245447999999999, 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2743 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085897+0000", 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.243e-06 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091156+0000", 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052584149999999998 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091186+0000", 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0648999999999997e-05 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091206+0000", 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9415999999999998e-05 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091331+0000", 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012479 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091576+0000", 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024558300000000001 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091810+0000", 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023423000000000001 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.104889+0000", 2024-09-10T05:57:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013079084 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105976+0000", 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010860659999999999 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106070+0000", 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4810999999999997e-05 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106140+0000", 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0160999999999995e-05 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2755 3.11 e74/24 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head v 74'8, mlcod=73'6)", 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.986577324000002, 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021403122, 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212031+0000", 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218661+0000", 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066300990000000004 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218698+0000", 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7109e-05 2024-09-10T05:57:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218716+0000", 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7776000000000001e-05 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218848+0000", 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013285 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218898+0000", 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9561999999999997e-05 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233312+0000", 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014414009 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233431+0000", 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001187 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2756 3.1a 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.984525945000001, 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021135549, 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2756 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214082+0000", 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218251+0000", 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041687790000000001 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218292+0000", 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0602000000000002e-05 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218318+0000", 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5701999999999999e-05 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218474+0000", 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015660000000000001 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218952+0000", 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047828600000000002 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.219315+0000", 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036209600000000001 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233050+0000", 2024-09-10T05:57:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013735041999999999 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234930+0000", 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018799870000000001 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235091+0000", 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016182499999999999 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235215+0000", 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012318999999999999 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2758 3.14 3:2b3c5956:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.964531002999998, 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020489027999999999, 2024-09-10T05:57:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2758 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234084+0000", 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0288999999999999e-05 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239117+0000", 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050329579999999997 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239150+0000", 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2391999999999998e-05 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239168+0000", 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8122999999999999e-05 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239346+0000", 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017855200000000001 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239754+0000", 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040791800000000001 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.240162+0000", 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040800899999999998 2024-09-10T05:57:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249324+0000", 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091615710000000003 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254280+0000", 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049566990000000002 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254445+0000", 2024-09-10T05:57:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016484599999999999 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254563+0000", 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011767100000000001 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3001 3.13 e90/24 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head v 90'4, mlcod=72'2)", 2024-09-10T05:57:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.067179796, 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024776917999999998, 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131428+0000", 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.016e-06 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137163+0000", 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057351640000000001 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137204+0000", 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0836e-05 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137222+0000", 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137415+0000", 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019288399999999999 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137480+0000", 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4776000000000005e-05 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156077+0000", 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018596850000000002 2024-09-10T05:57:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156202+0000", 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012555500000000001 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3005 3.34 3:2febc67c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.023733255, 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024327333999999999, 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3005 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174875+0000", 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181125+0000", 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062498969999999999 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181161+0000", 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569999999999997e-05 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181179+0000", 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8088999999999999e-05 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181333+0000", 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015358799999999999 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181593+0000", 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025959699999999997 2024-09-10T05:57:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181822+0000", 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022906700000000001 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.193600+0000", 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01177797 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.198883+0000", 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052831070000000004 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199068+0000", 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184821 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199199+0000", 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013147199999999999 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3012 3.24 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.929658783000001, 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.645952105, 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3012 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268950+0000", 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273458+0000", 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045087410000000001 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273497+0000", 2024-09-10T05:57:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8822000000000002e-05 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273516+0000", 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9300000000000002e-05 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273651+0000", 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273672+0000", 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1676999999999999e-05 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.884862+0000", 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.61118961599999999 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885232+0000", 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037011500000000002 2024-09-10T05:57:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885644+0000", 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186100000000002 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.904417+0000", 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018772858999999999 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.910331+0000", 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059138699999999999 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914700+0000", 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043697279999999998 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914898+0000", 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198035 2024-09-10T05:57:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3020 3.14 3:2b6e0d00:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.231274421, 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033030490000000003, 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3020 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967333+0000", 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972079+0000", 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047458250000000004 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972114+0000", 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5197999999999997e-05 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972130+0000", 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6317999999999999e-05 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972256+0000", 2024-09-10T05:57:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012557599999999999 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972555+0000", 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029879599999999999 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972831+0000", 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027629999999999999 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.999160+0000", 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026329128 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000129+0000", 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096927000000000005 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000279+0000", 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014958300000000001 2024-09-10T05:57:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000361+0000", 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2225999999999995e-05 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3021 3.b e91/90 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head v 91'3, mlcod=0'0)", 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.219521793, 2024-09-10T05:57:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026046184999999999, 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979128+0000", 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5216000000000002e-05 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983799+0000", 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046708660000000001 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983819+0000", 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9996e-05 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983829+0000", 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173999999999999e-05 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983909+0000", 2024-09-10T05:57:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9677000000000003e-05 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983938+0000", 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8506000000000001e-05 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005057+0000", 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021119150999999999 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005129+0000", 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2599000000000001e-05 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3038 3.9 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.030289574999999, 2024-09-10T05:57:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029031866999999999, 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3038 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168317+0000", 2024-09-10T05:57:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172702+0000", 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043843019999999996 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172720+0000", 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8284999999999999e-05 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172733+0000", 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3047999999999999e-05 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172846+0000", 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113281 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173043+0000", 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019643300000000001 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173322+0000", 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027913500000000002 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.186287+0000", 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012965302 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197185+0000", 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010897831 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197278+0000", 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2906999999999997e-05 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197347+0000", 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9252999999999996e-05 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3041 3.b e91/90 3:d26ad16f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_42:head v 91'5, mlcod=0'0)", 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.982011901, 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023158884000000001, 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216594+0000", 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2780000000000001e-06 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221006+0000", 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044112989999999996 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221029+0000", 2024-09-10T05:57:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3334000000000001e-05 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221038+0000", 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0110000000000006e-06 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221160+0000", 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122402 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221234+0000", 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3503000000000004e-05 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239675+0000", 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018441117999999999 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239752+0000", 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939000000000003e-05 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3056 3.14 3:29c50966:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.811747511, 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023839230999999999, 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3056 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386860+0000", 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.638e-06 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392248+0000", 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053876490000000004 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392276+0000", 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8240000000000001e-05 2024-09-10T05:57:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392290+0000", 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4357e-05 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392397+0000", 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106897 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392568+0000", 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017104800000000001 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392731+0000", 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162922 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.406474+0000", 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013743155999999999 2024-09-10T05:57:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409945+0000", 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034706659999999999 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410581+0000", 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063596099999999999 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410697+0000", 2024-09-10T05:57:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115697 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3057 3.9 3:921e1a42:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.800311012, 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021138760999999999, 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3057 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398297+0000", 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7719999999999999e-06 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402394+0000", 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040974660000000001 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402419+0000", 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5062000000000002e-05 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402433+0000", 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3828999999999999e-05 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402576+0000", 2024-09-10T05:57:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000142757 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402962+0000", 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000385728 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.403424+0000", 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046260300000000002 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.416554+0000", 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013129494 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419210+0000", 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026561110000000001 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419324+0000", 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114721 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419433+0000", 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108218 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3059 3.34 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.776842658, 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026671028999999999, 2024-09-10T05:57:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3059 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421765+0000", 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2510000000000001e-06 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425935+0000", 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041702730000000004 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425960+0000", 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5041999999999998e-05 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425976+0000", 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426110+0000", 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013405700000000001 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426325+0000", 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000215131 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426519+0000", 2024-09-10T05:57:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000194246 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.436549+0000", 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010029688 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448235+0000", 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0116861 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448379+0000", 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143747 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448433+0000", 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4759000000000002e-05 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:49.319 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:49.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:49.321 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:49.316+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:49.422 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:49.416+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:49.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:49.489 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:49.490 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:49.504 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:49.523 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:49.518+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:49.592 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:49.593 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:49.609 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:49.609 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:49.624 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:49.622+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:49.626 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:49.644 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:49.645 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:49.666 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:49.666 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:49.673 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:49.674 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:49.686 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:49.686 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:49.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:49.705 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:49.705 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:49.722 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:49.735 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:49.732+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:49.805 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:49.805 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:49.819 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:49.863 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:49.860+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:49.929 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:49.926+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:49.986 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:49.986 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:50.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:50.047 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:50.044+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:50.125 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:50.125 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:50.129 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:50.126+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:50.140 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:50.230 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:50.226+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:50.301 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:50.302 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:50.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:50.331 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:50.326+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:50.432 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:50.428+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:50.435 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:50.435 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:50.449 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:50.535 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:50.532+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:50.617 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:50.617 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:50.632 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:50.679 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:50.676+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:50.735 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:50.734+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:50.800 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:50.801 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:50.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:50.860 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:50.858+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:50.937 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:50.932+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:50.948 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:50.948 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:50.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:51.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:57:51.038 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:51.036+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:51.136 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:51.136 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:51.138 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:51.132+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:51.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:51.239 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:51.236+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:51.269 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:51.269 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:51.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:51.340 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:51.336+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:51.405 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:51.406 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:51.416 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:57:51.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:51.484 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:51.482+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:51.542 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:51.536+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:51.550 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:51.550 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:51.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:51.643 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:51.636+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:51.734 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:51.735 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:51.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:51.743 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:51.740+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:51.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:51.844 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:51.840+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:51.883 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:51.883 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:51.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:51.901 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:51.913 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:51.913 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:51.917 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:51.917 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:51.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:51.934 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:51.935 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:51.945 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:51.942+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:51.955 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:51.956 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:51.977 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:51.977 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:51.998 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:51.999 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:52.018 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:52.019 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:52.043 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:52.043 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:52.043 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:52.046 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:52.040+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:52.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:52.147 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:52.142+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:52.223 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:52.223 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:52.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:52.223 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2716 3.3b e73/24 3:dd248735:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_179:head v 73'8, mlcod=73'5)", 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.401983850000001, 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012669998999999999, 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818376+0000", 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.818378+0000", 2024-09-10T05:57:52.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.607e-06 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822721+0000", 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043427550000000002 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822741+0000", 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0820000000000001e-05 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822750+0000", 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6969999999999999e-06 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822826+0000", 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5488000000000006e-05 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.822850+0000", 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4328000000000002e-05 2024-09-10T05:57:52.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.830980+0000", 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0081304089999999999 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.831046+0000", 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5895000000000005e-05 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2721 3.9 e73/24 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head v 73'5, mlcod=73'3)", 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.346378422000001, 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011236408, 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873982+0000", 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.873983+0000", 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6729999999999999e-06 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878223+0000", 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042396789999999997 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878246+0000", 2024-09-10T05:57:52.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3326e-05 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878304+0000", 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7794000000000003e-05 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878368+0000", 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4005999999999997e-05 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878391+0000", 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2909e-05 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885156+0000", 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067645680000000003 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885218+0000", 2024-09-10T05:57:52.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2453000000000007e-05 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2725 3.21 3:856ed7cd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.314663080000003, 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018910211999999999, 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.234 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2725 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:57:52.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905702+0000", 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908098+0000", 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023965269999999999 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908124+0000", 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899000000000001e-05 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908139+0000", 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5026e-05 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908222+0000", 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-10T05:57:52.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908417+0000", 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195026 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908573+0000", 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155849 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.913471+0000", 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048985469999999996 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924490+0000", 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011019167999999999 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924557+0000", 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6925e-05 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924607+0000", 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9932000000000002e-05 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2748 3.3b e74/24 3:deadbbb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_211:head v 74'10, mlcod=73'8)", 2024-09-10T05:57:52.240 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.077883081000003, 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011669703999999999, 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142477+0000", 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.142478+0000", 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7599999999999997e-07 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148304+0000", 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058267570000000001 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148327+0000", 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2921e-05 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148338+0000", 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1294999999999999e-05 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148403+0000", 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4332999999999995e-05 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.148421+0000", 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7991000000000001e-05 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154104+0000", 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005683385 2024-09-10T05:57:52.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.154147+0000", 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2446e-05 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2751 3.21 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.053782279000004, 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019591372999999999, 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2751 2024-09-10T05:57:52.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166581+0000", 2024-09-10T05:57:52.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.167981+0000", 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00139999 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168020+0000", 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8980000000000003e-05 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.248 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168036+0000", 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6568000000000001e-05 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168113+0000", 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6417999999999999e-05 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168228+0000", 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115161 2024-09-10T05:57:52.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168349+0000", 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012086 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175149+0000", 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068000150000000004 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186073+0000", 2024-09-10T05:57:52.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010924411 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186119+0000", 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5550999999999998e-05 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186169+0000", 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0603000000000003e-05 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2753 3.21 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.033811556000003, 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019351368000000001, 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2753 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186551+0000", 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5059999999999998e-06 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.187974+0000", 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014233259999999999 2024-09-10T05:57:52.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188000+0000", 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188011+0000", 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188082+0000", 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1061000000000003e-05 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188225+0000", 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014240499999999999 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188343+0000", 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118019 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192712+0000", 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043687309999999998 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205798+0000", 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013086191 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205849+0000", 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205900+0000", 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1174999999999997e-05 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2757 3.2e 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.258 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 50.996315942999999, 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021228316000000001, 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2757 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224047+0000", 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.531e-06 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225876+0000", 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018291119999999999 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225905+0000", 2024-09-10T05:57:52.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9615999999999999e-05 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225921+0000", 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5338000000000001e-05 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226002+0000", 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1521999999999996e-05 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226149+0000", 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147031 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226249+0000", 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9671000000000002e-05 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.232949+0000", 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067004150000000004 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245149+0000", 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012199468 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245220+0000", 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0990999999999998e-05 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245272+0000", 2024-09-10T05:57:52.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2621000000000003e-05 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3003 3.3b e90/24 3:de7cc7af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_7:head v 90'11, mlcod=73'9)", 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.05814273, 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013130332999999999, 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.265 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162217+0000", 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.162219+0000", 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0200000000000001e-06 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168244+0000", 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060244879999999997 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168303+0000", 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8974999999999997e-05 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168321+0000", 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8698999999999998e-05 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168405+0000", 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3189999999999995e-05 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.168431+0000", 2024-09-10T05:57:52.268 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6271e-05 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175260+0000", 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068292320000000002 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.175348+0000", 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7458000000000002e-05 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3008 3.9 e90/24 3:905d4b1a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_12:head v 90'6, mlcod=73'4)", 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 18.003421629999998, 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011104477, 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216938+0000", 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.216940+0000", 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.753e-06 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222832+0000", 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058914040000000003 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222856+0000", 2024-09-10T05:57:52.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4006999999999999e-05 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222867+0000", 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1191e-05 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222943+0000", 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.64e-05 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.222967+0000", 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-05 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.227972+0000", 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050046989999999996 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.228043+0000", 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1073000000000002e-05 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.274 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3015 3.3d e91/24 3:bd148ba2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_17:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.297377107999999, 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013567879, 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922983+0000", 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922984+0000", 2024-09-10T05:57:52.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.051e-06 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924550+0000", 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001566226 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924566+0000", 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5722999999999998e-05 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.924577+0000", 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0634e-05 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925330+0000", 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00075334999999999996 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.925375+0000", 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4631e-05 2024-09-10T05:57:52.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936507+0000", 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011132856 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936551+0000", 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3408000000000002e-05 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3017 3.3b e91/24 3:dd236608:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_19:head v 91'12, mlcod=74'10)", 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.275667427999998, 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014972480999999999, 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:52.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.944693+0000", 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6400000000000002e-07 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950568+0000", 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0058748680000000001 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950590+0000", 2024-09-10T05:57:52.282 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2096e-05 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950600+0000", 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0291e-05 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950677+0000", 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6171e-05 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.283 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.950702+0000", 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5633999999999999e-05 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959561+0000", 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0088584089999999994 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.959665+0000", 2024-09-10T05:57:52.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000104448 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3019 3.1f 3:fa47017c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.261498482, 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021984574999999999, 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3019 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958865+0000", 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961571+0000", 2024-09-10T05:57:52.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002706052 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961590+0000", 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9028000000000001e-05 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961602+0000", 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2342e-05 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.288 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961725+0000", 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012271 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961895+0000", 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017041300000000001 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961998+0000", 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102068 2024-09-10T05:57:52.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.968323+0000", 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063252869999999997 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980751+0000", 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012427745 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980800+0000", 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9048999999999997e-05 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980846+0000", 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6517999999999997e-05 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3023 3.3b e91/24 3:de37cb64:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_25:head v 91'13, mlcod=90'11)", 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.211886698000001, 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011245872000000001, 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.292 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008473+0000", 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.008474+0000", 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9599999999999998e-07 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014097+0000", 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0056226690000000003 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014109+0000", 2024-09-10T05:57:52.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2156e-05 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014116+0000", 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0230000000000004e-06 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014169+0000", 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2777e-05 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.014190+0000", 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0812e-05 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019638+0000", 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054488619999999996 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.019719+0000", 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0777000000000003e-05 2024-09-10T05:57:52.296 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3034 3.21 3:85b134c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.085268031999998, 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013922285, 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.297 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3034 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135092+0000", 2024-09-10T05:57:52.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.135095+0000", 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6120000000000001e-06 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.136970+0000", 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001875551 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137000+0000", 2024-09-10T05:57:52.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9634000000000001e-05 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137015+0000", 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4999e-05 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137102+0000", 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7155000000000002e-05 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.300 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137278+0000", 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176193 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.137441+0000", 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016302999999999999 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144714+0000", 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072732439999999999 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148890+0000", 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0041755910000000002 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.148964+0000", 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4047000000000004e-05 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.149014+0000", 2024-09-10T05:57:52.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0229000000000003e-05 2024-09-10T05:57:52.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.303 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3038 3.9 e91/24 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head v 91'7, mlcod=73'5)", 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 17.046335493000001, 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023213424999999999, 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179953+0000", 2024-09-10T05:57:52.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059275639999999997 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179968+0000", 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5121e-05 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179980+0000", 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1773000000000001e-05 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180059+0000", 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180085+0000", 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6227000000000001e-05 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197005+0000", 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016919975 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197238+0000", 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023277500000000001 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3046 3.1e e91/90 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head v 91'6, mlcod=73'4)", 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.944287247999998, 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018313788000000001, 2024-09-10T05:57:52.308 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:57:52.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276074+0000", 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0219999999999999e-06 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287890+0000", 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181626 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287919+0000", 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8493e-05 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287931+0000", 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1990999999999999e-05 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288006+0000", 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5612999999999996e-05 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.311 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288030+0000", 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3998999999999998e-05 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294328+0000", 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062977299999999996 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294387+0000", 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8680000000000001e-05 2024-09-10T05:57:52.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3052 3.21 3:84f20414:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 16.876653463, 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017826086000000001, 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.313 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3052 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:57:52.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343709+0000", 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345869+0000", 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002160159 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345883+0000", 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345891+0000", 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4150000000000002e-06 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345960+0000", 2024-09-10T05:57:52.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8885000000000002e-05 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346142+0000", 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000182039 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346292+0000", 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150865 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.353142+0000", 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068494100000000002 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361408+0000", 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008266219 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361474+0000", 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6347999999999996e-05 2024-09-10T05:57:52.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361533+0000", 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8223000000000001e-05 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3249 3.2e 3:747b1d17:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.369612033999999, 2024-09-10T05:57:52.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017772942999999999, 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3249 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:52.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850750+0000", 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4530000000000001e-06 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852297+0000", 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546609 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852318+0000", 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0525000000000001e-05 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852332+0000", 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4705000000000001e-05 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852417+0000", 2024-09-10T05:57:52.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5220000000000001e-05 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852595+0000", 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017759699999999999 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852756+0000", 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016041699999999999 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.857792+0000", 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050367830000000004 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868397+0000", 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604255999999999 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868467+0000", 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0444000000000005e-05 2024-09-10T05:57:52.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868521+0000", 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3934000000000002e-05 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3250 3.2d e93/24 3:b5d1db82:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_239:head v 93'8, mlcod=92'6)", 2024-09-10T05:57:52.325 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.352951964000001, 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010751937, 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867408+0000", 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.867411+0000", 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8009999999999999e-06 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872662+0000", 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052508920000000001 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872689+0000", 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7007000000000001e-05 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872701+0000", 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2346e-05 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872802+0000", 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000100962 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.872836+0000", 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3674000000000003e-05 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878100+0000", 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0052643380000000004 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.878160+0000", 2024-09-10T05:57:52.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.9917000000000002e-05 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3253 3.28 e93/90 3:17a9055b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_242:head v 93'7, mlcod=92'5)", 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 14.321954744999999, 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014804029999999999, 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898405+0000", 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.898407+0000", 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8050000000000001e-06 2024-09-10T05:57:52.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903094+0000", 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046872809999999997 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903107+0000", 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2842e-05 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903118+0000", 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0557000000000001e-05 2024-09-10T05:57:52.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903206+0000", 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.8678999999999996e-05 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.903230+0000", 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3632e-05 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913156+0000", 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0099255690000000004 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.913209+0000", 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3665000000000002e-05 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.334 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:52.336 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:52.336 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records in 2024-09-10T05:57:52.336 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records out 2024-09-10T05:57:52.336 INFO:tasks.workunit.client.0.smithi070.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.6946 s, 153 MB/s 2024-09-10T05:57:52.337 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:52.332+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:52.437 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:52.432+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:52.481 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_57_52 2024-09-10T05:57:52.502 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:52.502 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:52.503 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:52.503 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:52.517 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:52.537 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:52.532+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:52.634 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:52.634 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:52.634 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:52.634 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:52.636 INFO:tasks.workunit.client.0.smithi070.stdout:quota set for the bucket: buck_2024_08_10_05_57_52 2024-09-10T05:57:52.638 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:52.632+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:52.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:52.739 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:52.736+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:52.765 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:52.765 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 139.13657420000001, 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.766 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.767 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.769 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:57:52.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.771 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.772 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.331052197999995, 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:57:52.773 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.775 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.776 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.777 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.362474052000003, 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.779 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.780 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.781 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:57:52.782 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.783 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.784 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.099756175000003, 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.785 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.786 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.787 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:57:52.788 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:57:52.790 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.044457536000003, 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.791 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.792 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:57:52.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.794 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:57:52.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.015146567999999, 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.796 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.797 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:57:52.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.799 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:57:52.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:57:52.801 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:52.802 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.993391394, 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.803 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.804 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:57:52.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.806 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:57:52.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.808 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.887811855000002, 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.810 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:57:52.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:57:52.812 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.813 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:57:52.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.877003977999998, 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:57:52.818 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.819 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:57:52.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.821 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.742634547000002, 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:57:52.824 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:57:52.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.826 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.657921193, 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.829 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:57:52.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:57:52.831 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.832 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.833 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.588399858999999, 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.834 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:52.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.836 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:57:52.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.838 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.492187008000002, 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.840 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.841 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.842 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:57:52.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.49204065, 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:57:52.845 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.846 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:57:52.847 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.848 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:57:52.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.850 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:57:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:57:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.852 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.853 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.475902161, 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:52.854 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.855 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:57:52.856 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.857 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.471061218000003, 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:57:52.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.860 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.861 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.862 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:57:52.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.864 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.359984828999998, 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.866 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.867 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:57:52.868 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.869 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:57:52.870 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:52.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.30822148, 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.872 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:57:52.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.874 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.875 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.282421778, 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:57:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:57:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.879 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.880 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.240420755999999, 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:52.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.882 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.883 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:57:52.884 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.885 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:57:52.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:52.887 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:52.887 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:52.888 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:52.889 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:52.884+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:52.990 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:52.984+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:53.020 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:53.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:53.020 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:53.021 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:53.034 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:53.123 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:53.120+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:53.192 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:53.188+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:53.200 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:53.200 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:53.201 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:53.201 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:53.201 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:53.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:53.293 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:53.290+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:53.384 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:53.384 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:53.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:53.384 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:53.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 144.82438903600001, 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:57:53.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:57:53.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:57:53.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 65.920842390000004, 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:57:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:57:53.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:57:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:57:53.394 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2721 3.9 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.516062314000003, 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021537937, 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.395 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2721 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866311+0000", 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7260000000000002e-06 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872270+0000", 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059589939999999996 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872300+0000", 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0023e-05 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872321+0000", 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1005999999999998e-05 2024-09-10T05:57:53.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872492+0000", 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017168500000000001 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872729+0000", 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236357 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872962+0000", 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023289299999999999 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883222+0000", 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010260607 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887676+0000", 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044541950000000002 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887772+0000", 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6089999999999996e-05 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887844+0000", 2024-09-10T05:57:53.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1360999999999997e-05 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2727 3.1c e74/24 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.445427270000003, 2024-09-10T05:57:53.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020405939000000001, 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936941+0000", 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936942+0000", 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6300000000000004e-07 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940348+0000", 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034059559999999999 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940389+0000", 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1173e-05 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940411+0000", 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2546000000000001e-05 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940673+0000", 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026151599999999999 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.940736+0000", 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2707999999999997e-05 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957202+0000", 2024-09-10T05:57:53.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016466524999999999 2024-09-10T05:57:53.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957347+0000", 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000144752 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.445246769000001, 2024-09-10T05:57:53.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:57:53.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:57:53.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.436252107000001, 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.415 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2743 3.34 3:2f05d0b8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.296473157000001, 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020245447999999999, 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.421 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2743 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085895+0000", 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.085897+0000", 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.243e-06 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091156+0000", 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052584149999999998 2024-09-10T05:57:53.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091186+0000", 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0648999999999997e-05 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091206+0000", 2024-09-10T05:57:53.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9415999999999998e-05 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091331+0000", 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012479 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091576+0000", 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024558300000000001 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.091810+0000", 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023423000000000001 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.104889+0000", 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013079084 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.105976+0000", 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010860659999999999 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106070+0000", 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4810999999999997e-05 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.106140+0000", 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0160999999999995e-05 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.427 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2755 3.11 e74/24 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head v 74'8, mlcod=73'6)", 2024-09-10T05:57:53.428 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:53.428 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.170340557999999, 2024-09-10T05:57:53.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021403122, 2024-09-10T05:57:53.428 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.428 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.428 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212031+0000", 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218661+0000", 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066300990000000004 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218698+0000", 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7109e-05 2024-09-10T05:57:53.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218716+0000", 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7776000000000001e-05 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218848+0000", 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013285 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218898+0000", 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9561999999999997e-05 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233312+0000", 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014414009 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233431+0000", 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001187 2024-09-10T05:57:53.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2756 3.1a 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.168289178999999, 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021135549, 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.433 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2756 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:53.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214082+0000", 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218251+0000", 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041687790000000001 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218292+0000", 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0602000000000002e-05 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218318+0000", 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5701999999999999e-05 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218474+0000", 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015660000000000001 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218952+0000", 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047828600000000002 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.219315+0000", 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036209600000000001 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233050+0000", 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013735041999999999 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234930+0000", 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018799870000000001 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235091+0000", 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016182499999999999 2024-09-10T05:57:53.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235215+0000", 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012318999999999999 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2758 3.14 3:2b3c5956:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:53.440 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.148294237000002, 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020489027999999999, 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2758 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234074+0000", 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234084+0000", 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0288999999999999e-05 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239117+0000", 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050329579999999997 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239150+0000", 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2391999999999998e-05 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239168+0000", 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8122999999999999e-05 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239346+0000", 2024-09-10T05:57:53.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017855200000000001 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.239754+0000", 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040791800000000001 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.240162+0000", 2024-09-10T05:57:53.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040800899999999998 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.249324+0000", 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091615710000000003 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254280+0000", 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049566990000000002 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254445+0000", 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016484599999999999 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.254563+0000", 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011767100000000001 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3001 3.13 e90/24 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head v 90'4, mlcod=72'2)", 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.250943029999998, 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024776917999999998, 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131428+0000", 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.016e-06 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137163+0000", 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057351640000000001 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137204+0000", 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0836e-05 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137222+0000", 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137415+0000", 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019288399999999999 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137480+0000", 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4776000000000005e-05 2024-09-10T05:57:53.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156077+0000", 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018596850000000002 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156202+0000", 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012555500000000001 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3005 3.34 3:2febc67c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.207496489, 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024327333999999999, 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3005 2024-09-10T05:57:53.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174875+0000", 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181125+0000", 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062498969999999999 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181161+0000", 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569999999999997e-05 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181179+0000", 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8088999999999999e-05 2024-09-10T05:57:53.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181333+0000", 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015358799999999999 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181593+0000", 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025959699999999997 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181822+0000", 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022906700000000001 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.193600+0000", 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01177797 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.198883+0000", 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052831070000000004 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199068+0000", 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184821 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199199+0000", 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013147199999999999 2024-09-10T05:57:53.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3012 3.24 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.113422017000001, 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.645952105, 2024-09-10T05:57:53.460 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3012 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:53.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268950+0000", 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:57:53.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273458+0000", 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045087410000000001 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273497+0000", 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8822000000000002e-05 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273516+0000", 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9300000000000002e-05 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273651+0000", 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:53.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273672+0000", 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1676999999999999e-05 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.884862+0000", 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.61118961599999999 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885232+0000", 2024-09-10T05:57:53.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037011500000000002 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885644+0000", 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186100000000002 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.904417+0000", 2024-09-10T05:57:53.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018772858999999999 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.910331+0000", 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059138699999999999 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914700+0000", 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043697279999999998 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914898+0000", 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198035 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3020 3.14 3:2b6e0d00:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.415037654999999, 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033030490000000003, 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.468 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3020 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:53.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967333+0000", 2024-09-10T05:57:53.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:53.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972079+0000", 2024-09-10T05:57:53.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047458250000000004 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972114+0000", 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5197999999999997e-05 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972130+0000", 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6317999999999999e-05 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972256+0000", 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012557599999999999 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972555+0000", 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029879599999999999 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972831+0000", 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027629999999999999 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.999160+0000", 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026329128 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000129+0000", 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096927000000000005 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000279+0000", 2024-09-10T05:57:53.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014958300000000001 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000361+0000", 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2225999999999995e-05 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3021 3.b e91/90 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head v 91'3, mlcod=0'0)", 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:53.476 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.403285026999999, 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026046184999999999, 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979128+0000", 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5216000000000002e-05 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983799+0000", 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046708660000000001 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983819+0000", 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9996e-05 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983829+0000", 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173999999999999e-05 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983909+0000", 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9677000000000003e-05 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983938+0000", 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8506000000000001e-05 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005057+0000", 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021119150999999999 2024-09-10T05:57:53.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005129+0000", 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2599000000000001e-05 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3038 3.9 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.214052809000002, 2024-09-10T05:57:53.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029031866999999999, 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3038 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:53.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168317+0000", 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172702+0000", 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043843019999999996 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172720+0000", 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8284999999999999e-05 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172733+0000", 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3047999999999999e-05 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172846+0000", 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113281 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173043+0000", 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019643300000000001 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173322+0000", 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027913500000000002 2024-09-10T05:57:53.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.186287+0000", 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012965302 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197185+0000", 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010897831 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197278+0000", 2024-09-10T05:57:53.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2906999999999997e-05 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197347+0000", 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9252999999999996e-05 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3041 3.b e91/90 3:d26ad16f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_42:head v 91'5, mlcod=0'0)", 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.165775135000001, 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023158884000000001, 2024-09-10T05:57:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216594+0000", 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2780000000000001e-06 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221006+0000", 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044112989999999996 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221029+0000", 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3334000000000001e-05 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221038+0000", 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0110000000000006e-06 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221160+0000", 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122402 2024-09-10T05:57:53.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221234+0000", 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3503000000000004e-05 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239675+0000", 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018441117999999999 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239752+0000", 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939000000000003e-05 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3056 3.14 3:29c50966:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.995510745000001, 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023839230999999999, 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.492 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3056 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386860+0000", 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.638e-06 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392248+0000", 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053876490000000004 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392276+0000", 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8240000000000001e-05 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392290+0000", 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4357e-05 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392397+0000", 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106897 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392568+0000", 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017104800000000001 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392731+0000", 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162922 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.406474+0000", 2024-09-10T05:57:53.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013743155999999999 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409945+0000", 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034706659999999999 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410581+0000", 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063596099999999999 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410697+0000", 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115697 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3057 3.9 3:921e1a42:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.984074245999999, 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021138760999999999, 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.498 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3057 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398297+0000", 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7719999999999999e-06 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402394+0000", 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040974660000000001 2024-09-10T05:57:53.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402419+0000", 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5062000000000002e-05 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402433+0000", 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3828999999999999e-05 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402576+0000", 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000142757 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402962+0000", 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000385728 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.403424+0000", 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046260300000000002 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.416554+0000", 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013129494 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419210+0000", 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026561110000000001 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419324+0000", 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114721 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419433+0000", 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108218 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3059 3.34 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:53.504 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.960605892, 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026671028999999999, 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3059 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:53.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421765+0000", 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2510000000000001e-06 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425935+0000", 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041702730000000004 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425960+0000", 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5041999999999998e-05 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425976+0000", 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426110+0000", 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013405700000000001 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426325+0000", 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000215131 2024-09-10T05:57:53.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426519+0000", 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000194246 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.436549+0000", 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010029688 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448235+0000", 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0116861 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448379+0000", 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143747 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448433+0000", 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4759000000000002e-05 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.510 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.511 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.511 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.511 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:53.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:57:53.512 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:53.510+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:53.513 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:53.613 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:53.610+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:53.641 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:53.641 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:53.641 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:53.655 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:53.714 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:53.708+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:53.778 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:53.779 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:53.779 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:53.779 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:53.779 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:53.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:53.815 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:53.810+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:53.916 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:53.912+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:53.963 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.397174371999995, 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:57:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:57:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.370363584000003, 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:57:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:57:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.538518791000001, 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:57:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:57:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2704 3.16 3:6b2c0ee3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.276511665999998, 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022182810000000001, 2024-09-10T05:57:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2704 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682886+0000", 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4429999999999996e-06 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686829+0000", 2024-09-10T05:57:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039425720000000001 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686867+0000", 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8466000000000001e-05 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686887+0000", 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9629000000000001e-05 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687049+0000", 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161619 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687342+0000", 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029348500000000001 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687579+0000", 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023733000000000001 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.696533+0000", 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089536040000000004 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704753+0000", 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082205669999999998 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704929+0000", 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017553499999999999 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.705065+0000", 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013556000000000001 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2706 3.1d 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.255811897999997, 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024374384999999998, 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2706 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703585+0000", 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.287e-06 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709069+0000", 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005484432 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709101+0000", 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2063000000000001e-05 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709117+0000", 2024-09-10T05:57:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709221+0000", 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103867 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709490+0000", 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269053 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709739+0000", 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024859600000000002 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.724317+0000", 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014578512 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727648+0000", 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033310420000000002 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727824+0000", 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017585100000000001 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727956+0000", 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013196 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2708 3.2a 3:546514ef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.236376419000003, 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021062501000000001, 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2708 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723020+0000", 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6259999999999999e-06 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727965+0000", 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049453429999999996 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727991+0000", 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6083000000000001e-05 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728016+0000", 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728170+0000", 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015342900000000001 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728472+0000", 2024-09-10T05:57:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030251099999999999 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728707+0000", 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023466700000000001 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739602+0000", 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010895083 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743763+0000", 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041615360000000004 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743947+0000", 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018321400000000001 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744080+0000", 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013281999999999999 2024-09-10T05:57:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2714 3.16 3:696d6af6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.169804724000002, 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018296902, 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2714 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789589+0000", 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.789592+0000", 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4199999999999999e-06 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793519+0000", 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039268360000000004 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793560+0000", 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1078000000000002e-05 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793578+0000", 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8386999999999999e-05 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793710+0000", 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013122899999999999 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.793970+0000", 2024-09-10T05:57:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025991600000000001 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.794207+0000", 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023692299999999999 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.806549+0000", 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012342671 2024-09-10T05:57:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807674+0000", 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001124702 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807774+0000", 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9987000000000003e-05 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.807886+0000", 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111753 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.031744232000001, 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:57:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:57:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:57:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:57:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.952047090999997, 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:57:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:57:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2747 3.2a 3:56df8694:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.832765455000001, 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336575999999999, 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2747 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126632+0000", 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130540+0000", 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003907794 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130580+0000", 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0194000000000002e-05 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130602+0000", 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2169999999999999e-05 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130776+0000", 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174005 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131200+0000", 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042367199999999999 2024-09-10T05:57:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131649+0000", 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000449171 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.146739+0000", 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01508959 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150675+0000", 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003936419 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150810+0000", 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135162 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150965+0000", 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015443299999999999 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2749 3.16 3:6b50c908:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.813982011999997, 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020765693000000002, 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.028 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2749 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145411+0000", 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.145415+0000", 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6940000000000001e-06 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149511+0000", 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040962409999999996 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149539+0000", 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7231000000000001e-05 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149552+0000", 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3771000000000001e-05 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.149708+0000", 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155174 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150116+0000", 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040834600000000002 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150545+0000", 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000428641 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.158644+0000", 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080993990000000002 2024-09-10T05:57:54.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.165933+0000", 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072888739999999999 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166073+0000", 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013972499999999999 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.166177+0000", 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104597 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2751 3.21 e74/24 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head v 74'2, mlcod=0'0)", 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.791629037, 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017265005, 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167764+0000", 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.167766+0000", 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0590000000000001e-06 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172413+0000", 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046462359999999998 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172447+0000", 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4731999999999999e-05 2024-09-10T05:57:54.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172469+0000", 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1460000000000001e-05 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172598+0000", 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128646 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.172642+0000", 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4274999999999999e-05 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.184906+0000", 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012264353 2024-09-10T05:57:54.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.185029+0000", 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000123244 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.763696244000002, 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:57:54.039 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:57:54.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:57:54.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2761 3.3c 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.694548795999999, 2024-09-10T05:57:54.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018127095999999999, 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2761 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264845+0000", 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.264849+0000", 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3309999999999997e-06 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270094+0000", 2024-09-10T05:57:54.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005245464 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270134+0000", 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9926999999999999e-05 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270157+0000", 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2824999999999999e-05 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270325+0000", 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016784699999999999 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270580+0000", 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025531600000000001 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.270912+0000", 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033126999999999999 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.280570+0000", 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096586569999999993 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282695+0000", 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021244139999999998 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282853+0000", 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015866799999999999 2024-09-10T05:57:54.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.282972+0000", 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118377 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2763 3.28 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.678120014999998, 2024-09-10T05:57:54.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019948423, 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2763 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:54.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281273+0000", 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.281276+0000", 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0599999999999999e-06 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286026+0000", 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047498289999999997 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286074+0000", 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7994999999999997e-05 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286099+0000", 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.51e-05 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286290+0000", 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019037500000000001 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.286698+0000", 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000408651 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.287116+0000", 2024-09-10T05:57:54.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041778300000000002 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300422+0000", 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013306226000000001 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300973+0000", 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055055100000000004 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301131+0000", 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015752100000000001 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.301222+0000", 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1331999999999999e-05 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3002 3.36 e90/24 3:6ef358c6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_6:head v 90'7, mlcod=73'5)", 2024-09-10T05:57:54.057 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.141780+0000", 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.817613747999999, 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017970942, 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141780+0000", 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141780+0000", 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141784+0000", 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1099999999999996e-06 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.148193+0000", 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064091340000000004 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.148248+0000", 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4562999999999999e-05 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.148276+0000", 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8736000000000001e-05 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.148445+0000", 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016885500000000001 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.148519+0000", 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4102000000000003e-05 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.159664+0000", 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01114443 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.159751+0000", 2024-09-10T05:57:54.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7012e-05 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3011 3.16 3:6bc2b5f1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.245479+0000", 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.713914823, 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022462724999999999, 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.062 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3011 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.245479+0000", 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.245479+0000", 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.245484+0000", 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.887e-06 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252541+0000", 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070577790000000001 2024-09-10T05:57:54.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252580+0000", 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8593000000000001e-05 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252598+0000", 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8315999999999999e-05 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252775+0000", 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000176498 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.253052+0000", 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000277753 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.253298+0000", 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024548000000000001 2024-09-10T05:57:54.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.266781+0000", 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013482757999999999 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.267774+0000", 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00099374300000000006 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.267867+0000", 2024-09-10T05:57:54.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2752999999999998e-05 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.267941+0000", 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4165000000000006e-05 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3048 3.2a 3:576861d0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.293616+0000", 2024-09-10T05:57:54.068 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.665777548000001, 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020730518999999999, 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3048 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.293616+0000", 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.293616+0000", 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.293619+0000", 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2449999999999998e-06 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.298340+0000", 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047212579999999999 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.298369+0000", 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8133999999999999e-05 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.298381+0000", 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2384e-05 2024-09-10T05:57:54.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.298541+0000", 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016041800000000001 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.298745+0000", 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020391800000000001 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:54.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.298936+0000", 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019079200000000001 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.305835+0000", 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006899184 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.314225+0000", 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083898979999999998 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.314290+0000", 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5287e-05 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.314346+0000", 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6001000000000001e-05 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.074 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3058 3.3a 3:5e49e8fb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.409193+0000", 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.550200318999998, 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018784512999999999, 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3058 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409193+0000", 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409193+0000", 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409197+0000", 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.552e-06 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.413135+0000", 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039387650000000003 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.413157+0000", 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1718000000000001e-05 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.413173+0000", 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6206999999999999e-05 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.413341+0000", 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016777 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.413591+0000", 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000250251 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.413784+0000", 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019220000000000001 2024-09-10T05:57:54.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.424043+0000", 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010259211000000001 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.427706+0000", 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00366359 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.427864+0000", 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015731799999999999 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.427978+0000", 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113931 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.080 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3264 3.1c 3:3923a6c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.920850389, 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02663254, 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3264 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:54.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038547+0000", 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1860000000000002e-06 2024-09-10T05:57:54.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044703+0000", 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061553579999999997 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044742+0000", 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9156000000000003e-05 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044760+0000", 2024-09-10T05:57:54.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.863e-05 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044913+0000", 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153048 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.045181+0000", 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026741299999999998 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.046065+0000", 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088462999999999996 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.062104+0000", 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016038812999999999 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.064938+0000", 2024-09-10T05:57:54.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028335249999999999 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065088+0000", 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974500000000001 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065176+0000", 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8035999999999995e-05 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:54.087 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:54.087 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:54.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:54.089 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:54.089 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:54.084+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:54.189 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:54.186+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:54.242 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:54.242 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:54.257 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:54.261 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:54.261 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:54.261 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:54.261 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:54.273 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:54.273 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:54.275 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:54.303 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:54.304 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:54.319 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:54.316+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:54.336 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:54.336 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:54.368 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:54.391 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:54.386+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:54.397 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:54.397 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:54.401 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:54.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:54.492 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:54.490+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:54.578 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:54.578 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:54.592 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:54.593 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:54.588+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:54.693 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:54.688+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:54.758 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:54.759 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:54.762 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:57:54.775 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:54.824 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:54.822+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:54.895 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:54.892+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:54.940 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:54.941 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:54.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:54.999 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:54.996+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:55.097 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:55.094+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:55.121 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:55.121 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:55.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:55.198 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:55.194+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:55.258 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:55.258 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:55.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:55.316 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:55.314+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:55.400 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:55.396+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:55.434 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:55.434 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:55.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:57:55.501 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:55.498+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:55.566 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:55.566 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:55.580 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:57:55.624 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:55.622+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:55.703 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:55.700+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:55.736 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:55.736 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:55.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:57:55.804 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:55.800+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:55.864 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:55.864 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:55.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:57:55.924 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:55.922+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:56.002 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:56.003 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:56.005 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:56.000+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:56.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:57:56.106 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:56.102+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:56.181 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:56.181 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:56.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:57:56.236 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:56.234+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:56.308 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:56.304+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:56.350 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:56.351 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:56.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:57:56.409 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:56.408+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:56.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:57:56.489 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:56.489 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:56.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:57:56.548 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:56.546+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:56.555 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:56.555 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:56.574 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:56.591 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:56.591 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:56.608 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:56.608 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:56.610 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:56.606+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:56.626 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:56.626 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:57:56.626 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:56.630 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:56.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:57:56.655 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:56.656 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:56.685 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:56.685 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:56.712 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:56.715 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:56.708+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:56.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:57:56.797 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:56.797 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:57:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:57:56.798 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:57:56.798 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:56.811 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:56.806+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:56.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:57:56.913 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:56.908+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:57.013 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:57.008+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:57.025 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:57:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:57:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:57:57.025 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 143.396302257, 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:57:57.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.027 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:57:57.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:57:57.029 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.030 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:57:57.031 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 69.590780254999999, 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.033 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:57:57.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:57:57.035 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.036 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.037 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.622202109, 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.038 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.039 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:57:57.040 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.041 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.042 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:57:57.043 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.359484232, 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.044 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.046 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:57:57.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.048 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:57:57.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.304185593, 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:57:57.050 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:57:57.052 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.053 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:57:57.054 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.274874625000002, 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.055 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.056 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.057 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:57:57.058 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.059 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:57:57.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.253119451000003, 2024-09-10T05:57:57.061 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:57.062 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.063 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:57:57.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.065 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.067 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.147539911999999, 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.068 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:57:57.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:57:57.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.136732035000001, 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:57:57.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:57:57.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:57.080 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 56.002362603999998, 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.917649249999997, 2024-09-10T05:57:57.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:57.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:57:57.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:57:57.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.848127916000003, 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:57:57.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:57:57.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.097 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.751915064999999, 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:57:57.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.102 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.751768706999997, 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:57:57.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:57:57.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.108 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.735630217999997, 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:57.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:57:57.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.112 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.113 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.730789274999999, 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:57:57.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:57:57.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.619712886000002, 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.120 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:57:57.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:57:57.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:57.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.567949536999997, 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:57:57.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.542149835000004, 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:57:57.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 55.500148813000003, 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:57:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:57:57.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:57:57.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:57:57.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:57:57.142 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:57:57.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:57:57.144 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:57.140+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:57.244 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:57:57.240+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:57:57.287 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:57.288 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:57.288 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:57.288 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:57.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:57:57.347 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:57.344+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:57.447 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:57.440+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:57.483 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:57.483 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:57.483 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:57.483 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:57.484 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:57.504 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:57:57.548 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:57.546+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:57.649 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:57.646+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:57.670 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 149.10860361499999, 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:57:57.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:57:57.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1816 3.f e66/24 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.205056968999997, 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020649704000000001, 2024-09-10T05:57:57.676 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461526+0000", 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466481+0000", 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049548200000000004 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466529+0000", 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7518999999999997e-05 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466556+0000", 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7713e-05 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466728+0000", 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000171702 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.466797+0000", 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9363000000000007e-05 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482085+0000", 2024-09-10T05:57:57.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015287475999999999 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482176+0000", 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0614999999999999e-05 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2721 3.9 3:93422ee7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:57.681 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.800276893000003, 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021537937, 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2721 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866306+0000", 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.866311+0000", 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7260000000000002e-06 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872270+0000", 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059589939999999996 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872300+0000", 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0023e-05 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872321+0000", 2024-09-10T05:57:57.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1005999999999998e-05 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872492+0000", 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017168500000000001 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872729+0000", 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236357 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.872962+0000", 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023289299999999999 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.883222+0000", 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010260607 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887676+0000", 2024-09-10T05:57:57.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044541950000000002 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887772+0000", 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6089999999999996e-05 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.887844+0000", 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1360999999999997e-05 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.729461348000001, 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.688 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:57:57.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.720466686000002, 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:57:57.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:57:57.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.700 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2755 3.11 e74/24 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head v 74'8, mlcod=73'6)", 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.454555137, 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021403122, 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212028+0000", 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.212031+0000", 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218661+0000", 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066300990000000004 2024-09-10T05:57:57.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218698+0000", 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7109e-05 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218716+0000", 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7776000000000001e-05 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218848+0000", 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013285 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218898+0000", 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9561999999999997e-05 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233312+0000", 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014414009 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233431+0000", 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001187 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2756 3.1a 3:5a2d459d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 56.452503757999999, 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021135549, 2024-09-10T05:57:57.705 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2756 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214079+0000", 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.214082+0000", 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-06 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218251+0000", 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041687790000000001 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218292+0000", 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0602000000000002e-05 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218318+0000", 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5701999999999999e-05 2024-09-10T05:57:57.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218474+0000", 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015660000000000001 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.218952+0000", 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047828600000000002 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.219315+0000", 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036209600000000001 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.233050+0000", 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013735041999999999 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234930+0000", 2024-09-10T05:57:57.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018799870000000001 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235091+0000", 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016182499999999999 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.235215+0000", 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012318999999999999 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.711 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3001 3.13 e90/24 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head v 90'4, mlcod=72'2)", 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.535157608999999, 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024776917999999998, 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131428+0000", 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.016e-06 2024-09-10T05:57:57.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137163+0000", 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057351640000000001 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137204+0000", 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0836e-05 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137222+0000", 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137415+0000", 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019288399999999999 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137480+0000", 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4776000000000005e-05 2024-09-10T05:57:57.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156077+0000", 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018596850000000002 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156202+0000", 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012555500000000001 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3005 3.34 3:2febc67c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.491711068000001, 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024327333999999999, 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3005 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174875+0000", 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181125+0000", 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062498969999999999 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181161+0000", 2024-09-10T05:57:57.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569999999999997e-05 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181179+0000", 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8088999999999999e-05 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181333+0000", 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015358799999999999 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181593+0000", 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025959699999999997 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181822+0000", 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022906700000000001 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.193600+0000", 2024-09-10T05:57:57.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01177797 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.198883+0000", 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052831070000000004 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199068+0000", 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184821 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199199+0000", 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013147199999999999 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3012 3.24 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:57.723 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.397636596000002, 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.645952105, 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3012 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268950+0000", 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273458+0000", 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045087410000000001 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273497+0000", 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8822000000000002e-05 2024-09-10T05:57:57.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273516+0000", 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9300000000000002e-05 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273651+0000", 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:57.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273672+0000", 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1676999999999999e-05 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.884862+0000", 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.61118961599999999 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885232+0000", 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037011500000000002 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885644+0000", 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186100000000002 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.904417+0000", 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018772858999999999 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.910331+0000", 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059138699999999999 2024-09-10T05:57:57.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914700+0000", 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043697279999999998 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914898+0000", 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198035 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3020 3.14 3:2b6e0d00:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.699252233999999, 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033030490000000003, 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.731 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3020 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967333+0000", 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972079+0000", 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047458250000000004 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972114+0000", 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5197999999999997e-05 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972130+0000", 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6317999999999999e-05 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972256+0000", 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012557599999999999 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972555+0000", 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029879599999999999 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972831+0000", 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027629999999999999 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.999160+0000", 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026329128 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000129+0000", 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096927000000000005 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000279+0000", 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014958300000000001 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000361+0000", 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2225999999999995e-05 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3021 3.b e91/90 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head v 91'3, mlcod=0'0)", 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.687499605999999, 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026046184999999999, 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.737 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979128+0000", 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5216000000000002e-05 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983799+0000", 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046708660000000001 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983819+0000", 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9996e-05 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983829+0000", 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173999999999999e-05 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983909+0000", 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9677000000000003e-05 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983938+0000", 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8506000000000001e-05 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005057+0000", 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021119150999999999 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005129+0000", 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2599000000000001e-05 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.741 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3038 3.9 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.498267387999999, 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029031866999999999, 2024-09-10T05:57:57.742 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3038 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168317+0000", 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172702+0000", 2024-09-10T05:57:57.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043843019999999996 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172720+0000", 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8284999999999999e-05 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172733+0000", 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3047999999999999e-05 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172846+0000", 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113281 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173043+0000", 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019643300000000001 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173322+0000", 2024-09-10T05:57:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027913500000000002 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.186287+0000", 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012965302 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197185+0000", 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010897831 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197278+0000", 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2906999999999997e-05 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197347+0000", 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9252999999999996e-05 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3041 3.b e91/90 3:d26ad16f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_42:head v 91'5, mlcod=0'0)", 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.449989714000001, 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023158884000000001, 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216593+0000", 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.216594+0000", 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2780000000000001e-06 2024-09-10T05:57:57.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221006+0000", 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044112989999999996 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221029+0000", 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3334000000000001e-05 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221038+0000", 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0110000000000006e-06 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221160+0000", 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122402 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.221234+0000", 2024-09-10T05:57:57.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3503000000000004e-05 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239675+0000", 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018441117999999999 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239752+0000", 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939000000000003e-05 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3056 3.14 3:29c50966:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.279725324000001, 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023839230999999999, 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.754 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3056 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:57:57.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386860+0000", 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.638e-06 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392248+0000", 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053876490000000004 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392276+0000", 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8240000000000001e-05 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392290+0000", 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4357e-05 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392397+0000", 2024-09-10T05:57:57.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106897 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392568+0000", 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017104800000000001 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392731+0000", 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162922 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.406474+0000", 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013743155999999999 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409945+0000", 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034706659999999999 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410581+0000", 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063596099999999999 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410697+0000", 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115697 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3057 3.9 3:921e1a42:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:57.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.268288824999999, 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021138760999999999, 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3057 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398294+0000", 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.398297+0000", 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7719999999999999e-06 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402394+0000", 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040974660000000001 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402419+0000", 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5062000000000002e-05 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402433+0000", 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3828999999999999e-05 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402576+0000", 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000142757 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.402962+0000", 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000385728 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.403424+0000", 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046260300000000002 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.416554+0000", 2024-09-10T05:57:57.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013129494 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419210+0000", 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026561110000000001 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419324+0000", 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114721 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.419433+0000", 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108218 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3059 3.34 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.244820471000001, 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026671028999999999, 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.767 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3059 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421765+0000", 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2510000000000001e-06 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425935+0000", 2024-09-10T05:57:57.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041702730000000004 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425960+0000", 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5041999999999998e-05 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425976+0000", 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426110+0000", 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013405700000000001 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426325+0000", 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000215131 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426519+0000", 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000194246 2024-09-10T05:57:57.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.436549+0000", 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010029688 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448235+0000", 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0116861 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448379+0000", 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143747 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448433+0000", 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4759000000000002e-05 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.773 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3416 3.1 e100/24 3:808843e2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_5:head v 100'9, mlcod=93'7)", 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.98533903899999997, 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027979082999999998, 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681246+0000", 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6769999999999999e-06 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691491+0000", 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010244237 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691528+0000", 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7151999999999999e-05 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691547+0000", 2024-09-10T05:57:57.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8709999999999999e-05 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691714+0000", 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000167369 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691760+0000", 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5695999999999998e-05 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709087+0000", 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017327259000000001 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709223+0000", 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135983 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3457 3.14 3:2831b25f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.66533641499999996, 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024902178000000001, 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.779 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3457 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001250+0000", 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5559999999999999e-06 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005190+0000", 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039401180000000003 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005220+0000", 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005236+0000", 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:57:57.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005366+0000", 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013042899999999999 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005583+0000", 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216698 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:57.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005795+0000", 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021261199999999999 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.015756+0000", 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009960076 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025862+0000", 2024-09-10T05:57:57.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010106484000000001 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026023+0000", 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016126899999999999 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026149+0000", 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012524300000000001 2024-09-10T05:57:57.785 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3502 3.14 3:29b11d35:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.509774+0000", 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.15680833199999999, 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022660870999999999, 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3502 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.509774+0000", 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.509774+0000", 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.509778+0000", 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0900000000000001e-06 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.514141+0000", 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043637520000000003 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.514174+0000", 2024-09-10T05:57:57.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2812999999999999e-05 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.514189+0000", 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5196e-05 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.514315+0000", 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125912 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.514563+0000", 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024811199999999999 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.514816+0000", 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025227399999999998 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.531372+0000", 2024-09-10T05:57:57.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016556339999999999 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.532310+0000", 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00093766200000000002 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.532378+0000", 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8690999999999997e-05 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:57.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.532435+0000", 2024-09-10T05:57:57.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7028999999999999e-05 2024-09-10T05:57:57.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.792 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.792 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.792 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.792 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:57.793 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:57:57.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:57:57.794 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:57.790+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:57.894 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:57.890+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3528 3.1d 3:b8bda836:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.934698+0000", 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0096213719999999996, 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097256879999999997, 2024-09-10T05:57:57.945 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3528 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934698+0000", 2024-09-10T05:57:57.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934698+0000", 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934700+0000", 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.215e-06 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.938636+0000", 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039366740000000002 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.938665+0000", 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8705999999999999e-05 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.938679+0000", 2024-09-10T05:57:57.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4051e-05 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.938772+0000", 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2391000000000004e-05 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.938964+0000", 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000192905 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.939118+0000", 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015316599999999999 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-10T05:57:57.950 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:57.962 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:57:57.995 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:57.990+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:58.089 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:58.089 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:58.089 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:58.096 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:58.094+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:58.103 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:57:58.197 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:58.194+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:58.239 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:58.239 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:58.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:58.239 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1668 3.3a 3:5c5076a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.672851410999996, 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022412708, 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1668 2024-09-10T05:57:58.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562219+0000", 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.562222+0000", 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.926e-06 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567752+0000", 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055299349999999997 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567800+0000", 2024-09-10T05:57:58.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8253e-05 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.567827+0000", 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6928999999999999e-05 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568038+0000", 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000210538 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568468+0000", 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042990900000000002 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.568888+0000", 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042051499999999999 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.577089+0000", 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082005140000000008 2024-09-10T05:57:58.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584385+0000", 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072961279999999998 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584505+0000", 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120248 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.584632+0000", 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012681300000000001 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1672 3.3a 3:5e46ba65:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.646040623000005, 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023256311000000002, 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1672 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589030+0000", 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.589032+0000", 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2129999999999998e-06 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593025+0000", 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039930219999999997 2024-09-10T05:57:58.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593059+0000", 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3485999999999998e-05 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593080+0000", 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.158e-05 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593201+0000", 2024-09-10T05:57:58.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120912 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.593462+0000", 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026110700000000001 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.594308+0000", 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000846264 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.606880+0000", 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012571591999999999 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612043+0000", 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051629680000000004 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612181+0000", 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013771200000000001 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.612286+0000", 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105455 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.814195830000003, 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.252 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:57:58.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:57:58.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:57:58.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2704 3.16 3:6b2c0ee3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.552188704999999, 2024-09-10T05:57:58.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022182810000000001, 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2704 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682882+0000", 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.682886+0000", 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4429999999999996e-06 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686829+0000", 2024-09-10T05:57:58.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039425720000000001 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686867+0000", 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8466000000000001e-05 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.686887+0000", 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9629000000000001e-05 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687049+0000", 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000161619 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687342+0000", 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029348500000000001 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.687579+0000", 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023733000000000001 2024-09-10T05:57:58.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.696533+0000", 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089536040000000004 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704753+0000", 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082205669999999998 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.704929+0000", 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017553499999999999 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.705065+0000", 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013556000000000001 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.264 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2706 3.1d 3:bb5ba2cb:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.531488936999999, 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024374384999999998, 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2706 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703582+0000", 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.703585+0000", 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.287e-06 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709069+0000", 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005484432 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709101+0000", 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2063000000000001e-05 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709117+0000", 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-10T05:57:58.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709221+0000", 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103867 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709490+0000", 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269053 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:58.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.709739+0000", 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024859600000000002 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.724317+0000", 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014578512 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727648+0000", 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033310420000000002 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727824+0000", 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017585100000000001 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727956+0000", 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013196 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2708 3.2a 3:546514ef:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:58.270 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.512053457999997, 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021062501000000001, 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2708 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723017+0000", 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.723020+0000", 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6259999999999999e-06 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727965+0000", 2024-09-10T05:57:58.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049453429999999996 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.727991+0000", 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6083000000000001e-05 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728016+0000", 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5188999999999999e-05 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728170+0000", 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015342900000000001 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728472+0000", 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030251099999999999 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.728707+0000", 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023466700000000001 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739602+0000", 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010895083 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743763+0000", 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041615360000000004 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.743947+0000", 2024-09-10T05:57:58.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018321400000000001 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.744080+0000", 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013281999999999999 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:58.276 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.307421271000003, 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:57:58.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:57:58.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:57:58.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.227724129999999, 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:57:58.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:57:58.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2747 3.2a 3:56df8694:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.108442494000002, 2024-09-10T05:57:58.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336575999999999, 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2747 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:58.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126628+0000", 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.126632+0000", 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9659999999999998e-06 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130540+0000", 2024-09-10T05:57:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003907794 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130580+0000", 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0194000000000002e-05 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130602+0000", 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2169999999999999e-05 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.130776+0000", 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174005 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131200+0000", 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042367199999999999 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.131649+0000", 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000449171 2024-09-10T05:57:58.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.146739+0000", 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01508959 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150675+0000", 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003936419 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150810+0000", 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135162 2024-09-10T05:57:58.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.150965+0000", 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015443299999999999 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.039373283000003, 2024-09-10T05:57:58.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:58.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:57:58.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3011 3.16 3:6bc2b5f1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.245479+0000", 2024-09-10T05:57:58.301 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.989591862000001, 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022462724999999999, 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3011 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.245479+0000", 2024-09-10T05:57:58.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.245479+0000", 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.245484+0000", 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.887e-06 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252541+0000", 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070577790000000001 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252580+0000", 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8593000000000001e-05 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252598+0000", 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8315999999999999e-05 2024-09-10T05:57:58.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.252775+0000", 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000176498 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.253052+0000", 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000277753 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.253298+0000", 2024-09-10T05:57:58.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024548000000000001 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.266781+0000", 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013482757999999999 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.267774+0000", 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00099374300000000006 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.267867+0000", 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2752999999999998e-05 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.267941+0000", 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4165000000000006e-05 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3264 3.1c 3:3923a6c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:57:58.307 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.196527428, 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02663254, 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3264 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038547+0000", 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1860000000000002e-06 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044703+0000", 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061553579999999997 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044742+0000", 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9156000000000003e-05 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044760+0000", 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.863e-05 2024-09-10T05:57:58.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044913+0000", 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153048 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.045181+0000", 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026741299999999998 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.046065+0000", 2024-09-10T05:57:58.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088462999999999996 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.062104+0000", 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016038812999999999 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.064938+0000", 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028335249999999999 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065088+0000", 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974500000000001 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065176+0000", 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8035999999999995e-05 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3417 3.37 e100/24 3:ee859745:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_6:head v 100'10, mlcod=91'8)", 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.540332942, 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028417909000000002, 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699999999999998e-07 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701552+0000", 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068132100000000001 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701602+0000", 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0482999999999998e-05 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701627+0000", 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4530000000000001e-05 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701806+0000", 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179192 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701865+0000", 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9416000000000002e-05 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723088+0000", 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021222933999999999 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723155+0000", 2024-09-10T05:57:58.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7317000000000006e-05 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3418 3.d e100/24 3:b0d74d7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_7:head v 100'7, mlcod=92'5)", 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.704058+0000", 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.531012885, 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022539878999999999, 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.704058+0000", 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.704058+0000", 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.704060+0000", 2024-09-10T05:57:58.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.446e-06 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708819+0000", 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004759096 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708861+0000", 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1471000000000003e-05 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708881+0000", 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0469e-05 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709016+0000", 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000134673 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709057+0000", 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0805e-05 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.726469+0000", 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017412811 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.726597+0000", 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012810799999999999 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.322 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3444 3.1f e100/43 3:f97eeaa4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_23:head v 100'8, mlcod=92'6)", 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.867132+0000", 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.3679381079999999, 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023395056000000001, 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.867132+0000", 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.867132+0000", 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.867136+0000", 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3759999999999999e-06 2024-09-10T05:57:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.871121+0000", 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039850850000000002 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.871157+0000", 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5982999999999998e-05 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.871174+0000", 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6874000000000001e-05 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.871363+0000", 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018891399999999999 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.871430+0000", 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7589999999999995e-05 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.890006+0000", 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018576222 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.890527+0000", 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052101199999999995 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3467 3.2f 3:f6fdc732:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.105087+0000", 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.129983027, 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024322225999999999, 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3467 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.328 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.105087+0000", 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.105087+0000", 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.105090+0000", 2024-09-10T05:57:58.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.39e-06 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.109049+0000", 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039590279999999999 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.109086+0000", 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6714000000000001e-05 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.109108+0000", 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2073e-05 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.109249+0000", 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014093499999999999 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.109653+0000", 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040436299999999998 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.109886+0000", 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000233038 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.129056+0000", 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019170481 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.129104+0000", 2024-09-10T05:57:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7719999999999997e-05 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.129256+0000", 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015186600000000001 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.129410+0000", 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015361800000000001 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3469 3.28 3:15b30b29:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.1101783439999999, 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026322306, 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3469 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124896+0000", 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999997e-06 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132908+0000", 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080112889999999996 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132952+0000", 2024-09-10T05:57:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4663000000000003e-05 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132983+0000", 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0800000000000003e-05 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133152+0000", 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168581 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133458+0000", 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000306192 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133744+0000", 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028567399999999998 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.149676+0000", 2024-09-10T05:57:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015932457000000001 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151030+0000", 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013541060000000001 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151127+0000", 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6274999999999996e-05 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151214+0000", 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7933e-05 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3517 3.2 3:42481240:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.43569854299999999, 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026698706999999999, 2024-09-10T05:57:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3517 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799376+0000", 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1729999999999997e-06 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803201+0000", 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003825186 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803245+0000", 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4187000000000002e-05 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803263+0000", 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7467999999999999e-05 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803403+0000", 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013966900000000001 2024-09-10T05:57:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803414+0000", 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1593999999999999e-05 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809545+0000", 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061312449999999996 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809926+0000", 2024-09-10T05:57:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038063399999999997 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.810277+0000", 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035085699999999999 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.823285+0000", 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013008426999999999 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.825994+0000", 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027082510000000001 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826036+0000", 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2462000000000001e-05 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826071+0000", 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4554000000000002e-05 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3519 3.16 3:6a948d9b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.828596+0000", 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.406474057, 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022473828000000001, 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3519 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.828596+0000", 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.828596+0000", 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.828599+0000", 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0230000000000001e-06 2024-09-10T05:57:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.832634+0000", 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040342670000000002 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.832673+0000", 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9085000000000003e-05 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.832696+0000", 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3300000000000001e-05 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.832897+0000", 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020102400000000001 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.833146+0000", 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024876400000000001 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.833301+0000", 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015495299999999999 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.841107+0000", 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078064959999999996 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.850987+0000", 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098798449999999999 2024-09-10T05:57:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.851034+0000", 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6709999999999998e-05 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.851070+0000", 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6361e-05 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3529 3.5 3:a2b214d0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.955866+0000", 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.27920472299999999, 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021554548, 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3529 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.955866+0000", 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.955866+0000", 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.955869+0000", 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.303e-06 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.959930+0000", 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040608119999999996 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.959968+0000", 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8374000000000002e-05 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.959986+0000", 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7663e-05 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.960067+0000", 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1324999999999998e-05 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.960181+0000", 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113653 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.960278+0000", 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6692000000000002e-05 2024-09-10T05:57:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.966601+0000", 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063230550000000002 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.977322+0000", 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010720914 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.977377+0000", 2024-09-10T05:57:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5173000000000002e-05 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.977420+0000", 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3584000000000001e-05 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.358 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:58.359 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:57:58.360 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:58.356+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:58.460 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:58.456+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:58.545 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:58.546 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:58.546 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:57:58.546 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:58.560 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:57:58.603 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:57:58.600+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:57:58.662 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:58.658+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:58.744 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:58.744 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:57:58.745 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:57:58.745 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:57:58.745 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:58.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:57:58.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:57:58.796 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:58.794+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:58.863 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:58.858+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 148.31730672399999, 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:57:58.909 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:57:58.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:57:58.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:57:58.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:1667 3.3f e66/24 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.341195421999998, 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020534329, 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565033+0000", 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.565034+0000", 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4400000000000001e-07 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569603+0000", 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045689320000000004 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569639+0000", 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6220000000000002e-05 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569658+0000", 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9582999999999999e-05 2024-09-10T05:57:58.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569788+0000", 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129395 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.569843+0000", 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4701999999999999e-05 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585439+0000", 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015596765 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585568+0000", 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128288 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2697 3.a 3:509838dc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:58.921 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.291560695999998, 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021976678999999999, 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2697 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614668+0000", 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.614672+0000", 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9570000000000004e-06 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618642+0000", 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003970215 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618682+0000", 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0241999999999999e-05 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618702+0000", 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9259e-05 2024-09-10T05:57:58.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.618865+0000", 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162893 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619114+0000", 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024920299999999998 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:58.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.619366+0000", 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025260899999999999 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.633958+0000", 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014591695 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636314+0000", 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023562790000000002 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636498+0000", 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018343799999999999 2024-09-10T05:57:58.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.636645+0000", 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014688900000000001 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2709 3.36 3:6dc529f2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.171111752000002, 2024-09-10T05:57:58.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021772117000000001, 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2709 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:58.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735117+0000", 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.735123+0000", 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7359999999999998e-06 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739149+0000", 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040258899999999999 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739195+0000", 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6238e-05 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739226+0000", 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0756000000000002e-05 2024-09-10T05:57:58.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739431+0000", 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020536799999999999 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.739867+0000", 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043582799999999997 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.740323+0000", 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045658999999999999 2024-09-10T05:57:58.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.750593+0000", 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010269215999999999 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756560+0000", 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059669450000000004 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756768+0000", 2024-09-10T05:57:58.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020802799999999999 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.756889+0000", 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012152200000000001 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3000 3.26 3:66b3ccfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:57:58.934 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.804193292000001, 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026540508000000001, 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3000 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102039+0000", 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.213e-06 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108021+0000", 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059826480000000001 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108061+0000", 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9382999999999999e-05 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108079+0000", 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8542999999999998e-05 2024-09-10T05:57:58.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108260+0000", 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018121000000000001 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108677+0000", 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041657899999999998 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:58.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.109094+0000", 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000416807 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.127165+0000", 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018071348000000001 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128257+0000", 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001091741 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128485+0000", 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022827700000000001 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128576+0000", 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0759000000000003e-05 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.940 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3002 3.36 3:6ef358c6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.771821161999998, 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026032893000000001, 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3002 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134413+0000", 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5639999999999996e-06 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140435+0000", 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060217939999999996 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140485+0000", 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0089000000000001e-05 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140505+0000", 2024-09-10T05:57:58.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0186999999999998e-05 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140663+0000", 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157744 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141102+0000", 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043870399999999999 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141512+0000", 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041073500000000002 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.153730+0000", 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012217608 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160105+0000", 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063753949999999998 2024-09-10T05:57:58.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160301+0000", 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195551 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160440+0000", 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139522 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3009 3.33 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.68315488, 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71394179300000005, 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3009 2024-09-10T05:57:58.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223079+0000", 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8029999999999996e-06 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227044+0000", 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003965021 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227081+0000", 2024-09-10T05:57:58.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7153000000000002e-05 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227106+0000", 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5522999999999999e-05 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227283+0000", 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017625099999999999 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:57:58.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227305+0000", 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2200000000000001e-05 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.911736+0000", 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.68443125800000004 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912098+0000", 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000361527 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912509+0000", 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186899999999998 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.930388+0000", 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017878817000000002 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936858+0000", 2024-09-10T05:57:58.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064700369999999997 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936908+0000", 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9792e-05 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.937016+0000", 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010754199999999999 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.953 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3042 3.a 3:50a6a854:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.686598729, 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023353200000000001, 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3042 2024-09-10T05:57:58.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219633+0000", 2024-09-10T05:57:58.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0060000000000001e-06 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225187+0000", 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055536630000000003 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225218+0000", 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1353999999999998e-05 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225234+0000", 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5519000000000002e-05 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225372+0000", 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013812699999999999 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225669+0000", 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029757699999999999 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225934+0000", 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026508599999999999 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239222+0000", 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01328796 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242760+0000", 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035374289999999999 2024-09-10T05:57:58.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242891+0000", 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013163399999999999 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242983+0000", 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1844999999999999e-05 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3045 3.36 3:6d95eaca:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.259088+0000", 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.647140655000001, 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021555105000000001, 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3045 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.259088+0000", 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.259088+0000", 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.259092+0000", 2024-09-10T05:57:58.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6219999999999998e-06 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.262955+0000", 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038631109999999998 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.262978+0000", 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3132000000000001e-05 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.262996+0000", 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7618999999999999e-05 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.263089+0000", 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3282999999999994e-05 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.263283+0000", 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019367399999999999 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.263430+0000", 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014762900000000001 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.277852+0000", 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014421853 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.280448+0000", 2024-09-10T05:57:58.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025962329999999999 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.280565+0000", 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116622 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.280643+0000", 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8326999999999997e-05 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3046 3.1e 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.635071078999999, 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023372101999999999, 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.966 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3046 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271160+0000", 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275046+0000", 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003885707 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275067+0000", 2024-09-10T05:57:58.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1642e-05 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275083+0000", 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5477000000000001e-05 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275168+0000", 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5079000000000003e-05 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275391+0000", 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022318699999999999 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275563+0000", 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017160499999999999 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.284169+0000", 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086058950000000006 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294378+0000", 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010209885 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294463+0000", 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4661999999999997e-05 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294530+0000", 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6688999999999998e-05 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3059 3.34 e91/24 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head v 91'6, mlcod=74'4)", 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.426704+0000", 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.479525157000001, 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02121441, 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.972 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426704+0000", 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426704+0000", 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426706+0000", 2024-09-10T05:57:58.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.74e-06 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.430512+0000", 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003805395 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.430546+0000", 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4607999999999998e-05 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.430564+0000", 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7825999999999998e-05 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.430716+0000", 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015194000000000001 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.430784+0000", 2024-09-10T05:57:58.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7731000000000006e-05 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.447829+0000", 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017045211000000001 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.447918+0000", 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8959e-05 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.976 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3062 3.a 3:510cfa22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.446933316999999, 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023825417000000002, 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.977 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3062 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459299+0000", 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0829999999999997e-06 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464231+0000", 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049315019999999999 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464266+0000", 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4904000000000003e-05 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464282+0000", 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464381+0000", 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8698999999999998e-05 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464599+0000", 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218533 2024-09-10T05:57:58.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464788+0000", 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188247 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475654+0000", 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010866549 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.482934+0000", 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072803160000000002 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483038+0000", 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010331 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483121+0000", 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3101000000000003e-05 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3260 3.36 3:6f11aa0d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.014563+0000", 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.891665974999999, 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020736721999999999, 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.983 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3260 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.014563+0000", 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.014563+0000", 2024-09-10T05:57:58.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.014565+0000", 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2180000000000002e-06 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.018327+0000", 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037618859999999999 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.018352+0000", 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5605e-05 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.018369+0000", 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6881999999999999e-05 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.018511+0000", 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014159599999999999 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.018776+0000", 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026510299999999999 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.019025+0000", 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000249077 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.034465+0000", 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015439618 2024-09-10T05:57:58.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.035023+0000", 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055858500000000001 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.035182+0000", 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159145 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.035299+0000", 2024-09-10T05:57:58.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117007 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3419 3.1e 3:7bbb5ef4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.1975161349999999, 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024061241000000001, 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.989 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3419 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708717+0000", 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999997e-06 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717539+0000", 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088221600000000008 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717582+0000", 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999998e-05 2024-09-10T05:57:58.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717607+0000", 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4532000000000002e-05 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717749+0000", 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014247500000000001 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718284+0000", 2024-09-10T05:57:58.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053459199999999997 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718669+0000", 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038528400000000001 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.729703+0000", 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011033687 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732433+0000", 2024-09-10T05:57:58.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027304439999999998 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732615+0000", 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018145800000000001 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732774+0000", 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159149 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3449 3.20 3:06b085c8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.9888956879999999, 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023229774000000002, 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:58.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3449 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917337+0000", 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922049+0000", 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004711135 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922104+0000", 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.592e-05 2024-09-10T05:57:58.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922135+0000", 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0329e-05 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922305+0000", 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017053899999999999 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:58.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922568+0000", 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026224799999999997 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922808+0000", 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240678 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.932764+0000", 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099562020000000008 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:58.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940253+0000", 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074887970000000002 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940434+0000", 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018096799999999999 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:59.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940563+0000", 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128615 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3463 3.36 3:6eb508a9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.844059589, 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02333292, 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:59.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3463 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:57:59.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062176+0000", 2024-09-10T05:57:59.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.956e-06 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066729+0000", 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045528799999999996 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066763+0000", 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4471999999999998e-05 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066781+0000", 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7917000000000001e-05 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066948+0000", 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016702199999999999 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067181+0000", 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232869 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067421+0000", 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023939299999999999 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.076526+0000", 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091050300000000001 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085179+0000", 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086531899999999998 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085358+0000", 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017913900000000001 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085502+0000", 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014405200000000001 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3464 3.26 3:670772ec:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:59.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.833305942, 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027033292, 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3464 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072927+0000", 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7459999999999998e-06 2024-09-10T05:57:59.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077023+0000", 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040969040000000002 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077070+0000", 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6876000000000003e-05 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077102+0000", 2024-09-10T05:57:59.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1766e-05 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077220+0000", 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011787599999999999 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077448+0000", 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228175 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077666+0000", 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218216 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099266+0000", 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021599679 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099650+0000", 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000384096 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099819+0000", 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168746 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099956+0000", 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137212 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3515 3.33 3:cdf573bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:57:59.014 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.1511677680000001, 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022302426, 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3515 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:59.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755064+0000", 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2969999999999999e-06 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759036+0000", 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003971484 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759069+0000", 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3654e-05 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759086+0000", 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6736e-05 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759206+0000", 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120363 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759485+0000", 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027802399999999998 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759727+0000", 2024-09-10T05:57:59.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024243499999999999 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.768857+0000", 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091297849999999996 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777204+0000", 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083474719999999999 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777293+0000", 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8306000000000005e-05 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777363+0000", 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0870000000000004e-05 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3527 3.34 e101/24 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head v 101'12, mlcod=93'10)", 2024-09-10T05:57:59.020 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.97534048299999998, 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022764337999999999, 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:59.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930889+0000", 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2130000000000001e-06 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934309+0000", 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034198950000000001 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934342+0000", 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2483000000000001e-05 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934358+0000", 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6439999999999998e-05 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:59.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934490+0000", 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013154599999999999 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934530+0000", 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0590000000000003e-05 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953524+0000", 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018993344999999998 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953653+0000", 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882599999999999 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3570 3.26 3:67afa84d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.20479903199999999, 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023228478, 2024-09-10T05:57:59.025 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3570 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:57:59.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701432+0000", 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6340000000000001e-06 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705705+0000", 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042724269999999996 2024-09-10T05:57:59.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705729+0000", 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4107000000000001e-05 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705741+0000", 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2335e-05 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705897+0000", 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015548100000000001 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706177+0000", 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028081500000000001 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706408+0000", 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230991 2024-09-10T05:57:59.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.715905+0000", 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094962859999999996 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724359+0000", 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084545820000000004 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724526+0000", 2024-09-10T05:57:59.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016648499999999999 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724658+0000", 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132335 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:57:59.032 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:57:59.033 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:57:59.034 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:57:59.034 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:57:59.035 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:57:59.035 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:57:59.035 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:57:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:57:59.036 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:57:59.036 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:57:59.037 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:57:59.037 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:57:59.037 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:57:59.030+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:57:59.044 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:57:59.044 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:57:59.068 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:57:59.068 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:57:59.096 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:57:59.097 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:57:59.164 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:59.162+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:57:59.186 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:59.186 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:59.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:57:59.247 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:59.244+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:59.337 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:59.334+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:59.499 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:59.499 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:59.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:57:59.500 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:57:59.496+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:57:59.600 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:57:59.598+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:57:59.688 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:59.688 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:59.701 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:59.698+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:57:59.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:57:59.803 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:57:59.796+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:57:59.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:57:59.864 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:57:59.864 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:57:59.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:57:59.936 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:57:59.934+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:00.003 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:57:59.998+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:00.097 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:00.097 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:00.105 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:00.100+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:00.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:58:00.208 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:00.206+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:00.307 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:00.300+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:00.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:58:00.420 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:00.418+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:00.508 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:00.506+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:00.554 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:00.555 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:00.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:58:00.620 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:00.618+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:00.711 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:00.708+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:00.747 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:00.747 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:00.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:58:00.802 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:58:00.818 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:00.808+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:00.912 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:00.910+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:00.952 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:00.953 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:00.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:58:01.020 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:01.018+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:01.114 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:01.108+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:01.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:58:01.167 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:01.167 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:01.185 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:58:01.232 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:01.230+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:01.310 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:01.311 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:01.315 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:01.312+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:01.333 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:01.333 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:01.346 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:01.346 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:01.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:58:01.369 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:01.370 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:01.392 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:01.416 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:01.414+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:01.420 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:01.420 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:01.449 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:01.449 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:01.475 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:01.476 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:01.504 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:01.511 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:01.511 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:58:01.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:58:01.511 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:58:01.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.511 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2725 3.21 3:856ed7cd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.602909130999997, 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018910211999999999, 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2725 2024-09-10T05:58:01.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905697+0000", 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.905702+0000", 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7400000000000004e-06 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908098+0000", 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023965269999999999 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908124+0000", 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5899000000000001e-05 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908139+0000", 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5026e-05 2024-09-10T05:58:01.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908222+0000", 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2572999999999997e-05 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908417+0000", 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000195026 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.908573+0000", 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000155849 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.913471+0000", 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048985469999999996 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924490+0000", 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011019167999999999 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924557+0000", 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6925e-05 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.924607+0000", 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9932000000000002e-05 2024-09-10T05:58:01.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2751 3.21 3:86aa6f41:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.342028329999998, 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019591372999999999, 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2751 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166578+0000", 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.166581+0000", 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8159999999999998e-06 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.167981+0000", 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00139999 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168020+0000", 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8980000000000003e-05 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168036+0000", 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6568000000000001e-05 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168113+0000", 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6417999999999999e-05 2024-09-10T05:58:01.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168228+0000", 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000115161 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.168349+0000", 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012086 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175149+0000", 2024-09-10T05:58:01.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068000150000000004 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186073+0000", 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010924411 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186119+0000", 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5550999999999998e-05 2024-09-10T05:58:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186169+0000", 2024-09-10T05:58:01.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0603000000000003e-05 2024-09-10T05:58:01.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.525 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.525 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2753 3.21 3:85c90646:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.322057606999998, 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019351368000000001, 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.526 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2753 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186548+0000", 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.186551+0000", 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5059999999999998e-06 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.187974+0000", 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014233259999999999 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188000+0000", 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5643000000000002e-05 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188011+0000", 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1355999999999999e-05 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188082+0000", 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1061000000000003e-05 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188225+0000", 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014240499999999999 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.188343+0000", 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000118019 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192712+0000", 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043687309999999998 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205798+0000", 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013086191 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205849+0000", 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0955000000000003e-05 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.205900+0000", 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1174999999999997e-05 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.532 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2757 3.2e 3:764882c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.284561994000001, 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021228316000000001, 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2757 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224044+0000", 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.224047+0000", 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.531e-06 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225876+0000", 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018291119999999999 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225905+0000", 2024-09-10T05:58:01.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9615999999999999e-05 2024-09-10T05:58:01.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.536 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.536 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.536 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.225921+0000", 2024-09-10T05:58:01.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5338000000000001e-05 2024-09-10T05:58:01.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226002+0000", 2024-09-10T05:58:01.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1521999999999996e-05 2024-09-10T05:58:01.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226149+0000", 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000147031 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.226249+0000", 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9671000000000002e-05 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.232949+0000", 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0067004150000000004 2024-09-10T05:58:01.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245149+0000", 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012199468 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245220+0000", 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0990999999999998e-05 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.245272+0000", 2024-09-10T05:58:01.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.2621000000000003e-05 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3019 3.1f 3:fa47017c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.549744532999998, 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021984574999999999, 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.540 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3019 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958862+0000", 2024-09-10T05:58:01.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.958865+0000", 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961571+0000", 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002706052 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961590+0000", 2024-09-10T05:58:01.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9028000000000001e-05 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961602+0000", 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2342e-05 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961725+0000", 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012271 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961895+0000", 2024-09-10T05:58:01.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017041300000000001 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.961998+0000", 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102068 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.968323+0000", 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063252869999999997 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980751+0000", 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012427745 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980800+0000", 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.9048999999999997e-05 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.980846+0000", 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6517999999999997e-05 2024-09-10T05:58:01.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3038 3.9 e91/24 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head v 91'7, mlcod=73'5)", 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.334581543999999, 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023213424999999999, 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.547 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.174025+0000", 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.71e-07 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179953+0000", 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059275639999999997 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179968+0000", 2024-09-10T05:58:01.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5121e-05 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.179980+0000", 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1773000000000001e-05 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180059+0000", 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9118999999999999e-05 2024-09-10T05:58:01.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.180085+0000", 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6227000000000001e-05 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197005+0000", 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016919975 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.197238+0000", 2024-09-10T05:58:01.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00023277500000000001 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3046 3.1e e91/90 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head v 91'6, mlcod=73'4)", 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.232533299, 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018313788000000001, 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276073+0000", 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.276074+0000", 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0219999999999999e-06 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287890+0000", 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181626 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287919+0000", 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8493e-05 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.287931+0000", 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1990999999999999e-05 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288006+0000", 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5612999999999996e-05 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.288030+0000", 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3998999999999998e-05 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294328+0000", 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0062977299999999996 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.294387+0000", 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8680000000000001e-05 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3052 3.21 3:84f20414:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:01.555 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 26.164899513999998, 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017826086000000001, 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3052 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343707+0000", 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.343709+0000", 2024-09-10T05:58:01.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1299999999999999e-06 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345869+0000", 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002160159 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345883+0000", 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4392999999999999e-05 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345891+0000", 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.4150000000000002e-06 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.345960+0000", 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8885000000000002e-05 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346142+0000", 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000182039 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.346292+0000", 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150865 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.353142+0000", 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068494100000000002 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361408+0000", 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008266219 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361474+0000", 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6347999999999996e-05 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.361533+0000", 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8223000000000001e-05 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3249 3.2e 3:747b1d17:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_238:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:58:01.562 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.657858085000001, 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017772942999999999, 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3249 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:58:01.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850748+0000", 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.850750+0000", 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4530000000000001e-06 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852297+0000", 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001546609 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852318+0000", 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0525000000000001e-05 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852332+0000", 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4705000000000001e-05 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852417+0000", 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5220000000000001e-05 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852595+0000", 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017759699999999999 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.852756+0000", 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016041699999999999 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.857792+0000", 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050367830000000004 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868397+0000", 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010604255999999999 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868467+0000", 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0444000000000005e-05 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:37.868521+0000", 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3934000000000002e-05 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.568 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3440 3.1f 3:f8d8233a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.823576+0000", 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6850300789999997, 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021061468999999999, 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3440 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.823576+0000", 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.823576+0000", 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.823579+0000", 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0970000000000002e-06 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.825989+0000", 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024096489999999998 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.826022+0000", 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3246e-05 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.826038+0000", 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.558e-05 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.826133+0000", 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.5570999999999997e-05 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.826304+0000", 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017044299999999999 2024-09-10T05:58:01.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.826461+0000", 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015707399999999999 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.833263+0000", 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068028289999999998 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.844524+0000", 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011260826 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.844589+0000", 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4980000000000005e-05 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.844637+0000", 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8174000000000003e-05 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.574 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3444 3.1f 3:f97eeaa4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.865068+0000", 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.6435376399999999, 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.026172774999999999, 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3444 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.865068+0000", 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.865068+0000", 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.865071+0000", 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9409999999999999e-06 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.866870+0000", 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001798801 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.866894+0000", 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3830999999999999e-05 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.866907+0000", 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2602000000000001e-05 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.866963+0000", 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6870000000000003e-05 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.867093+0000", 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012984499999999999 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.867261+0000", 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016782400000000001 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.872562+0000", 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053010310000000003 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.891128+0000", 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018565360999999999 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.891190+0000", 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2174999999999993e-05 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.891241+0000", 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1493999999999999e-05 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3468 3.21 3:879d381d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:57.115128+0000", 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.3934783599999996, 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.026384655, 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3468 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.115128+0000", 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.115128+0000", 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.115130+0000", 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.165e-06 2024-09-10T05:58:01.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.116504+0000", 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013740110000000001 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.116527+0000", 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3468e-05 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.116541+0000", 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3182e-05 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.116633+0000", 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2013000000000001e-05 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.116811+0000", 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017883600000000001 2024-09-10T05:58:01.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.116974+0000", 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016287300000000001 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.122442+0000", 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0054675430000000001 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.141408+0000", 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018966370999999999 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.141464+0000", 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6057999999999998e-05 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.141512+0000", 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8134999999999999e-05 2024-09-10T05:58:01.587 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3510 3.3b e100/24 3:dc723a09:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_89:head v 100'19, mlcod=100'17)", 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:57.664371+0000", 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.8442346810000001, 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01655295, 2024-09-10T05:58:01.588 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.664371+0000", 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.589 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.664371+0000", 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.664374+0000", 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.027e-06 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.668777+0000", 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0044028890000000001 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.590 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.668813+0000", 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5547999999999999e-05 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.668830+0000", 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7178999999999999e-05 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.591 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.668986+0000", 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015581199999999999 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.669053+0000", 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6840000000000004e-05 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.680794+0000", 2024-09-10T05:58:01.592 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011741740000000001 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.680924+0000", 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012991500000000001 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3513 3.2e 3:769690c4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:57.718401+0000", 2024-09-10T05:58:01.593 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.7902051280000002, 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016241228, 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3513 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.718401+0000", 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.718401+0000", 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.718404+0000", 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0639999999999998e-06 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.595 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.721730+0000", 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0033261020000000001 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.721771+0000", 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1310999999999998e-05 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.596 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.721791+0000", 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9143999999999998e-05 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.721946+0000", 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015512499999999999 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.722199+0000", 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025312199999999999 2024-09-10T05:58:01.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.722426+0000", 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022698099999999999 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.731763+0000", 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0093374679999999998 2024-09-10T05:58:01.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.734382+0000", 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026183059999999999 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.734504+0000", 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012251100000000001 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.734642+0000", 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013809400000000001 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3529 3.5 e101/90 3:a2b214d0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_108:head v 101'11, mlcod=100'9)", 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:57.960838+0000", 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5477680650000001, 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016556812000000001, 2024-09-10T05:58:01.600 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.960838+0000", 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.960838+0000", 2024-09-10T05:58:01.601 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.960841+0000", 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5380000000000001e-06 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.966449+0000", 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005608371 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.602 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.966493+0000", 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4002999999999999e-05 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.966514+0000", 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1450999999999998e-05 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.966668+0000", 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015322400000000001 2024-09-10T05:58:01.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.966730+0000", 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2564000000000006e-05 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.977292+0000", 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010561790999999999 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.604 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.977395+0000", 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010287 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3530 3.4 e101/24 3:221df403:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_109:head v 101'16, mlcod=100'14)", 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:57.974758+0000", 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.5338481320000001, 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016845668000000001, 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.974758+0000", 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.606 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.974758+0000", 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.974759+0000", 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7700000000000004e-07 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.978560+0000", 2024-09-10T05:58:01.608 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0038017210000000001 2024-09-10T05:58:01.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.608 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.608 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.608 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.978621+0000", 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0584000000000001e-05 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.978643+0000", 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1923999999999999e-05 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.978791+0000", 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014785500000000001 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.978855+0000", 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3986999999999996e-05 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.991466+0000", 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012611252 2024-09-10T05:58:01.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:57.991604+0000", 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013756799999999999 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3550 3.c 3:3116d4b5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:58.362376+0000", 2024-09-10T05:58:01.611 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.1462295660000001, 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023292899999999998, 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3550 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.612 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.362376+0000", 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.362376+0000", 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.362381+0000", 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.07e-06 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.613 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367329+0000", 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0049484280000000004 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367370+0000", 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1442000000000001e-05 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367390+0000", 2024-09-10T05:58:01.614 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9551999999999998e-05 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367555+0000", 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000164807 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367909+0000", 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000353815 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.615 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.368340+0000", 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00043151499999999999 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.380506+0000", 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165628 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.385468+0000", 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.004962391 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.616 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.385567+0000", 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8856000000000004e-05 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.385669+0000", 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102396 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3558 3.21 3:86ef5dcd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:58.484509+0000", 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 3.0240974879999998, 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023146224999999999, 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3558 2024-09-10T05:58:01.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.484509+0000", 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.484509+0000", 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.484512+0000", 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5590000000000001e-06 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.487360+0000", 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028477979999999999 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.620 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.487391+0000", 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1257999999999998e-05 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.487405+0000", 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4141999999999999e-05 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.487563+0000", 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015770000000000001 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.621 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.487851+0000", 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028810799999999997 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.488064+0000", 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00021289400000000001 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.495593+0000", 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007529038 2024-09-10T05:58:01.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.507500+0000", 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011906903 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.507587+0000", 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.7211000000000002e-05 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.507655+0000", 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7613999999999993e-05 2024-09-10T05:58:01.623 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3563 3.2e 3:765d6191:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:58.567775+0000", 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9408312909999998, 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017884786, 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3563 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.625 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.567775+0000", 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.567775+0000", 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.626 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.567779+0000", 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1849999999999997e-06 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.570500+0000", 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002720858 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.570531+0000", 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1347000000000003e-05 2024-09-10T05:58:01.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.570548+0000", 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7065e-05 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.570689+0000", 2024-09-10T05:58:01.628 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000140297 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.571028+0000", 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00033938600000000001 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.571275+0000", 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024719500000000002 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.629 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.578678+0000", 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.007402395 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.585564+0000", 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068863470000000001 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.585612+0000", 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8164999999999997e-05 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.585660+0000", 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7546000000000002e-05 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.631 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3564 3.c 3:3115d56a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:58.589673+0000", 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 2.9189331740000002, 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017989465999999999, 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3564 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.632 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.589673+0000", 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.589673+0000", 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:01.633 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.589675+0000", 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4370000000000001e-06 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.592359+0000", 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0026841510000000001 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.592390+0000", 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0241999999999999e-05 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.634 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.592406+0000", 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6016e-05 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.592510+0000", 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010409899999999999 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.592780+0000", 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00027009899999999999 2024-09-10T05:58:01.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.593008+0000", 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000227894 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.601061+0000", 2024-09-10T05:58:01.636 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080532069999999997 2024-09-10T05:58:01.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.637 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:01.637 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.607407+0000", 2024-09-10T05:58:01.637 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063463720000000003 2024-09-10T05:58:01.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.607554+0000", 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014613899999999999 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.607662+0000", 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010881 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.638 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.639 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:01.639 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:01.639 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:01.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:58:01.641 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:01.636+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:01.740 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:01.738+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:01.828 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:01.828 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:58:01.828 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:01.842 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:01.838+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:01.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:58:01.942 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:01.938+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:02.017 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:02.017 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:02.017 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:58:02.017 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:58:02.017 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:02.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:58:02.080 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:02.078+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:02.146 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:02.142+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:02.212 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 148.58325414399999, 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:58:02.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:58:02.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:02.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:58:02.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:58:02.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:58:02.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 74.777732142000005, 2024-09-10T05:58:02.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:58:02.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:58:02.225 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.226 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.809153995999999, 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:58:02.227 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:58:02.229 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:58:02.230 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:58:02.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:58:02.232 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.546436118999999, 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.236 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.237 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:58:02.238 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:58:02.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.238 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.238 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.238 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:58:02.239 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:58:02.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.239 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:58:02.240 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.491137479999999, 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:58:02.242 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:58:02.243 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.244 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.245 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.246 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.247 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.461826512000002, 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:58:02.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.249 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:58:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:58:02.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.252 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:58:02.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.440071338000003, 2024-09-10T05:58:02.254 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.255 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:58:02.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:58:02.257 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.258 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:58:02.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.334491798999998, 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.263 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:58:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.265 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:58:02.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.323683922000001, 2024-09-10T05:58:02.267 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.268 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:58:02.270 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.271 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.273 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.189314490999998, 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.275 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:58:02.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.277 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.278 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.104601137000003, 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.279 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.280 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:58:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:58:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.281 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:58:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:58:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:58:02.284 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.285 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:58:02.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.287 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 61.035079803000002, 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:58:02.288 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.290 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:58:02.292 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.293 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.294 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.938866951999998, 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.296 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:58:02.297 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.298 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.299 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.938720594000003, 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.300 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.301 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.302 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:58:02.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.304 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.305 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.922582105000004, 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.306 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:58:02.307 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.308 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:58:02.309 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.310 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.917741161999999, 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.311 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.313 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.314 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:58:02.315 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.316 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.806664773000001, 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:58:02.317 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:58:02.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.320 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:58:02.322 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.754901424000003, 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.324 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:58:02.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.326 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:58:02.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.729101722000003, 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:58:02.329 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.330 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:58:02.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.333 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 60.687100700000002, 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.334 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:58:02.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.336 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.337 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:58:02.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:58:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:58:02.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:02.340 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:02.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:58:02.342 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:02.336+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:02.442 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:02.436+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:02.487 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:02.487 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:02.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3906 3.1a 3:5b2b25ca:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.472829+0000", 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.014369252000000001, 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014390714000000001, 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3906 2024-09-10T05:58:02.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.472829+0000", 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.472829+0000", 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.472832+0000", 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.813e-06 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.476801+0000", 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039693050000000002 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.476834+0000", 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3482999999999998e-05 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.476851+0000", 2024-09-10T05:58:02.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6713000000000001e-05 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.476944+0000", 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2645000000000005e-05 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.477091+0000", 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014743499999999999 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.477212+0000", 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120963 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.484280+0000", 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070677589999999998 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-10T05:58:02.495 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-10T05:58:02.496 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:02.501 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:58:02.547 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:02.544+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:02.644 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:02.642+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:02.691 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:02.691 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:02.691 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:02.691 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:02.691 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:02.707 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:58:02.744 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:02.742+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:02.832 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:58:02.846 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:02.846 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 154.285006119, 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:02.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.851 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.905863852000003, 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:58:02.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:58:02.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:58:02.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.858 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.896869189999997, 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:02.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:58:02.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3001 3.13 e90/24 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head v 90'4, mlcod=72'2)", 2024-09-10T05:58:02.865 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.711560113000001, 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024776917999999998, 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131428+0000", 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.016e-06 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137163+0000", 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057351640000000001 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137204+0000", 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0836e-05 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137222+0000", 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137415+0000", 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019288399999999999 2024-09-10T05:58:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137480+0000", 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4776000000000005e-05 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156077+0000", 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018596850000000002 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156202+0000", 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012555500000000001 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3005 3.34 3:2febc67c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.668113571999999, 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024327333999999999, 2024-09-10T05:58:02.870 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3005 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174875+0000", 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181125+0000", 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062498969999999999 2024-09-10T05:58:02.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181161+0000", 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569999999999997e-05 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181179+0000", 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8088999999999999e-05 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181333+0000", 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015358799999999999 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181593+0000", 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025959699999999997 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181822+0000", 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022906700000000001 2024-09-10T05:58:02.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.193600+0000", 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01177797 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.198883+0000", 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052831070000000004 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199068+0000", 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184821 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199199+0000", 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013147199999999999 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3012 3.24 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:02.876 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.5740391, 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.645952105, 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3012 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268950+0000", 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:58:02.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273458+0000", 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045087410000000001 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273497+0000", 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8822000000000002e-05 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273516+0000", 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9300000000000002e-05 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273651+0000", 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273672+0000", 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1676999999999999e-05 2024-09-10T05:58:02.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.884862+0000", 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.61118961599999999 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885232+0000", 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037011500000000002 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:02.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885644+0000", 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186100000000002 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.904417+0000", 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018772858999999999 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.910331+0000", 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059138699999999999 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914700+0000", 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043697279999999998 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914898+0000", 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198035 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3020 3.14 3:2b6e0d00:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:02.883 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.875654738000001, 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033030490000000003, 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3020 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967333+0000", 2024-09-10T05:58:02.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972079+0000", 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047458250000000004 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972114+0000", 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5197999999999997e-05 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972130+0000", 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6317999999999999e-05 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972256+0000", 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012557599999999999 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972555+0000", 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029879599999999999 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972831+0000", 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027629999999999999 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.999160+0000", 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026329128 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000129+0000", 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096927000000000005 2024-09-10T05:58:02.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000279+0000", 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014958300000000001 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000361+0000", 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2225999999999995e-05 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3021 3.b e91/90 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head v 91'3, mlcod=0'0)", 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.863902110000001, 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026046184999999999, 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979128+0000", 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5216000000000002e-05 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983799+0000", 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046708660000000001 2024-09-10T05:58:02.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983819+0000", 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9996e-05 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983829+0000", 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173999999999999e-05 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983909+0000", 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9677000000000003e-05 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983938+0000", 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8506000000000001e-05 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005057+0000", 2024-09-10T05:58:02.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021119150999999999 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005129+0000", 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2599000000000001e-05 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.894 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3038 3.9 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.674669892000001, 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029031866999999999, 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3038 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168317+0000", 2024-09-10T05:58:02.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:58:02.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172702+0000", 2024-09-10T05:58:02.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043843019999999996 2024-09-10T05:58:02.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172720+0000", 2024-09-10T05:58:02.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8284999999999999e-05 2024-09-10T05:58:02.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172733+0000", 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3047999999999999e-05 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172846+0000", 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113281 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173043+0000", 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019643300000000001 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173322+0000", 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027913500000000002 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.186287+0000", 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012965302 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197185+0000", 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010897831 2024-09-10T05:58:02.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197278+0000", 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2906999999999997e-05 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197347+0000", 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9252999999999996e-05 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.903 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3056 3.14 3:29c50966:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.456127828, 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023839230999999999, 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3056 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.904 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386860+0000", 2024-09-10T05:58:02.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.638e-06 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392248+0000", 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053876490000000004 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392276+0000", 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8240000000000001e-05 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392290+0000", 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4357e-05 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392397+0000", 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106897 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392568+0000", 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017104800000000001 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392731+0000", 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162922 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.406474+0000", 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013743155999999999 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409945+0000", 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034706659999999999 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410581+0000", 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063596099999999999 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410697+0000", 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115697 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3059 3.34 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.421222974999999, 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026671028999999999, 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3059 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421765+0000", 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2510000000000001e-06 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425935+0000", 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041702730000000004 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425960+0000", 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5041999999999998e-05 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425976+0000", 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426110+0000", 2024-09-10T05:58:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013405700000000001 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426325+0000", 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000215131 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426519+0000", 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000194246 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.436549+0000", 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010029688 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448235+0000", 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0116861 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448379+0000", 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143747 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448433+0000", 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4759000000000002e-05 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3416 3.1 e100/24 3:808843e2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_5:head v 100'9, mlcod=93'7)", 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1617415429999998, 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027979082999999998, 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681246+0000", 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6769999999999999e-06 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691491+0000", 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010244237 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691528+0000", 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7151999999999999e-05 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691547+0000", 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8709999999999999e-05 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691714+0000", 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000167369 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691760+0000", 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5695999999999998e-05 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709087+0000", 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017327259000000001 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709223+0000", 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135983 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3457 3.14 3:2831b25f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.841738919, 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024902178000000001, 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3457 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001250+0000", 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5559999999999999e-06 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005190+0000", 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039401180000000003 2024-09-10T05:58:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005220+0000", 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005236+0000", 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005366+0000", 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013042899999999999 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005583+0000", 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216698 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005795+0000", 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021261199999999999 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.015756+0000", 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009960076 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025862+0000", 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010106484000000001 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026023+0000", 2024-09-10T05:58:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016126899999999999 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026149+0000", 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012524300000000001 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3527 3.34 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.9182647790000003, 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029448789, 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3527 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924725+0000", 2024-09-10T05:58:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4340000000000002e-06 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929795+0000", 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050704119999999998 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929844+0000", 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8529999999999998e-05 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929870+0000", 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6273000000000001e-05 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930059+0000", 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189338 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930358+0000", 2024-09-10T05:58:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029820500000000001 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930585+0000", 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227801 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.943164+0000", 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012578045 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954035+0000", 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010871822 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954112+0000", 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6377000000000004e-05 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954169+0000", 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7552000000000001e-05 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3540 3.3 3:c0a030d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6721872429999998, 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025740391000000001, 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3540 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170800+0000", 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3420000000000002e-06 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174879+0000", 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040782479999999996 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174907+0000", 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8507e-05 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174917+0000", 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0162e-05 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174986+0000", 2024-09-10T05:58:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8929000000000004e-05 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175105+0000", 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119156 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175205+0000", 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9630000000000007e-05 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.183734+0000", 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008529165 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196451+0000", 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012716867 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196501+0000", 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9495e-05 2024-09-10T05:58:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196538+0000", 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7889999999999998e-05 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3805 3.f e103/24 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head v 103'13, mlcod=100'11)", 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.3235161129999999, 2024-09-10T05:58:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024687252, 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519471+0000", 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1629999999999999e-06 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521818+0000", 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002346622 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521856+0000", 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7651000000000003e-05 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521885+0000", 2024-09-10T05:58:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9833999999999999e-05 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522050+0000", 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016488700000000001 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522135+0000", 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4870000000000006e-05 2024-09-10T05:58:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544022+0000", 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021886663000000001 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544156+0000", 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013456199999999999 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3886 3.34 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.60381477400000005, 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.037223538, 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3886 2024-09-10T05:58:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239173+0000", 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669999999999999e-06 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244645+0000", 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054724689999999998 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244680+0000", 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.485e-05 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244699+0000", 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8732999999999998e-05 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244825+0000", 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012615400000000001 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245045+0000", 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022069900000000001 2024-09-10T05:58:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245231+0000", 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000185236 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.271326+0000", 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026095063000000002 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276174+0000", 2024-09-10T05:58:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048486559999999998 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276304+0000", 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013003400000000001 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276394+0000", 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9577e-05 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3888 3.1c e103/24 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head v 103'14, mlcod=103'12)", 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.57704936699999998, 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024494029, 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265938+0000", 2024-09-10T05:58:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.418e-06 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268943+0000", 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030050979999999999 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268989+0000", 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6013000000000001e-05 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269014+0000", 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4403e-05 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269160+0000", 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146582 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269218+0000", 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7238999999999999e-05 2024-09-10T05:58:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290347+0000", 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021129577 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290430+0000", 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699000000000002e-05 2024-09-10T05:58:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3889 3.1a 3:59af3e8e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_458:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.57687756499999998, 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023755387999999999, 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3889 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266111+0000", 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.207e-06 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272923+0000", 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006812411 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272969+0000", 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6109999999999997e-05 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272995+0000", 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5507000000000002e-05 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273138+0000", 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014260799999999999 2024-09-10T05:58:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273453+0000", 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031509399999999998 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273736+0000", 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000283486 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284653+0000", 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010916571 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289571+0000", 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049184830000000004 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289745+0000", 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017408500000000001 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289863+0000", 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011782600000000001 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3910 3.14 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.29468686900000002, 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032209085999999998, 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3910 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548302+0000", 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9169999999999999e-06 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552324+0000", 2024-09-10T05:58:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040218169999999996 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552352+0000", 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7606e-05 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552375+0000", 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3663e-05 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552452+0000", 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6762999999999997e-05 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552562+0000", 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110011 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552695+0000", 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132371 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.561844+0000", 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091494290000000006 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580364+0000", 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018519889000000001 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580464+0000", 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100008 2024-09-10T05:58:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580507+0000", 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3612000000000002e-05 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:02.969 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:02.970 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:02.874+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:02.971 INFO:tasks.workunit.client.0.smithi070.stdout:quota disabled for the bucket: buck_2024_08_10_05_57_52 2024-09-10T05:58:02.971 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 2Gb. 2024-09-10T05:58:02.971 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:58:02.971 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:58:02.971 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-09-10T05:58:02.971 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:58:02.972 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:58:02.972 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:02.968+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:03.071 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:03.070+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:03.161 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:03.161 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:03.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:4009 8.18 e103/90 8:1931e2f2:root::buck_2024_08_10_05_57_52:head v 103'6, mlcod=94'4)", 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:03.160267+0000", 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00081775299999999995, 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087701599999999999, 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160267+0000", 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160267+0000", 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160270+0000", 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.48e-06 2024-09-10T05:58:03.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160284+0000", 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4399999999999999e-05 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160328+0000", 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3872999999999998e-05 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160346+0000", 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8170000000000001e-05 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160493+0000", 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014705499999999999 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:03.160552+0000", 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9033000000000002e-05 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-10T05:58:03.166 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:03.173 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:03.168+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:03.176 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:58:03.177 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:58:03.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:58:03.273 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:03.268+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:03.345 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:03.345 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:03.345 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:03.345 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:03.345 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:03.359 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:58:03.403 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:03.400+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:03.475 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:03.470+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:03.531 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:03.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.106570949000002, 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.532 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:58:03.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.599796390000002, 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:58:03.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:03.544 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.520099248999998, 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:58:03.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:58:03.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.331748402000002, 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:58:03.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:58:03.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:58:03.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3264 3.1c 3:3923a6c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.488902546999999, 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02663254, 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3264 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038547+0000", 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1860000000000002e-06 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044703+0000", 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061553579999999997 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044742+0000", 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9156000000000003e-05 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044760+0000", 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.863e-05 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044913+0000", 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153048 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.045181+0000", 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026741299999999998 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.046065+0000", 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088462999999999996 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.062104+0000", 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016038812999999999 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.064938+0000", 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028335249999999999 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065088+0000", 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974500000000001 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065176+0000", 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8035999999999995e-05 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3417 3.37 e100/24 3:ee859745:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_6:head v 100'10, mlcod=91'8)", 2024-09-10T05:58:03.567 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.8327080609999999, 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028417909000000002, 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699999999999998e-07 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701552+0000", 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068132100000000001 2024-09-10T05:58:03.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701602+0000", 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0482999999999998e-05 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701627+0000", 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4530000000000001e-05 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701806+0000", 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179192 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701865+0000", 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9416000000000002e-05 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723088+0000", 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021222933999999999 2024-09-10T05:58:03.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723155+0000", 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7317000000000006e-05 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3469 3.28 3:15b30b29:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:03.572 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.4025534630000003, 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026322306, 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3469 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124896+0000", 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999997e-06 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132908+0000", 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080112889999999996 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132952+0000", 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4663000000000003e-05 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132983+0000", 2024-09-10T05:58:03.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0800000000000003e-05 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133152+0000", 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168581 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133458+0000", 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000306192 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133744+0000", 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028567399999999998 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.149676+0000", 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015932457000000001 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151030+0000", 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013541060000000001 2024-09-10T05:58:03.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151127+0000", 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6274999999999996e-05 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151214+0000", 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7933e-05 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3517 3.2 3:42481240:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7280736619999999, 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026698706999999999, 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.579 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3517 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799376+0000", 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1729999999999997e-06 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803201+0000", 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003825186 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803245+0000", 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4187000000000002e-05 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803263+0000", 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7467999999999999e-05 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803403+0000", 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013966900000000001 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803414+0000", 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1593999999999999e-05 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809545+0000", 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061312449999999996 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809926+0000", 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038063399999999997 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.810277+0000", 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035085699999999999 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.823285+0000", 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013008426999999999 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.825994+0000", 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027082510000000001 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826036+0000", 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2462000000000001e-05 2024-09-10T05:58:03.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826071+0000", 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4554000000000002e-05 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3808 3.2 3:41ef7625:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.9830318390000001, 2024-09-10T05:58:03.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025521107000000001, 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3808 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:03.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544419+0000", 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3430000000000003e-06 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549878+0000", 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054584589999999997 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549915+0000", 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7472999999999998e-05 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549932+0000", 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7136e-05 2024-09-10T05:58:03.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550060+0000", 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012812699999999999 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550275+0000", 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021436400000000001 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:03.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550458+0000", 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018312800000000001 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.558866+0000", 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084081569999999994 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569623+0000", 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010757139000000001 2024-09-10T05:58:03.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569801+0000", 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017797200000000001 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569935+0000", 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013380900000000001 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3815 3.5 3:a26771db:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_394:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.915789661, 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024682987, 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.593 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3815 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611660+0000", 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6370000000000001e-06 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615460+0000", 2024-09-10T05:58:03.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00380088 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615496+0000", 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5772999999999998e-05 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615523+0000", 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6859000000000002e-05 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615724+0000", 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201366 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616167+0000", 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044238600000000002 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:03.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616565+0000", 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039797999999999998 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.629207+0000", 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012642146999999999 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636048+0000", 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068409880000000001 2024-09-10T05:58:03.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636198+0000", 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014965900000000001 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636339+0000", 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014131199999999999 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3822 3.2f 3:f5691873:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_401:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.848357459, 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029772514, 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3822 2024-09-10T05:58:03.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679092+0000", 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9910000000000004e-06 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682947+0000", 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038550630000000002 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682976+0000", 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8988000000000001e-05 2024-09-10T05:58:03.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682992+0000", 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6209e-05 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683193+0000", 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000200185 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683489+0000", 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296717 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683725+0000", 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023543500000000001 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.695201+0000", 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011476513000000001 2024-09-10T05:58:03.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708548+0000", 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013346373 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708739+0000", 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019118499999999999 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708861+0000", 2024-09-10T05:58:03.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121855 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3842 3.2f 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.7412725610000002, 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034550046000000001, 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3842 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786179+0000", 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8069999999999996e-06 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791316+0000", 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051367679999999999 2024-09-10T05:58:03.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791355+0000", 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9440000000000002e-05 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791373+0000", 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8352999999999999e-05 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791572+0000", 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019850799999999999 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791832+0000", 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025995199999999998 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792070+0000", 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023838099999999999 2024-09-10T05:58:03.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.806866+0000", 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014796073999999999 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820440+0000", 2024-09-10T05:58:03.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013573528 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820604+0000", 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016399599999999999 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820723+0000", 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119239 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3853 3.2 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.6249000810000001, 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032847466999999998, 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.613 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3853 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902549+0000", 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6880000000000001e-06 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908028+0000", 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054786820000000003 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908063+0000", 2024-09-10T05:58:03.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4792999999999997e-05 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908087+0000", 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4499e-05 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908218+0000", 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130977 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908410+0000", 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019136399999999999 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908651+0000", 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024184 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927151+0000", 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018500103 2024-09-10T05:58:03.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935254+0000", 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081027359999999993 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935323+0000", 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880000000000005e-05 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935393+0000", 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9905000000000002e-05 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3854 3.2 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.615653708, 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032334535999999997, 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3854 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911796+0000", 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7799999999999998e-06 2024-09-10T05:58:03.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915942+0000", 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041458290000000002 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915977+0000", 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5682000000000002e-05 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916000+0000", 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2364000000000001e-05 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916619+0000", 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061924400000000002 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917000+0000", 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000381651 2024-09-10T05:58:03.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917409+0000", 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040862500000000003 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.931292+0000", 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013882495 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943964+0000", 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012672843 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944047+0000", 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2371000000000001e-05 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944126+0000", 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9652000000000002e-05 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3874 3.2 3:414c7108:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_443:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.415142892, 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028695409000000002, 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.626 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3874 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112306+0000", 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.117951+0000", 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056447779999999996 2024-09-10T05:58:03.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118011+0000", 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0179000000000001e-05 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118040+0000", 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.885e-05 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118251+0000", 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021135199999999999 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118565+0000", 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031331399999999998 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118877+0000", 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031258099999999998 2024-09-10T05:58:03.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.137138+0000", 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018260345000000001 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140708+0000", 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035707590000000002 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140883+0000", 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017462200000000001 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140998+0000", 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011507599999999999 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3878 3.2a 3:5587957a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_447:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.632 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.3699939510000001, 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029379293000000001, 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3878 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157455+0000", 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1999999999999999e-06 2024-09-10T05:58:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161427+0000", 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039726149999999997 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161465+0000", 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7883000000000003e-05 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161484+0000", 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8465999999999999e-05 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161632+0000", 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014848199999999999 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161895+0000", 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000262835 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.162126+0000", 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230471 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.183957+0000", 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021831547 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186575+0000", 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002617608 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186718+0000", 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014299199999999999 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186831+0000", 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113194 2024-09-10T05:58:03.638 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3879 3.2a 3:5472b1a4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_448:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.363163466, 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027503584000000001, 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3879 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:03.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164285+0000", 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0929999999999999e-06 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171662+0000", 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073767499999999996 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171705+0000", 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2599999999999999e-05 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171731+0000", 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6812999999999999e-05 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171914+0000", 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018210899999999999 2024-09-10T05:58:03.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172318+0000", 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040407699999999997 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172753+0000", 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043529899999999999 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.189712+0000", 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016959044 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191568+0000", 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018557510000000001 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191692+0000", 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012407299999999999 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191786+0000", 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3974999999999994e-05 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3887 3.36 e103/24 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head v 103'16, mlcod=102'14)", 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.2738526809999999, 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025460763000000001, 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:03.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253596+0000", 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3349999999999998e-06 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255939+0000", 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002342481 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255990+0000", 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1595999999999999e-05 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256015+0000", 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.438e-05 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256167+0000", 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015261699999999999 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256221+0000", 2024-09-10T05:58:03.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3455999999999998e-05 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.278813+0000", 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022591946000000002 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279054+0000", 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024095200000000001 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.650 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3888 3.1c 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.2685810550000001, 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032020736000000001, 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.651 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3888 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258869+0000", 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8899999999999998e-06 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265112+0000", 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062428429999999997 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265150+0000", 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7366000000000001e-05 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265169+0000", 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9089999999999998e-05 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265288+0000", 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119085 2024-09-10T05:58:03.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265498+0000", 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020986299999999999 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265757+0000", 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025964299999999999 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.280209+0000", 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014451311 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290711+0000", 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010502589 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290793+0000", 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1310999999999995e-05 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290885+0000", 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2744999999999994e-05 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3895 3.1d 3:b90a3a7e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_464:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.1960275730000001, 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024479635999999999, 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3895 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:03.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:03.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331422+0000", 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.76e-06 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335102+0000", 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003680104 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335143+0000", 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1006e-05 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335161+0000", 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8567999999999999e-05 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335338+0000", 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017661099999999999 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335689+0000", 2024-09-10T05:58:03.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035125800000000002 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.336048+0000", 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035893299999999997 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.347421+0000", 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011372597999999999 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355631+0000", 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082105349999999997 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355779+0000", 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014740200000000001 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355898+0000", 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118861 2024-09-10T05:58:03.663 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.664 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.664 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.664 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:03.664 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:03.664 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:03.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:58:03.666 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:58:03.666 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:03.660+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:03.766 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:03.761+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:03.819 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:58:03.820 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:03.820 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:03.839 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:03.839 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:03.839 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:03.840 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:03.840 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:03.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:58:03.857 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:03.874 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:03.874 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:03.893 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:03.893 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:03.899 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:03.896+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:03.904 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T05:58:03.904 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T05:58:03.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:58:03.912 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:03.912 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:03.932 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:03.953 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:03.954 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:03.968 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:03.965+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:03.975 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:03.976 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:03.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:58:04.075 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:04.072+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:04.154 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:04.155 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:04.168 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:58:04.170 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:04.165+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:04.212 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:58:04.219 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:58:04.229 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-09-10T05:58:03.813362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3335206354,"num_objects":1042,"num_object_clones":0,"num_object_copies":2084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1042,"num_whiteouts":0,"num_read":3088,"num_read_kb":2759,"num_write":2139,"num_write_kb":3282804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":318774732,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3058,"ondisk_log_size":3058,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":531,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":6368392,"kb_used_data":6129404,"kb_used_omap":10,"kb_used_meta":230645,"kb_avail":654234488,"statfs":{"total":676457349120,"available":669936115712,"internally_reserved":0,"allocated":6276509696,"data_stored":6272570485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11159,"internal_metadata":236180585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1220542464,"num_objects":291,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":1191936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.035514"},"pg_stats":[{"pgid":"3.3f","version":"103'13","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830033+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:58:00.830033+0000","last_peered":"2024-09-10T05:58:00.830033+0000","last_clean":"2024-09-10T05:58:00.830033+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:58:00.830033+0000","last_undegraded":"2024-09-10T05:58:00.830033+0000","last_fullsized":"2024-09-10T05:58:00.830033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"94'2","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811582+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:58:00.811582+0000","last_peered":"2024-09-10T05:58:00.811582+0000","last_clean":"2024-09-10T05:58:00.811582+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:58:00.811582+0000","last_undegraded":"2024-09-10T05:58:00.811582+0000","last_fullsized":"2024-09-10T05:58:00.811582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"100'15","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.829411+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:57:59.829411+0000","last_peered":"2024-09-10T05:57:59.829411+0000","last_clean":"2024-09-10T05:57:59.829411+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:57:59.829411+0000","last_undegraded":"2024-09-10T05:57:59.829411+0000","last_fullsized":"2024-09-10T05:57:59.829411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827775+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:58:00.827775+0000","last_peered":"2024-09-10T05:58:00.827775+0000","last_clean":"2024-09-10T05:58:00.827775+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:58:00.827775+0000","last_undegraded":"2024-09-10T05:58:00.827775+0000","last_fullsized":"2024-09-10T05:58:00.827775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"101'13","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808315+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:57:59.808315+0000","last_peered":"2024-09-10T05:57:59.808315+0000","last_clean":"2024-09-10T05:57:59.808315+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:57:59.808315+0000","last_undegraded":"2024-09-10T05:57:59.808315+0000","last_fullsized":"2024-09-10T05:57:59.808315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"67'4","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815401+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:57:59.815401+0000","last_peered":"2024-09-10T05:57:59.815401+0000","last_clean":"2024-09-10T05:57:59.815401+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:57:59.815401+0000","last_undegraded":"2024-09-10T05:57:59.815401+0000","last_fullsized":"2024-09-10T05:57:59.815401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'10","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813831+0000","last_change":"2024-09-10T05:57:35.997693+0000","last_active":"2024-09-10T05:58:00.813831+0000","last_peered":"2024-09-10T05:58:00.813831+0000","last_clean":"2024-09-10T05:58:00.813831+0000","last_became_active":"2024-09-10T05:57:34.929573+0000","last_became_peered":"2024-09-10T05:57:34.929573+0000","last_unstale":"2024-09-10T05:58:00.813831+0000","last_undegraded":"2024-09-10T05:58:00.813831+0000","last_fullsized":"2024-09-10T05:58:00.813831+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:13.157802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"99'9","reported_seq":223,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.810057+0000","last_change":"2024-09-10T05:57:36.063637+0000","last_active":"2024-09-10T05:57:59.810057+0000","last_peered":"2024-09-10T05:57:59.810057+0000","last_clean":"2024-09-10T05:57:59.810057+0000","last_became_active":"2024-09-10T05:57:34.935493+0000","last_became_peered":"2024-09-10T05:57:34.935493+0000","last_unstale":"2024-09-10T05:57:59.810057+0000","last_undegraded":"2024-09-10T05:57:59.810057+0000","last_fullsized":"2024-09-10T05:57:59.810057+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:04.514423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"100'19","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827639+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:58:00.827639+0000","last_peered":"2024-09-10T05:58:00.827639+0000","last_clean":"2024-09-10T05:58:00.827639+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:58:00.827639+0000","last_undegraded":"2024-09-10T05:58:00.827639+0000","last_fullsized":"2024-09-10T05:58:00.827639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827913+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:58:00.827913+0000","last_peered":"2024-09-10T05:58:00.827913+0000","last_clean":"2024-09-10T05:58:00.827913+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:58:00.827913+0000","last_undegraded":"2024-09-10T05:58:00.827913+0000","last_fullsized":"2024-09-10T05:58:00.827913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'17","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813382+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:58:00.813382+0000","last_peered":"2024-09-10T05:58:00.813382+0000","last_clean":"2024-09-10T05:58:00.813382+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:58:00.813382+0000","last_undegraded":"2024-09-10T05:58:00.813382+0000","last_fullsized":"2024-09-10T05:58:00.813382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816308+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:57:59.816308+0000","last_peered":"2024-09-10T05:57:59.816308+0000","last_clean":"2024-09-10T05:57:59.816308+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:57:59.816308+0000","last_undegraded":"2024-09-10T05:57:59.816308+0000","last_fullsized":"2024-09-10T05:57:59.816308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"102'11","reported_seq":179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828127+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:58:00.828127+0000","last_peered":"2024-09-10T05:58:00.828127+0000","last_clean":"2024-09-10T05:58:00.828127+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:58:00.828127+0000","last_undegraded":"2024-09-10T05:58:00.828127+0000","last_fullsized":"2024-09-10T05:58:00.828127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.816280+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:58:00.816280+0000","last_peered":"2024-09-10T05:58:00.816280+0000","last_clean":"2024-09-10T05:58:00.816280+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:58:00.816280+0000","last_undegraded":"2024-09-10T05:58:00.816280+0000","last_fullsized":"2024-09-10T05:58:00.816280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"100'4","reported_seq":80,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811897+0000","last_change":"2024-09-10T05:57:35.813336+0000","last_active":"2024-09-10T05:58:00.811897+0000","last_peered":"2024-09-10T05:58:00.811897+0000","last_clean":"2024-09-10T05:58:00.811897+0000","last_became_active":"2024-09-10T05:57:34.905432+0000","last_became_peered":"2024-09-10T05:57:34.905432+0000","last_unstale":"2024-09-10T05:58:00.811897+0000","last_undegraded":"2024-09-10T05:58:00.811897+0000","last_fullsized":"2024-09-10T05:58:00.811897+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:40:43.602147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.868513+0000","last_change":"2024-09-10T05:57:34.934120+0000","last_active":"2024-09-10T05:57:59.868513+0000","last_peered":"2024-09-10T05:57:59.868513+0000","last_clean":"2024-09-10T05:57:59.868513+0000","last_became_active":"2024-09-10T05:57:34.886318+0000","last_became_peered":"2024-09-10T05:57:34.886318+0000","last_unstale":"2024-09-10T05:57:59.868513+0000","last_undegraded":"2024-09-10T05:57:59.868513+0000","last_fullsized":"2024-09-10T05:57:59.868513+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:03.695086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814253+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:57:59.814253+0000","last_peered":"2024-09-10T05:57:59.814253+0000","last_clean":"2024-09-10T05:57:59.814253+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:57:59.814253+0000","last_undegraded":"2024-09-10T05:57:59.814253+0000","last_fullsized":"2024-09-10T05:57:59.814253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"102'13","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830081+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:58:00.830081+0000","last_peered":"2024-09-10T05:58:00.830081+0000","last_clean":"2024-09-10T05:58:00.830081+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:58:00.830081+0000","last_undegraded":"2024-09-10T05:58:00.830081+0000","last_fullsized":"2024-09-10T05:58:00.830081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827952+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:58:00.827952+0000","last_peered":"2024-09-10T05:58:00.827952+0000","last_clean":"2024-09-10T05:58:00.827952+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:58:00.827952+0000","last_undegraded":"2024-09-10T05:58:00.827952+0000","last_fullsized":"2024-09-10T05:58:00.827952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"102'15","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827072+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:58:00.827072+0000","last_peered":"2024-09-10T05:58:00.827072+0000","last_clean":"2024-09-10T05:58:00.827072+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:58:00.827072+0000","last_undegraded":"2024-09-10T05:58:00.827072+0000","last_fullsized":"2024-09-10T05:58:00.827072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813809+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:58:00.813809+0000","last_peered":"2024-09-10T05:58:00.813809+0000","last_clean":"2024-09-10T05:58:00.813809+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:58:00.813809+0000","last_undegraded":"2024-09-10T05:58:00.813809+0000","last_fullsized":"2024-09-10T05:58:00.813809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"102'9","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829790+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:58:00.829790+0000","last_peered":"2024-09-10T05:58:00.829790+0000","last_clean":"2024-09-10T05:58:00.829790+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:58:00.829790+0000","last_undegraded":"2024-09-10T05:58:00.829790+0000","last_fullsized":"2024-09-10T05:58:00.829790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866953+0000","last_change":"2024-09-10T05:57:34.918272+0000","last_active":"2024-09-10T05:57:59.866953+0000","last_peered":"2024-09-10T05:57:59.866953+0000","last_clean":"2024-09-10T05:57:59.866953+0000","last_became_active":"2024-09-10T05:57:34.886181+0000","last_became_peered":"2024-09-10T05:57:34.886181+0000","last_unstale":"2024-09-10T05:57:59.866953+0000","last_undegraded":"2024-09-10T05:57:59.866953+0000","last_fullsized":"2024-09-10T05:57:59.866953+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:52.163141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"102'16","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814988+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:57:59.814988+0000","last_peered":"2024-09-10T05:57:59.814988+0000","last_clean":"2024-09-10T05:57:59.814988+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:57:59.814988+0000","last_undegraded":"2024-09-10T05:57:59.814988+0000","last_fullsized":"2024-09-10T05:57:59.814988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"74'2","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867814+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:57:59.867814+0000","last_peered":"2024-09-10T05:57:59.867814+0000","last_clean":"2024-09-10T05:57:59.867814+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:57:59.867814+0000","last_undegraded":"2024-09-10T05:57:59.867814+0000","last_fullsized":"2024-09-10T05:57:59.867814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"101'13","reported_seq":101,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828383+0000","last_change":"2024-09-10T05:57:35.409111+0000","last_active":"2024-09-10T05:58:00.828383+0000","last_peered":"2024-09-10T05:58:00.828383+0000","last_clean":"2024-09-10T05:58:00.828383+0000","last_became_active":"2024-09-10T05:57:34.908315+0000","last_became_peered":"2024-09-10T05:57:34.908315+0000","last_unstale":"2024-09-10T05:58:00.828383+0000","last_undegraded":"2024-09-10T05:58:00.828383+0000","last_fullsized":"2024-09-10T05:58:00.828383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:14.629870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816447+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:57:59.816447+0000","last_peered":"2024-09-10T05:57:59.816447+0000","last_clean":"2024-09-10T05:57:59.816447+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:57:59.816447+0000","last_undegraded":"2024-09-10T05:57:59.816447+0000","last_fullsized":"2024-09-10T05:57:59.816447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"101'9","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807844+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:57:59.807844+0000","last_peered":"2024-09-10T05:57:59.807844+0000","last_clean":"2024-09-10T05:57:59.807844+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:57:59.807844+0000","last_undegraded":"2024-09-10T05:57:59.807844+0000","last_fullsized":"2024-09-10T05:57:59.807844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"99'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.813956+0000","last_change":"2024-09-10T05:57:35.634592+0000","last_active":"2024-09-10T05:57:59.813956+0000","last_peered":"2024-09-10T05:57:59.813956+0000","last_clean":"2024-09-10T05:57:59.813956+0000","last_became_active":"2024-09-10T05:57:34.904670+0000","last_became_peered":"2024-09-10T05:57:34.904670+0000","last_unstale":"2024-09-10T05:57:59.813956+0000","last_undegraded":"2024-09-10T05:57:59.813956+0000","last_fullsized":"2024-09-10T05:57:59.813956+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:51.928187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"99'6","reported_seq":100,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.828843+0000","last_change":"2024-09-10T05:57:36.068038+0000","last_active":"2024-09-10T05:57:59.828843+0000","last_peered":"2024-09-10T05:57:59.828843+0000","last_clean":"2024-09-10T05:57:59.828843+0000","last_became_active":"2024-09-10T05:57:34.927936+0000","last_became_peered":"2024-09-10T05:57:34.927936+0000","last_unstale":"2024-09-10T05:57:59.828843+0000","last_undegraded":"2024-09-10T05:57:59.828843+0000","last_fullsized":"2024-09-10T05:57:59.828843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:15.259327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"102'12","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827993+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:58:00.827993+0000","last_peered":"2024-09-10T05:58:00.827993+0000","last_clean":"2024-09-10T05:58:00.827993+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:58:00.827993+0000","last_undegraded":"2024-09-10T05:58:00.827993+0000","last_fullsized":"2024-09-10T05:58:00.827993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.815363+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:58:00.815363+0000","last_peered":"2024-09-10T05:58:00.815363+0000","last_clean":"2024-09-10T05:58:00.815363+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:58:00.815363+0000","last_undegraded":"2024-09-10T05:58:00.815363+0000","last_fullsized":"2024-09-10T05:58:00.815363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"94'28","reported_seq":200,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809604+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:57:59.809604+0000","last_peered":"2024-09-10T05:57:59.809604+0000","last_clean":"2024-09-10T05:57:59.809604+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:57:59.809604+0000","last_undegraded":"2024-09-10T05:57:59.809604+0000","last_fullsized":"2024-09-10T05:57:59.809604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829471+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:58:00.829471+0000","last_peered":"2024-09-10T05:58:00.829471+0000","last_clean":"2024-09-10T05:58:00.829471+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:58:00.829471+0000","last_undegraded":"2024-09-10T05:58:00.829471+0000","last_fullsized":"2024-09-10T05:58:00.829471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"99'41","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811662+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:58:00.811662+0000","last_peered":"2024-09-10T05:58:00.811662+0000","last_clean":"2024-09-10T05:58:00.811662+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:58:00.811662+0000","last_undegraded":"2024-09-10T05:58:00.811662+0000","last_fullsized":"2024-09-10T05:58:00.811662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":82,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.815809+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:58:00.815809+0000","last_peered":"2024-09-10T05:58:00.815809+0000","last_clean":"2024-09-10T05:58:00.815809+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:58:00.815809+0000","last_undegraded":"2024-09-10T05:58:00.815809+0000","last_fullsized":"2024-09-10T05:58:00.815809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"101'13","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808007+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:57:59.808007+0000","last_peered":"2024-09-10T05:57:59.808007+0000","last_clean":"2024-09-10T05:57:59.808007+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:57:59.808007+0000","last_undegraded":"2024-09-10T05:57:59.808007+0000","last_fullsized":"2024-09-10T05:57:59.808007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":82,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826849+0000","last_change":"2024-09-10T05:57:34.909248+0000","last_active":"2024-09-10T05:58:00.826849+0000","last_peered":"2024-09-10T05:58:00.826849+0000","last_clean":"2024-09-10T05:58:00.826849+0000","last_became_active":"2024-09-10T05:57:34.908514+0000","last_became_peered":"2024-09-10T05:57:34.908514+0000","last_unstale":"2024-09-10T05:58:00.826849+0000","last_undegraded":"2024-09-10T05:58:00.826849+0000","last_fullsized":"2024-09-10T05:58:00.826849+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:54.641680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816943+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:57:59.816943+0000","last_peered":"2024-09-10T05:57:59.816943+0000","last_clean":"2024-09-10T05:57:59.816943+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:57:59.816943+0000","last_undegraded":"2024-09-10T05:57:59.816943+0000","last_fullsized":"2024-09-10T05:57:59.816943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816355+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:57:59.816355+0000","last_peered":"2024-09-10T05:57:59.816355+0000","last_clean":"2024-09-10T05:57:59.816355+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:57:59.816355+0000","last_undegraded":"2024-09-10T05:57:59.816355+0000","last_fullsized":"2024-09-10T05:57:59.816355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807526+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:57:59.807526+0000","last_peered":"2024-09-10T05:57:59.807526+0000","last_clean":"2024-09-10T05:57:59.807526+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:57:59.807526+0000","last_undegraded":"2024-09-10T05:57:59.807526+0000","last_fullsized":"2024-09-10T05:57:59.807526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809953+0000","last_change":"2024-09-10T05:57:34.911131+0000","last_active":"2024-09-10T05:57:59.809953+0000","last_peered":"2024-09-10T05:57:59.809953+0000","last_clean":"2024-09-10T05:57:59.809953+0000","last_became_active":"2024-09-10T05:57:34.910896+0000","last_became_peered":"2024-09-10T05:57:34.910896+0000","last_unstale":"2024-09-10T05:57:59.809953+0000","last_undegraded":"2024-09-10T05:57:59.809953+0000","last_fullsized":"2024-09-10T05:57:59.809953+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:28.972799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"103'19","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828342+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:58:00.828342+0000","last_peered":"2024-09-10T05:58:00.828342+0000","last_clean":"2024-09-10T05:58:00.828342+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:58:00.828342+0000","last_undegraded":"2024-09-10T05:58:00.828342+0000","last_fullsized":"2024-09-10T05:58:00.828342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":79,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.833946+0000","last_change":"2024-09-10T05:57:34.928926+0000","last_active":"2024-09-10T05:57:59.833946+0000","last_peered":"2024-09-10T05:57:59.833946+0000","last_clean":"2024-09-10T05:57:59.833946+0000","last_became_active":"2024-09-10T05:57:34.928512+0000","last_became_peered":"2024-09-10T05:57:34.928512+0000","last_unstale":"2024-09-10T05:57:59.833946+0000","last_undegraded":"2024-09-10T05:57:59.833946+0000","last_fullsized":"2024-09-10T05:57:59.833946+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:02.124851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867619+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:57:59.867619+0000","last_peered":"2024-09-10T05:57:59.867619+0000","last_clean":"2024-09-10T05:57:59.867619+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:57:59.867619+0000","last_undegraded":"2024-09-10T05:57:59.867619+0000","last_fullsized":"2024-09-10T05:57:59.867619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"99'116","reported_seq":298,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828533+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:58:00.828533+0000","last_peered":"2024-09-10T05:58:00.828533+0000","last_clean":"2024-09-10T05:58:00.828533+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:58:00.828533+0000","last_undegraded":"2024-09-10T05:58:00.828533+0000","last_fullsized":"2024-09-10T05:58:00.828533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814831+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:57:59.814831+0000","last_peered":"2024-09-10T05:57:59.814831+0000","last_clean":"2024-09-10T05:57:59.814831+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:57:59.814831+0000","last_undegraded":"2024-09-10T05:57:59.814831+0000","last_fullsized":"2024-09-10T05:57:59.814831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":88,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829630+0000","last_change":"2024-09-10T05:57:34.946714+0000","last_active":"2024-09-10T05:58:00.829630+0000","last_peered":"2024-09-10T05:58:00.829630+0000","last_clean":"2024-09-10T05:58:00.829630+0000","last_became_active":"2024-09-10T05:57:34.908606+0000","last_became_peered":"2024-09-10T05:57:34.908606+0000","last_unstale":"2024-09-10T05:58:00.829630+0000","last_undegraded":"2024-09-10T05:58:00.829630+0000","last_fullsized":"2024-09-10T05:58:00.829630+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.316724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"101'10","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830132+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:58:00.830132+0000","last_peered":"2024-09-10T05:58:00.830132+0000","last_clean":"2024-09-10T05:58:00.830132+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:58:00.830132+0000","last_undegraded":"2024-09-10T05:58:00.830132+0000","last_fullsized":"2024-09-10T05:58:00.830132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.816027+0000","last_change":"2024-09-10T05:57:34.893355+0000","last_active":"2024-09-10T05:58:00.816027+0000","last_peered":"2024-09-10T05:58:00.816027+0000","last_clean":"2024-09-10T05:58:00.816027+0000","last_became_active":"2024-09-10T05:57:34.892405+0000","last_became_peered":"2024-09-10T05:57:34.892405+0000","last_unstale":"2024-09-10T05:58:00.816027+0000","last_undegraded":"2024-09-10T05:58:00.816027+0000","last_fullsized":"2024-09-10T05:58:00.816027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:37.620977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"94'21","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828773+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:58:00.828773+0000","last_peered":"2024-09-10T05:58:00.828773+0000","last_clean":"2024-09-10T05:58:00.828773+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:58:00.828773+0000","last_undegraded":"2024-09-10T05:58:00.828773+0000","last_fullsized":"2024-09-10T05:58:00.828773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"99'121","reported_seq":247,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867528+0000","last_change":"2024-09-10T05:57:37.914832+0000","last_active":"2024-09-10T05:57:59.867528+0000","last_peered":"2024-09-10T05:57:59.867528+0000","last_clean":"2024-09-10T05:57:59.867528+0000","last_became_active":"2024-09-10T05:57:37.914041+0000","last_became_peered":"2024-09-10T05:57:37.914041+0000","last_unstale":"2024-09-10T05:57:59.867528+0000","last_undegraded":"2024-09-10T05:57:59.867528+0000","last_fullsized":"2024-09-10T05:57:59.867528+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:16.655964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.812190+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:58:00.812190+0000","last_peered":"2024-09-10T05:58:00.812190+0000","last_clean":"2024-09-10T05:58:00.812190+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:58:00.812190+0000","last_undegraded":"2024-09-10T05:58:00.812190+0000","last_fullsized":"2024-09-10T05:58:00.812190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"100'12","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830169+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:58:00.830169+0000","last_peered":"2024-09-10T05:58:00.830169+0000","last_clean":"2024-09-10T05:58:00.830169+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:58:00.830169+0000","last_undegraded":"2024-09-10T05:58:00.830169+0000","last_fullsized":"2024-09-10T05:58:00.830169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826218+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:58:00.826218+0000","last_peered":"2024-09-10T05:58:00.826218+0000","last_clean":"2024-09-10T05:58:00.826218+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:58:00.826218+0000","last_undegraded":"2024-09-10T05:58:00.826218+0000","last_fullsized":"2024-09-10T05:58:00.826218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"94'33","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811485+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:58:00.811485+0000","last_peered":"2024-09-10T05:58:00.811485+0000","last_clean":"2024-09-10T05:58:00.811485+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:58:00.811485+0000","last_undegraded":"2024-09-10T05:58:00.811485+0000","last_fullsized":"2024-09-10T05:58:00.811485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823485+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:57:59.823485+0000","last_peered":"2024-09-10T05:57:59.823485+0000","last_clean":"2024-09-10T05:57:59.823485+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:57:59.823485+0000","last_undegraded":"2024-09-10T05:57:59.823485+0000","last_fullsized":"2024-09-10T05:57:59.823485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813303+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:58:00.813303+0000","last_peered":"2024-09-10T05:58:00.813303+0000","last_clean":"2024-09-10T05:58:00.813303+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:58:00.813303+0000","last_undegraded":"2024-09-10T05:58:00.813303+0000","last_fullsized":"2024-09-10T05:58:00.813303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814427+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:57:59.814427+0000","last_peered":"2024-09-10T05:57:59.814427+0000","last_clean":"2024-09-10T05:57:59.814427+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:57:59.814427+0000","last_undegraded":"2024-09-10T05:57:59.814427+0000","last_fullsized":"2024-09-10T05:57:59.814427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'10","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829629+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:58:00.829629+0000","last_peered":"2024-09-10T05:58:00.829629+0000","last_clean":"2024-09-10T05:58:00.829629+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:58:00.829629+0000","last_undegraded":"2024-09-10T05:58:00.829629+0000","last_fullsized":"2024-09-10T05:58:00.829629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866012+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:57:59.866012+0000","last_peered":"2024-09-10T05:57:59.866012+0000","last_clean":"2024-09-10T05:57:59.866012+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:57:59.866012+0000","last_undegraded":"2024-09-10T05:57:59.866012+0000","last_fullsized":"2024-09-10T05:57:59.866012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"94'21","reported_seq":155,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827219+0000","last_change":"2024-09-10T05:57:35.494490+0000","last_active":"2024-09-10T05:58:00.827219+0000","last_peered":"2024-09-10T05:58:00.827219+0000","last_clean":"2024-09-10T05:58:00.827219+0000","last_became_active":"2024-09-10T05:57:34.931995+0000","last_became_peered":"2024-09-10T05:57:34.931995+0000","last_unstale":"2024-09-10T05:58:00.827219+0000","last_undegraded":"2024-09-10T05:58:00.827219+0000","last_fullsized":"2024-09-10T05:58:00.827219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:45.082878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":81,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866503+0000","last_change":"2024-09-10T05:57:34.877382+0000","last_active":"2024-09-10T05:57:59.866503+0000","last_peered":"2024-09-10T05:57:59.866503+0000","last_clean":"2024-09-10T05:57:59.866503+0000","last_became_active":"2024-09-10T05:57:34.877017+0000","last_became_peered":"2024-09-10T05:57:34.877017+0000","last_unstale":"2024-09-10T05:57:59.866503+0000","last_undegraded":"2024-09-10T05:57:59.866503+0000","last_fullsized":"2024-09-10T05:57:59.866503+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:04.862334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":153,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829113+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:58:00.829113+0000","last_peered":"2024-09-10T05:58:00.829113+0000","last_clean":"2024-09-10T05:58:00.829113+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:58:00.829113+0000","last_undegraded":"2024-09-10T05:58:00.829113+0000","last_fullsized":"2024-09-10T05:58:00.829113+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828712+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:58:00.828712+0000","last_peered":"2024-09-10T05:58:00.828712+0000","last_clean":"2024-09-10T05:58:00.828712+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:58:00.828712+0000","last_undegraded":"2024-09-10T05:58:00.828712+0000","last_fullsized":"2024-09-10T05:58:00.828712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"102'16","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829470+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:58:00.829470+0000","last_peered":"2024-09-10T05:58:00.829470+0000","last_clean":"2024-09-10T05:58:00.829470+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:58:00.829470+0000","last_undegraded":"2024-09-10T05:58:00.829470+0000","last_fullsized":"2024-09-10T05:58:00.829470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867228+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:57:59.867228+0000","last_peered":"2024-09-10T05:57:59.867228+0000","last_clean":"2024-09-10T05:57:59.867228+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:57:59.867228+0000","last_undegraded":"2024-09-10T05:57:59.867228+0000","last_fullsized":"2024-09-10T05:57:59.867228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"94'33","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826779+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:58:00.826779+0000","last_peered":"2024-09-10T05:58:00.826779+0000","last_clean":"2024-09-10T05:58:00.826779+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:58:00.826779+0000","last_undegraded":"2024-09-10T05:58:00.826779+0000","last_fullsized":"2024-09-10T05:58:00.826779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"99'116","reported_seq":373,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.806688+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:57:59.806688+0000","last_peered":"2024-09-10T05:57:59.806688+0000","last_clean":"2024-09-10T05:57:59.806688+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:57:59.806688+0000","last_undegraded":"2024-09-10T05:57:59.806688+0000","last_fullsized":"2024-09-10T05:57:59.806688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809596+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:57:59.809596+0000","last_peered":"2024-09-10T05:57:59.809596+0000","last_clean":"2024-09-10T05:57:59.809596+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:57:59.809596+0000","last_undegraded":"2024-09-10T05:57:59.809596+0000","last_fullsized":"2024-09-10T05:57:59.809596+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809277+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:57:59.809277+0000","last_peered":"2024-09-10T05:57:59.809277+0000","last_clean":"2024-09-10T05:57:59.809277+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:57:59.809277+0000","last_undegraded":"2024-09-10T05:57:59.809277+0000","last_fullsized":"2024-09-10T05:57:59.809277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"101'5","reported_seq":89,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867431+0000","last_change":"2024-09-10T05:57:35.045833+0000","last_active":"2024-09-10T05:57:59.867431+0000","last_peered":"2024-09-10T05:57:59.867431+0000","last_clean":"2024-09-10T05:57:59.867431+0000","last_became_active":"2024-09-10T05:57:34.919525+0000","last_became_peered":"2024-09-10T05:57:34.919525+0000","last_unstale":"2024-09-10T05:57:59.867431+0000","last_undegraded":"2024-09-10T05:57:59.867431+0000","last_fullsized":"2024-09-10T05:57:59.867431+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:31.924974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866710+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:57:59.866710+0000","last_peered":"2024-09-10T05:57:59.866710+0000","last_clean":"2024-09-10T05:57:59.866710+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:57:59.866710+0000","last_undegraded":"2024-09-10T05:57:59.866710+0000","last_fullsized":"2024-09-10T05:57:59.866710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"94'36","reported_seq":212,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808206+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:57:59.808206+0000","last_peered":"2024-09-10T05:57:59.808206+0000","last_clean":"2024-09-10T05:57:59.808206+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:57:59.808206+0000","last_undegraded":"2024-09-10T05:57:59.808206+0000","last_fullsized":"2024-09-10T05:57:59.808206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.865882+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:57:59.865882+0000","last_peered":"2024-09-10T05:57:59.865882+0000","last_clean":"2024-09-10T05:57:59.865882+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:57:59.865882+0000","last_undegraded":"2024-09-10T05:57:59.865882+0000","last_fullsized":"2024-09-10T05:57:59.865882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"80'4","reported_seq":190,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.833781+0000","last_change":"2024-09-10T05:57:35.929283+0000","last_active":"2024-09-10T05:57:59.833781+0000","last_peered":"2024-09-10T05:57:59.833781+0000","last_clean":"2024-09-10T05:57:59.833781+0000","last_became_active":"2024-09-10T05:57:34.909075+0000","last_became_peered":"2024-09-10T05:57:34.909075+0000","last_unstale":"2024-09-10T05:57:59.833781+0000","last_undegraded":"2024-09-10T05:57:59.833781+0000","last_fullsized":"2024-09-10T05:57:59.833781+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:12.213324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815170+0000","last_change":"2024-09-10T05:57:35.640722+0000","last_active":"2024-09-10T05:57:59.815170+0000","last_peered":"2024-09-10T05:57:59.815170+0000","last_clean":"2024-09-10T05:57:59.815170+0000","last_became_active":"2024-09-10T05:57:34.919490+0000","last_became_peered":"2024-09-10T05:57:34.919490+0000","last_unstale":"2024-09-10T05:57:59.815170+0000","last_undegraded":"2024-09-10T05:57:59.815170+0000","last_fullsized":"2024-09-10T05:57:59.815170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:58.622866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"102'11","reported_seq":86,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.953846+0000","last_change":"2024-09-10T05:57:35.950376+0000","last_active":"2024-09-10T05:57:59.953846+0000","last_peered":"2024-09-10T05:57:59.953846+0000","last_clean":"2024-09-10T05:57:59.953846+0000","last_became_active":"2024-09-10T05:57:34.907835+0000","last_became_peered":"2024-09-10T05:57:34.907835+0000","last_unstale":"2024-09-10T05:57:59.953846+0000","last_undegraded":"2024-09-10T05:57:59.953846+0000","last_fullsized":"2024-09-10T05:57:59.953846+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:54.430770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.868308+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:57:59.868308+0000","last_peered":"2024-09-10T05:57:59.868308+0000","last_clean":"2024-09-10T05:57:59.868308+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:57:59.868308+0000","last_undegraded":"2024-09-10T05:57:59.868308+0000","last_fullsized":"2024-09-10T05:57:59.868308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"94'25","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816521+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:57:59.816521+0000","last_peered":"2024-09-10T05:57:59.816521+0000","last_clean":"2024-09-10T05:57:59.816521+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:57:59.816521+0000","last_undegraded":"2024-09-10T05:57:59.816521+0000","last_fullsized":"2024-09-10T05:57:59.816521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809984+0000","last_change":"2024-09-10T05:57:34.916181+0000","last_active":"2024-09-10T05:57:59.809984+0000","last_peered":"2024-09-10T05:57:59.809984+0000","last_clean":"2024-09-10T05:57:59.809984+0000","last_became_active":"2024-09-10T05:57:34.915779+0000","last_became_peered":"2024-09-10T05:57:34.915779+0000","last_unstale":"2024-09-10T05:57:59.809984+0000","last_undegraded":"2024-09-10T05:57:59.809984+0000","last_fullsized":"2024-09-10T05:57:59.809984+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:13.675508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":64,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811583+0000","last_change":"2024-09-10T05:57:35.777709+0000","last_active":"2024-09-10T05:58:00.811583+0000","last_peered":"2024-09-10T05:58:00.811583+0000","last_clean":"2024-09-10T05:58:00.811583+0000","last_became_active":"2024-09-10T05:57:34.902280+0000","last_became_peered":"2024-09-10T05:57:34.902280+0000","last_unstale":"2024-09-10T05:58:00.811583+0000","last_undegraded":"2024-09-10T05:58:00.811583+0000","last_fullsized":"2024-09-10T05:58:00.811583+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:18.492594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816688+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:57:59.816688+0000","last_peered":"2024-09-10T05:57:59.816688+0000","last_clean":"2024-09-10T05:57:59.816688+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:57:59.816688+0000","last_undegraded":"2024-09-10T05:57:59.816688+0000","last_fullsized":"2024-09-10T05:57:59.816688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"102'15","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828920+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:58:00.828920+0000","last_peered":"2024-09-10T05:58:00.828920+0000","last_clean":"2024-09-10T05:58:00.828920+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:58:00.828920+0000","last_undegraded":"2024-09-10T05:58:00.828920+0000","last_fullsized":"2024-09-10T05:58:00.828920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823222+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:57:59.823222+0000","last_peered":"2024-09-10T05:57:59.823222+0000","last_clean":"2024-09-10T05:57:59.823222+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:57:59.823222+0000","last_undegraded":"2024-09-10T05:57:59.823222+0000","last_fullsized":"2024-09-10T05:57:59.823222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"94'21","reported_seq":250,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.868331+0000","last_change":"2024-09-10T05:57:34.963269+0000","last_active":"2024-09-10T05:57:59.868331+0000","last_peered":"2024-09-10T05:57:59.868331+0000","last_clean":"2024-09-10T05:57:59.868331+0000","last_became_active":"2024-09-10T05:57:34.888062+0000","last_became_peered":"2024-09-10T05:57:34.888062+0000","last_unstale":"2024-09-10T05:57:59.868331+0000","last_undegraded":"2024-09-10T05:57:59.868331+0000","last_fullsized":"2024-09-10T05:57:59.868331+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:51.888618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"99'116","reported_seq":307,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867718+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:57:59.867718+0000","last_peered":"2024-09-10T05:57:59.867718+0000","last_clean":"2024-09-10T05:57:59.867718+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:57:59.867718+0000","last_undegraded":"2024-09-10T05:57:59.867718+0000","last_fullsized":"2024-09-10T05:57:59.867718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822751+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:57:59.822751+0000","last_peered":"2024-09-10T05:57:59.822751+0000","last_clean":"2024-09-10T05:57:59.822751+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:57:59.822751+0000","last_undegraded":"2024-09-10T05:57:59.822751+0000","last_fullsized":"2024-09-10T05:57:59.822751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"74'2","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.817147+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:57:59.817147+0000","last_peered":"2024-09-10T05:57:59.817147+0000","last_clean":"2024-09-10T05:57:59.817147+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:57:59.817147+0000","last_undegraded":"2024-09-10T05:57:59.817147+0000","last_fullsized":"2024-09-10T05:57:59.817147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"101'15","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815595+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:57:59.815595+0000","last_peered":"2024-09-10T05:57:59.815595+0000","last_clean":"2024-09-10T05:57:59.815595+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:57:59.815595+0000","last_undegraded":"2024-09-10T05:57:59.815595+0000","last_fullsized":"2024-09-10T05:57:59.815595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":315,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.817706+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:58:00.817706+0000","last_peered":"2024-09-10T05:58:00.817706+0000","last_clean":"2024-09-10T05:58:00.817706+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:58:00.817706+0000","last_undegraded":"2024-09-10T05:58:00.817706+0000","last_fullsized":"2024-09-10T05:58:00.817706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":154,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":140,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827645+0000","last_change":"2024-09-10T05:57:35.162977+0000","last_active":"2024-09-10T05:58:00.827645+0000","last_peered":"2024-09-10T05:58:00.827645+0000","last_clean":"2024-09-10T05:58:00.827645+0000","last_became_active":"2024-09-10T05:57:34.906841+0000","last_became_peered":"2024-09-10T05:57:34.906841+0000","last_unstale":"2024-09-10T05:58:00.827645+0000","last_undegraded":"2024-09-10T05:58:00.827645+0000","last_fullsized":"2024-09-10T05:58:00.827645+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:30.492886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"99'116","reported_seq":339,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829313+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:58:00.829313+0000","last_peered":"2024-09-10T05:58:00.829313+0000","last_clean":"2024-09-10T05:58:00.829313+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:58:00.829313+0000","last_undegraded":"2024-09-10T05:58:00.829313+0000","last_fullsized":"2024-09-10T05:58:00.829313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815115+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:57:59.815115+0000","last_peered":"2024-09-10T05:57:59.815115+0000","last_clean":"2024-09-10T05:57:59.815115+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:57:59.815115+0000","last_undegraded":"2024-09-10T05:57:59.815115+0000","last_fullsized":"2024-09-10T05:57:59.815115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.844868+0000","last_change":"2024-09-10T05:58:00.843197+0000","last_active":"2024-09-10T05:58:00.844868+0000","last_peered":"2024-09-10T05:58:00.844868+0000","last_clean":"2024-09-10T05:58:00.844868+0000","last_became_active":"2024-09-10T05:58:00.820024+0000","last_became_peered":"2024-09-10T05:58:00.820024+0000","last_unstale":"2024-09-10T05:58:00.844868+0000","last_undegraded":"2024-09-10T05:58:00.844868+0000","last_fullsized":"2024-09-10T05:58:00.844868+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:58.926783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"102'11","reported_seq":92,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822650+0000","last_change":"2024-09-10T05:57:36.057179+0000","last_active":"2024-09-10T05:57:59.822650+0000","last_peered":"2024-09-10T05:57:59.822650+0000","last_clean":"2024-09-10T05:57:59.822650+0000","last_became_active":"2024-09-10T05:57:34.927921+0000","last_became_peered":"2024-09-10T05:57:34.927921+0000","last_unstale":"2024-09-10T05:57:59.822650+0000","last_undegraded":"2024-09-10T05:57:59.822650+0000","last_fullsized":"2024-09-10T05:57:59.822650+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:43.123119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816863+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:57:59.816863+0000","last_peered":"2024-09-10T05:57:59.816863+0000","last_clean":"2024-09-10T05:57:59.816863+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:57:59.816863+0000","last_undegraded":"2024-09-10T05:57:59.816863+0000","last_fullsized":"2024-09-10T05:57:59.816863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"94'23","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.815149+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:58:00.815149+0000","last_peered":"2024-09-10T05:58:00.815149+0000","last_clean":"2024-09-10T05:58:00.815149+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:58:00.815149+0000","last_undegraded":"2024-09-10T05:58:00.815149+0000","last_fullsized":"2024-09-10T05:58:00.815149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":169,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827288+0000","last_change":"2024-09-10T05:57:34.930017+0000","last_active":"2024-09-10T05:58:00.827288+0000","last_peered":"2024-09-10T05:58:00.827288+0000","last_clean":"2024-09-10T05:58:00.827288+0000","last_became_active":"2024-09-10T05:57:34.929436+0000","last_became_peered":"2024-09-10T05:57:34.929436+0000","last_unstale":"2024-09-10T05:58:00.827288+0000","last_undegraded":"2024-09-10T05:58:00.827288+0000","last_fullsized":"2024-09-10T05:58:00.827288+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:48.878767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823452+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:57:59.823452+0000","last_peered":"2024-09-10T05:57:59.823452+0000","last_clean":"2024-09-10T05:57:59.823452+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:57:59.823452+0000","last_undegraded":"2024-09-10T05:57:59.823452+0000","last_fullsized":"2024-09-10T05:57:59.823452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'6","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829597+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:58:00.829597+0000","last_peered":"2024-09-10T05:58:00.829597+0000","last_clean":"2024-09-10T05:58:00.829597+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:58:00.829597+0000","last_undegraded":"2024-09-10T05:58:00.829597+0000","last_fullsized":"2024-09-10T05:58:00.829597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":273,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827008+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:58:00.827008+0000","last_peered":"2024-09-10T05:58:00.827008+0000","last_clean":"2024-09-10T05:58:00.827008+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:58:00.827008+0000","last_undegraded":"2024-09-10T05:58:00.827008+0000","last_fullsized":"2024-09-10T05:58:00.827008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.812490+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:58:00.812490+0000","last_peered":"2024-09-10T05:58:00.812490+0000","last_clean":"2024-09-10T05:58:00.812490+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:58:00.812490+0000","last_undegraded":"2024-09-10T05:58:00.812490+0000","last_fullsized":"2024-09-10T05:58:00.812490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"103'9","reported_seq":87,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813213+0000","last_change":"2024-09-10T05:57:35.883007+0000","last_active":"2024-09-10T05:58:00.813213+0000","last_peered":"2024-09-10T05:58:00.813213+0000","last_clean":"2024-09-10T05:58:00.813213+0000","last_became_active":"2024-09-10T05:57:34.908343+0000","last_became_peered":"2024-09-10T05:57:34.908343+0000","last_unstale":"2024-09-10T05:58:00.813213+0000","last_undegraded":"2024-09-10T05:58:00.813213+0000","last_fullsized":"2024-09-10T05:58:00.813213+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:18.440590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828408+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:58:00.828408+0000","last_peered":"2024-09-10T05:58:00.828408+0000","last_clean":"2024-09-10T05:58:00.828408+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:58:00.828408+0000","last_undegraded":"2024-09-10T05:58:00.828408+0000","last_fullsized":"2024-09-10T05:58:00.828408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"94'37","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.818208+0000","last_change":"2024-09-10T05:57:35.628497+0000","last_active":"2024-09-10T05:58:00.818208+0000","last_peered":"2024-09-10T05:58:00.818208+0000","last_clean":"2024-09-10T05:58:00.818208+0000","last_became_active":"2024-09-10T05:57:34.892383+0000","last_became_peered":"2024-09-10T05:57:34.892383+0000","last_unstale":"2024-09-10T05:58:00.818208+0000","last_undegraded":"2024-09-10T05:58:00.818208+0000","last_fullsized":"2024-09-10T05:58:00.818208+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:53.650316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809696+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:57:59.809696+0000","last_peered":"2024-09-10T05:57:59.809696+0000","last_clean":"2024-09-10T05:57:59.809696+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:57:59.809696+0000","last_undegraded":"2024-09-10T05:57:59.809696+0000","last_fullsized":"2024-09-10T05:57:59.809696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":147,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826916+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:58:00.826916+0000","last_peered":"2024-09-10T05:58:00.826916+0000","last_clean":"2024-09-10T05:58:00.826916+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:58:00.826916+0000","last_undegraded":"2024-09-10T05:58:00.826916+0000","last_fullsized":"2024-09-10T05:58:00.826916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809852+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:57:59.809852+0000","last_peered":"2024-09-10T05:57:59.809852+0000","last_clean":"2024-09-10T05:57:59.809852+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:57:59.809852+0000","last_undegraded":"2024-09-10T05:57:59.809852+0000","last_fullsized":"2024-09-10T05:57:59.809852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826576+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:58:00.826576+0000","last_peered":"2024-09-10T05:58:00.826576+0000","last_clean":"2024-09-10T05:58:00.826576+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:58:00.826576+0000","last_undegraded":"2024-09-10T05:58:00.826576+0000","last_fullsized":"2024-09-10T05:58:00.826576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"101'10","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808319+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:57:59.808319+0000","last_peered":"2024-09-10T05:57:59.808319+0000","last_clean":"2024-09-10T05:57:59.808319+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:57:59.808319+0000","last_undegraded":"2024-09-10T05:57:59.808319+0000","last_fullsized":"2024-09-10T05:57:59.808319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.818580+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:58:00.818580+0000","last_peered":"2024-09-10T05:58:00.818580+0000","last_clean":"2024-09-10T05:58:00.818580+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:58:00.818580+0000","last_undegraded":"2024-09-10T05:58:00.818580+0000","last_fullsized":"2024-09-10T05:58:00.818580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"99'124","reported_seq":369,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823071+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:57:59.823071+0000","last_peered":"2024-09-10T05:57:59.823071+0000","last_clean":"2024-09-10T05:57:59.823071+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:57:59.823071+0000","last_undegraded":"2024-09-10T05:57:59.823071+0000","last_fullsized":"2024-09-10T05:57:59.823071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":167,"num_read_kb":151,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828538+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:58:00.828538+0000","last_peered":"2024-09-10T05:58:00.828538+0000","last_clean":"2024-09-10T05:58:00.828538+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:58:00.828538+0000","last_undegraded":"2024-09-10T05:58:00.828538+0000","last_fullsized":"2024-09-10T05:58:00.828538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822656+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:57:59.822656+0000","last_peered":"2024-09-10T05:57:59.822656+0000","last_clean":"2024-09-10T05:57:59.822656+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:57:59.822656+0000","last_undegraded":"2024-09-10T05:57:59.822656+0000","last_fullsized":"2024-09-10T05:57:59.822656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"99'3","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.834145+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:57:59.834145+0000","last_peered":"2024-09-10T05:57:59.834145+0000","last_clean":"2024-09-10T05:57:59.834145+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:57:59.834145+0000","last_undegraded":"2024-09-10T05:57:59.834145+0000","last_fullsized":"2024-09-10T05:57:59.834145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866388+0000","last_change":"2024-09-10T05:57:34.879758+0000","last_active":"2024-09-10T05:57:59.866388+0000","last_peered":"2024-09-10T05:57:59.866388+0000","last_clean":"2024-09-10T05:57:59.866388+0000","last_became_active":"2024-09-10T05:57:34.879405+0000","last_became_peered":"2024-09-10T05:57:34.879405+0000","last_unstale":"2024-09-10T05:57:59.866388+0000","last_undegraded":"2024-09-10T05:57:59.866388+0000","last_fullsized":"2024-09-10T05:57:59.866388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:45.727145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"102'12","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822729+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:57:59.822729+0000","last_peered":"2024-09-10T05:57:59.822729+0000","last_clean":"2024-09-10T05:57:59.822729+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:57:59.822729+0000","last_undegraded":"2024-09-10T05:57:59.822729+0000","last_fullsized":"2024-09-10T05:57:59.822729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867913+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:57:59.867913+0000","last_peered":"2024-09-10T05:57:59.867913+0000","last_clean":"2024-09-10T05:57:59.867913+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:57:59.867913+0000","last_undegraded":"2024-09-10T05:57:59.867913+0000","last_fullsized":"2024-09-10T05:57:59.867913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829030+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:58:00.829030+0000","last_peered":"2024-09-10T05:58:00.829030+0000","last_clean":"2024-09-10T05:58:00.829030+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:58:00.829030+0000","last_undegraded":"2024-09-10T05:58:00.829030+0000","last_fullsized":"2024-09-10T05:58:00.829030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807834+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:57:59.807834+0000","last_peered":"2024-09-10T05:57:59.807834+0000","last_clean":"2024-09-10T05:57:59.807834+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:57:59.807834+0000","last_undegraded":"2024-09-10T05:57:59.807834+0000","last_fullsized":"2024-09-10T05:57:59.807834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":80,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815958+0000","last_change":"2024-09-10T05:57:34.893576+0000","last_active":"2024-09-10T05:57:59.815958+0000","last_peered":"2024-09-10T05:57:59.815958+0000","last_clean":"2024-09-10T05:57:59.815958+0000","last_became_active":"2024-09-10T05:57:34.892769+0000","last_became_peered":"2024-09-10T05:57:34.892769+0000","last_unstale":"2024-09-10T05:57:59.815958+0000","last_undegraded":"2024-09-10T05:57:59.815958+0000","last_fullsized":"2024-09-10T05:57:59.815958+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:55.028842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"99'5","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.828962+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:57:59.828962+0000","last_peered":"2024-09-10T05:57:59.828962+0000","last_clean":"2024-09-10T05:57:59.828962+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:57:59.828962+0000","last_undegraded":"2024-09-10T05:57:59.828962+0000","last_fullsized":"2024-09-10T05:57:59.828962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.814674+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:58:00.814674+0000","last_peered":"2024-09-10T05:58:00.814674+0000","last_clean":"2024-09-10T05:58:00.814674+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:58:00.814674+0000","last_undegraded":"2024-09-10T05:58:00.814674+0000","last_fullsized":"2024-09-10T05:58:00.814674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"101'17","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816224+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:57:59.816224+0000","last_peered":"2024-09-10T05:57:59.816224+0000","last_clean":"2024-09-10T05:57:59.816224+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:57:59.816224+0000","last_undegraded":"2024-09-10T05:57:59.816224+0000","last_fullsized":"2024-09-10T05:57:59.816224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808154+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:57:59.808154+0000","last_peered":"2024-09-10T05:57:59.808154+0000","last_clean":"2024-09-10T05:57:59.808154+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:57:59.808154+0000","last_undegraded":"2024-09-10T05:57:59.808154+0000","last_fullsized":"2024-09-10T05:57:59.808154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.817296+0000","last_change":"2024-09-10T05:57:35.674003+0000","last_active":"2024-09-10T05:57:59.817296+0000","last_peered":"2024-09-10T05:57:59.817296+0000","last_clean":"2024-09-10T05:57:59.817296+0000","last_became_active":"2024-09-10T05:57:34.928379+0000","last_became_peered":"2024-09-10T05:57:34.928379+0000","last_unstale":"2024-09-10T05:57:59.817296+0000","last_undegraded":"2024-09-10T05:57:59.817296+0000","last_fullsized":"2024-09-10T05:57:59.817296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:42.557315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830791+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:58:00.830791+0000","last_peered":"2024-09-10T05:58:00.830791+0000","last_clean":"2024-09-10T05:58:00.830791+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:58:00.830791+0000","last_undegraded":"2024-09-10T05:58:00.830791+0000","last_fullsized":"2024-09-10T05:58:00.830791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811304+0000","last_change":"2024-09-10T05:57:35.896721+0000","last_active":"2024-09-10T05:58:00.811304+0000","last_peered":"2024-09-10T05:58:00.811304+0000","last_clean":"2024-09-10T05:58:00.811304+0000","last_became_active":"2024-09-10T05:57:34.929520+0000","last_became_peered":"2024-09-10T05:57:34.929520+0000","last_unstale":"2024-09-10T05:58:00.811304+0000","last_undegraded":"2024-09-10T05:58:00.811304+0000","last_fullsized":"2024-09-10T05:58:00.811304+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:43.505133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"99'1","reported_seq":127,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866448+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:57:59.866448+0000","last_peered":"2024-09-10T05:57:59.866448+0000","last_clean":"2024-09-10T05:57:59.866448+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:57:59.866448+0000","last_undegraded":"2024-09-10T05:57:59.866448+0000","last_fullsized":"2024-09-10T05:57:59.866448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"102'13","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.816004+0000","last_change":"2024-09-10T05:57:34.944169+0000","last_active":"2024-09-10T05:58:00.816004+0000","last_peered":"2024-09-10T05:58:00.816004+0000","last_clean":"2024-09-10T05:58:00.816004+0000","last_became_active":"2024-09-10T05:57:34.881090+0000","last_became_peered":"2024-09-10T05:57:34.881090+0000","last_unstale":"2024-09-10T05:58:00.816004+0000","last_undegraded":"2024-09-10T05:58:00.816004+0000","last_fullsized":"2024-09-10T05:58:00.816004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:28.724387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.829278+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:57:59.829278+0000","last_peered":"2024-09-10T05:57:59.829278+0000","last_clean":"2024-09-10T05:57:59.829278+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:57:59.829278+0000","last_undegraded":"2024-09-10T05:57:59.829278+0000","last_fullsized":"2024-09-10T05:57:59.829278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":235,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808676+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:57:59.808676+0000","last_peered":"2024-09-10T05:57:59.808676+0000","last_clean":"2024-09-10T05:57:59.808676+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:57:59.808676+0000","last_undegraded":"2024-09-10T05:57:59.808676+0000","last_fullsized":"2024-09-10T05:57:59.808676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"94'43","reported_seq":306,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.806993+0000","last_change":"2024-09-10T05:57:34.972762+0000","last_active":"2024-09-10T05:57:59.806993+0000","last_peered":"2024-09-10T05:57:59.806993+0000","last_clean":"2024-09-10T05:57:59.806993+0000","last_became_active":"2024-09-10T05:57:34.888347+0000","last_became_peered":"2024-09-10T05:57:34.888347+0000","last_unstale":"2024-09-10T05:57:59.806993+0000","last_undegraded":"2024-09-10T05:57:59.806993+0000","last_fullsized":"2024-09-10T05:57:59.806993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:17.235444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":660,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.813941+0000","last_change":"2024-09-10T05:57:34.907745+0000","last_active":"2024-09-10T05:57:59.813941+0000","last_peered":"2024-09-10T05:57:59.813941+0000","last_clean":"2024-09-10T05:57:59.813941+0000","last_became_active":"2024-09-10T05:57:34.907115+0000","last_became_peered":"2024-09-10T05:57:34.907115+0000","last_unstale":"2024-09-10T05:57:59.813941+0000","last_undegraded":"2024-09-10T05:57:59.813941+0000","last_fullsized":"2024-09-10T05:57:59.813941+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:22.411611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807653+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:57:59.807653+0000","last_peered":"2024-09-10T05:57:59.807653+0000","last_clean":"2024-09-10T05:57:59.807653+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:57:59.807653+0000","last_undegraded":"2024-09-10T05:57:59.807653+0000","last_fullsized":"2024-09-10T05:57:59.807653+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809177+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:57:59.809177+0000","last_peered":"2024-09-10T05:57:59.809177+0000","last_clean":"2024-09-10T05:57:59.809177+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:57:59.809177+0000","last_undegraded":"2024-09-10T05:57:59.809177+0000","last_fullsized":"2024-09-10T05:57:59.809177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"101'17","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.829072+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:57:59.829072+0000","last_peered":"2024-09-10T05:57:59.829072+0000","last_clean":"2024-09-10T05:57:59.829072+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:57:59.829072+0000","last_undegraded":"2024-09-10T05:57:59.829072+0000","last_fullsized":"2024-09-10T05:57:59.829072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830119+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:58:00.830119+0000","last_peered":"2024-09-10T05:58:00.830119+0000","last_clean":"2024-09-10T05:58:00.830119+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:58:00.830119+0000","last_undegraded":"2024-09-10T05:58:00.830119+0000","last_fullsized":"2024-09-10T05:58:00.830119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828344+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:58:00.828344+0000","last_peered":"2024-09-10T05:58:00.828344+0000","last_clean":"2024-09-10T05:58:00.828344+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:58:00.828344+0000","last_undegraded":"2024-09-10T05:58:00.828344+0000","last_fullsized":"2024-09-10T05:58:00.828344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822508+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:57:59.822508+0000","last_peered":"2024-09-10T05:57:59.822508+0000","last_clean":"2024-09-10T05:57:59.822508+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:57:59.822508+0000","last_undegraded":"2024-09-10T05:57:59.822508+0000","last_fullsized":"2024-09-10T05:57:59.822508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"99'116","reported_seq":297,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811811+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:58:00.811811+0000","last_peered":"2024-09-10T05:58:00.811811+0000","last_clean":"2024-09-10T05:58:00.811811+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:58:00.811811+0000","last_undegraded":"2024-09-10T05:58:00.811811+0000","last_fullsized":"2024-09-10T05:58:00.811811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":93,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.868465+0000","last_change":"2024-09-10T05:57:34.976289+0000","last_active":"2024-09-10T05:57:59.868465+0000","last_peered":"2024-09-10T05:57:59.868465+0000","last_clean":"2024-09-10T05:57:59.868465+0000","last_became_active":"2024-09-10T05:57:34.897502+0000","last_became_peered":"2024-09-10T05:57:34.897502+0000","last_unstale":"2024-09-10T05:57:59.868465+0000","last_undegraded":"2024-09-10T05:57:59.868465+0000","last_fullsized":"2024-09-10T05:57:59.868465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:31:45.355247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":83,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826025+0000","last_change":"2024-09-10T05:57:34.914873+0000","last_active":"2024-09-10T05:58:00.826025+0000","last_peered":"2024-09-10T05:58:00.826025+0000","last_clean":"2024-09-10T05:58:00.826025+0000","last_became_active":"2024-09-10T05:57:34.906502+0000","last_became_peered":"2024-09-10T05:57:34.906502+0000","last_unstale":"2024-09-10T05:58:00.826025+0000","last_undegraded":"2024-09-10T05:58:00.826025+0000","last_fullsized":"2024-09-10T05:58:00.826025+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:30.677812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"102'13","reported_seq":96,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829827+0000","last_change":"2024-09-10T05:57:35.017514+0000","last_active":"2024-09-10T05:58:00.829827+0000","last_peered":"2024-09-10T05:58:00.829827+0000","last_clean":"2024-09-10T05:58:00.829827+0000","last_became_active":"2024-09-10T05:57:34.909734+0000","last_became_peered":"2024-09-10T05:57:34.909734+0000","last_unstale":"2024-09-10T05:58:00.829827+0000","last_undegraded":"2024-09-10T05:58:00.829827+0000","last_fullsized":"2024-09-10T05:58:00.829827+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:51.087678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.829515+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:57:59.829515+0000","last_peered":"2024-09-10T05:57:59.829515+0000","last_clean":"2024-09-10T05:57:59.829515+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:57:59.829515+0000","last_undegraded":"2024-09-10T05:57:59.829515+0000","last_fullsized":"2024-09-10T05:57:59.829515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814200+0000","last_change":"2024-09-10T05:57:34.928209+0000","last_active":"2024-09-10T05:57:59.814200+0000","last_peered":"2024-09-10T05:57:59.814200+0000","last_clean":"2024-09-10T05:57:59.814200+0000","last_became_active":"2024-09-10T05:57:34.927726+0000","last_became_peered":"2024-09-10T05:57:34.927726+0000","last_unstale":"2024-09-10T05:57:59.814200+0000","last_undegraded":"2024-09-10T05:57:59.814200+0000","last_fullsized":"2024-09-10T05:57:59.814200+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:32.547952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":240,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815474+0000","last_change":"2024-09-10T05:57:35.172638+0000","last_active":"2024-09-10T05:57:59.815474+0000","last_peered":"2024-09-10T05:57:59.815474+0000","last_clean":"2024-09-10T05:57:59.815474+0000","last_became_active":"2024-09-10T05:57:34.881830+0000","last_became_peered":"2024-09-10T05:57:34.881830+0000","last_unstale":"2024-09-10T05:57:59.815474+0000","last_undegraded":"2024-09-10T05:57:59.815474+0000","last_fullsized":"2024-09-10T05:57:59.815474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:27:17.353966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"99'121","reported_seq":233,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867007+0000","last_change":"2024-09-10T05:57:37.911205+0000","last_active":"2024-09-10T05:57:59.867007+0000","last_peered":"2024-09-10T05:57:59.867007+0000","last_clean":"2024-09-10T05:57:59.867007+0000","last_became_active":"2024-09-10T05:57:37.910863+0000","last_became_peered":"2024-09-10T05:57:37.910863+0000","last_unstale":"2024-09-10T05:57:59.867007+0000","last_undegraded":"2024-09-10T05:57:59.867007+0000","last_fullsized":"2024-09-10T05:57:59.867007+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:55.705820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807860+0000","last_change":"2024-09-10T05:57:34.911121+0000","last_active":"2024-09-10T05:57:59.807860+0000","last_peered":"2024-09-10T05:57:59.807860+0000","last_clean":"2024-09-10T05:57:59.807860+0000","last_became_active":"2024-09-10T05:57:34.910691+0000","last_became_peered":"2024-09-10T05:57:34.910691+0000","last_unstale":"2024-09-10T05:57:59.807860+0000","last_undegraded":"2024-09-10T05:57:59.807860+0000","last_fullsized":"2024-09-10T05:57:59.807860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:46.593321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814646+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:57:59.814646+0000","last_peered":"2024-09-10T05:57:59.814646+0000","last_clean":"2024-09-10T05:57:59.814646+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:57:59.814646+0000","last_undegraded":"2024-09-10T05:57:59.814646+0000","last_fullsized":"2024-09-10T05:57:59.814646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"101'9","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809959+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:57:59.809959+0000","last_peered":"2024-09-10T05:57:59.809959+0000","last_clean":"2024-09-10T05:57:59.809959+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:57:59.809959+0000","last_undegraded":"2024-09-10T05:57:59.809959+0000","last_fullsized":"2024-09-10T05:57:59.809959+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.831112+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:58:00.831112+0000","last_peered":"2024-09-10T05:58:00.831112+0000","last_clean":"2024-09-10T05:58:00.831112+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:58:00.831112+0000","last_undegraded":"2024-09-10T05:58:00.831112+0000","last_fullsized":"2024-09-10T05:58:00.831112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":80,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822494+0000","last_change":"2024-09-10T05:57:34.899505+0000","last_active":"2024-09-10T05:57:59.822494+0000","last_peered":"2024-09-10T05:57:59.822494+0000","last_clean":"2024-09-10T05:57:59.822494+0000","last_became_active":"2024-09-10T05:57:34.896009+0000","last_became_peered":"2024-09-10T05:57:34.896009+0000","last_unstale":"2024-09-10T05:57:59.822494+0000","last_undegraded":"2024-09-10T05:57:59.822494+0000","last_fullsized":"2024-09-10T05:57:59.822494+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:02.585400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"94'44","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826751+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:58:00.826751+0000","last_peered":"2024-09-10T05:58:00.826751+0000","last_clean":"2024-09-10T05:58:00.826751+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:58:00.826751+0000","last_undegraded":"2024-09-10T05:58:00.826751+0000","last_fullsized":"2024-09-10T05:58:00.826751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":81,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822778+0000","last_change":"2024-09-10T05:57:34.884773+0000","last_active":"2024-09-10T05:57:59.822778+0000","last_peered":"2024-09-10T05:57:59.822778+0000","last_clean":"2024-09-10T05:57:59.822778+0000","last_became_active":"2024-09-10T05:57:34.880698+0000","last_became_peered":"2024-09-10T05:57:34.880698+0000","last_unstale":"2024-09-10T05:57:59.822778+0000","last_undegraded":"2024-09-10T05:57:59.822778+0000","last_fullsized":"2024-09-10T05:57:59.822778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:21.473131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.814922+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:58:00.814922+0000","last_peered":"2024-09-10T05:58:00.814922+0000","last_clean":"2024-09-10T05:58:00.814922+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:58:00.814922+0000","last_undegraded":"2024-09-10T05:58:00.814922+0000","last_fullsized":"2024-09-10T05:58:00.814922+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809827+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:57:59.809827+0000","last_peered":"2024-09-10T05:57:59.809827+0000","last_clean":"2024-09-10T05:57:59.809827+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:57:59.809827+0000","last_undegraded":"2024-09-10T05:57:59.809827+0000","last_fullsized":"2024-09-10T05:57:59.809827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815405+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:57:59.815405+0000","last_peered":"2024-09-10T05:57:59.815405+0000","last_clean":"2024-09-10T05:57:59.815405+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:57:59.815405+0000","last_undegraded":"2024-09-10T05:57:59.815405+0000","last_fullsized":"2024-09-10T05:57:59.815405+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"101'13","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814888+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:57:59.814888+0000","last_peered":"2024-09-10T05:57:59.814888+0000","last_clean":"2024-09-10T05:57:59.814888+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:57:59.814888+0000","last_undegraded":"2024-09-10T05:57:59.814888+0000","last_fullsized":"2024-09-10T05:57:59.814888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823377+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:57:59.823377+0000","last_peered":"2024-09-10T05:57:59.823377+0000","last_clean":"2024-09-10T05:57:59.823377+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:57:59.823377+0000","last_undegraded":"2024-09-10T05:57:59.823377+0000","last_fullsized":"2024-09-10T05:57:59.823377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"94'24","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807636+0000","last_change":"2024-09-10T05:57:35.480035+0000","last_active":"2024-09-10T05:57:59.807636+0000","last_peered":"2024-09-10T05:57:59.807636+0000","last_clean":"2024-09-10T05:57:59.807636+0000","last_became_active":"2024-09-10T05:57:34.893566+0000","last_became_peered":"2024-09-10T05:57:34.893566+0000","last_unstale":"2024-09-10T05:57:59.807636+0000","last_undegraded":"2024-09-10T05:57:59.807636+0000","last_fullsized":"2024-09-10T05:57:59.807636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:56.570750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":80,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866097+0000","last_change":"2024-09-10T05:57:34.897807+0000","last_active":"2024-09-10T05:57:59.866097+0000","last_peered":"2024-09-10T05:57:59.866097+0000","last_clean":"2024-09-10T05:57:59.866097+0000","last_became_active":"2024-09-10T05:57:34.897483+0000","last_became_peered":"2024-09-10T05:57:34.897483+0000","last_unstale":"2024-09-10T05:57:59.866097+0000","last_undegraded":"2024-09-10T05:57:59.866097+0000","last_fullsized":"2024-09-10T05:57:59.866097+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:13.756785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":83,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828976+0000","last_change":"2024-09-10T05:57:34.910938+0000","last_active":"2024-09-10T05:58:00.828976+0000","last_peered":"2024-09-10T05:58:00.828976+0000","last_clean":"2024-09-10T05:58:00.828976+0000","last_became_active":"2024-09-10T05:57:34.910312+0000","last_became_peered":"2024-09-10T05:57:34.910312+0000","last_unstale":"2024-09-10T05:58:00.828976+0000","last_undegraded":"2024-09-10T05:58:00.828976+0000","last_fullsized":"2024-09-10T05:58:00.828976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:52.486420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823494+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:57:59.823494+0000","last_peered":"2024-09-10T05:57:59.823494+0000","last_clean":"2024-09-10T05:57:59.823494+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:57:59.823494+0000","last_undegraded":"2024-09-10T05:57:59.823494+0000","last_fullsized":"2024-09-10T05:57:59.823494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"102'15","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830364+0000","last_change":"2024-09-10T05:57:35.186775+0000","last_active":"2024-09-10T05:58:00.830364+0000","last_peered":"2024-09-10T05:58:00.830364+0000","last_clean":"2024-09-10T05:58:00.830364+0000","last_became_active":"2024-09-10T05:57:34.927769+0000","last_became_peered":"2024-09-10T05:57:34.927769+0000","last_unstale":"2024-09-10T05:58:00.830364+0000","last_undegraded":"2024-09-10T05:58:00.830364+0000","last_fullsized":"2024-09-10T05:58:00.830364+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:57.235556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":79,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809377+0000","last_change":"2024-09-10T05:57:34.903365+0000","last_active":"2024-09-10T05:57:59.809377+0000","last_peered":"2024-09-10T05:57:59.809377+0000","last_clean":"2024-09-10T05:57:59.809377+0000","last_became_active":"2024-09-10T05:57:34.899932+0000","last_became_peered":"2024-09-10T05:57:34.899932+0000","last_unstale":"2024-09-10T05:57:59.809377+0000","last_undegraded":"2024-09-10T05:57:59.809377+0000","last_fullsized":"2024-09-10T05:57:59.809377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.735548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.10","version":"94'8","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.806806+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:57:59.806806+0000","last_peered":"2024-09-10T05:57:59.806806+0000","last_clean":"2024-09-10T05:57:59.806806+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:57:59.806806+0000","last_undegraded":"2024-09-10T05:57:59.806806+0000","last_fullsized":"2024-09-10T05:57:59.806806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827600+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:58:00.827600+0000","last_peered":"2024-09-10T05:58:00.827600+0000","last_clean":"2024-09-10T05:58:00.827600+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:58:00.827600+0000","last_undegraded":"2024-09-10T05:58:00.827600+0000","last_fullsized":"2024-09-10T05:58:00.827600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808046+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:57:59.808046+0000","last_peered":"2024-09-10T05:57:59.808046+0000","last_clean":"2024-09-10T05:57:59.808046+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:57:59.808046+0000","last_undegraded":"2024-09-10T05:57:59.808046+0000","last_fullsized":"2024-09-10T05:57:59.808046+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":122,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826394+0000","last_change":"2024-09-10T05:57:35.504563+0000","last_active":"2024-09-10T05:58:00.826394+0000","last_peered":"2024-09-10T05:58:00.826394+0000","last_clean":"2024-09-10T05:58:00.826394+0000","last_became_active":"2024-09-10T05:57:34.932630+0000","last_became_peered":"2024-09-10T05:57:34.932630+0000","last_unstale":"2024-09-10T05:58:00.826394+0000","last_undegraded":"2024-09-10T05:58:00.826394+0000","last_fullsized":"2024-09-10T05:58:00.826394+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:28.141010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"102'14","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.817088+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:58:00.817088+0000","last_peered":"2024-09-10T05:58:00.817088+0000","last_clean":"2024-09-10T05:58:00.817088+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:58:00.817088+0000","last_undegraded":"2024-09-10T05:58:00.817088+0000","last_fullsized":"2024-09-10T05:58:00.817088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.825618+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:58:00.825618+0000","last_peered":"2024-09-10T05:58:00.825618+0000","last_clean":"2024-09-10T05:58:00.825618+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:58:00.825618+0000","last_undegraded":"2024-09-10T05:58:00.825618+0000","last_fullsized":"2024-09-10T05:58:00.825618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"94'18","reported_seq":142,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809078+0000","last_change":"2024-09-10T05:57:35.959978+0000","last_active":"2024-09-10T05:57:59.809078+0000","last_peered":"2024-09-10T05:57:59.809078+0000","last_clean":"2024-09-10T05:57:59.809078+0000","last_became_active":"2024-09-10T05:57:34.914224+0000","last_became_peered":"2024-09-10T05:57:34.914224+0000","last_unstale":"2024-09-10T05:57:59.809078+0000","last_undegraded":"2024-09-10T05:57:59.809078+0000","last_fullsized":"2024-09-10T05:57:59.809078+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:29.840388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828224+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:58:00.828224+0000","last_peered":"2024-09-10T05:58:00.828224+0000","last_clean":"2024-09-10T05:58:00.828224+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:58:00.828224+0000","last_undegraded":"2024-09-10T05:58:00.828224+0000","last_fullsized":"2024-09-10T05:58:00.828224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"99'7","reported_seq":157,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813082+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:58:00.813082+0000","last_peered":"2024-09-10T05:58:00.813082+0000","last_clean":"2024-09-10T05:58:00.813082+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:58:00.813082+0000","last_undegraded":"2024-09-10T05:58:00.813082+0000","last_fullsized":"2024-09-10T05:58:00.813082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":83,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822566+0000","last_change":"2024-09-10T05:57:35.926781+0000","last_active":"2024-09-10T05:57:59.822566+0000","last_peered":"2024-09-10T05:57:59.822566+0000","last_clean":"2024-09-10T05:57:59.822566+0000","last_became_active":"2024-09-10T05:57:34.908480+0000","last_became_peered":"2024-09-10T05:57:34.908480+0000","last_unstale":"2024-09-10T05:57:59.822566+0000","last_undegraded":"2024-09-10T05:57:59.822566+0000","last_fullsized":"2024-09-10T05:57:59.822566+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:51.018790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"101'15","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.810358+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:57:59.810358+0000","last_peered":"2024-09-10T05:57:59.810358+0000","last_clean":"2024-09-10T05:57:59.810358+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:57:59.810358+0000","last_undegraded":"2024-09-10T05:57:59.810358+0000","last_fullsized":"2024-09-10T05:57:59.810358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827558+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:58:00.827558+0000","last_peered":"2024-09-10T05:58:00.827558+0000","last_clean":"2024-09-10T05:58:00.827558+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:58:00.827558+0000","last_undegraded":"2024-09-10T05:58:00.827558+0000","last_fullsized":"2024-09-10T05:58:00.827558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"94'15","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827432+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:58:00.827432+0000","last_peered":"2024-09-10T05:58:00.827432+0000","last_clean":"2024-09-10T05:58:00.827432+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:58:00.827432+0000","last_undegraded":"2024-09-10T05:58:00.827432+0000","last_fullsized":"2024-09-10T05:58:00.827432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808326+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:57:59.808326+0000","last_peered":"2024-09-10T05:57:59.808326+0000","last_clean":"2024-09-10T05:57:59.808326+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:57:59.808326+0000","last_undegraded":"2024-09-10T05:57:59.808326+0000","last_fullsized":"2024-09-10T05:57:59.808326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.831525+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:58:00.831525+0000","last_peered":"2024-09-10T05:58:00.831525+0000","last_clean":"2024-09-10T05:58:00.831525+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:58:00.831525+0000","last_undegraded":"2024-09-10T05:58:00.831525+0000","last_fullsized":"2024-09-10T05:58:00.831525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"101'16","reported_seq":108,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807092+0000","last_change":"2024-09-10T05:57:35.775013+0000","last_active":"2024-09-10T05:57:59.807092+0000","last_peered":"2024-09-10T05:57:59.807092+0000","last_clean":"2024-09-10T05:57:59.807092+0000","last_became_active":"2024-09-10T05:57:34.896697+0000","last_became_peered":"2024-09-10T05:57:34.896697+0000","last_unstale":"2024-09-10T05:57:59.807092+0000","last_undegraded":"2024-09-10T05:57:59.807092+0000","last_fullsized":"2024-09-10T05:57:59.807092+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:32.879809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809740+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:57:59.809740+0000","last_peered":"2024-09-10T05:57:59.809740+0000","last_clean":"2024-09-10T05:57:59.809740+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:57:59.809740+0000","last_undegraded":"2024-09-10T05:57:59.809740+0000","last_fullsized":"2024-09-10T05:57:59.809740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"94'33","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823228+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:57:59.823228+0000","last_peered":"2024-09-10T05:57:59.823228+0000","last_clean":"2024-09-10T05:57:59.823228+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:57:59.823228+0000","last_undegraded":"2024-09-10T05:57:59.823228+0000","last_fullsized":"2024-09-10T05:57:59.823228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":169,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813606+0000","last_change":"2024-09-10T05:57:34.901398+0000","last_active":"2024-09-10T05:58:00.813606+0000","last_peered":"2024-09-10T05:58:00.813606+0000","last_clean":"2024-09-10T05:58:00.813606+0000","last_became_active":"2024-09-10T05:57:34.900590+0000","last_became_peered":"2024-09-10T05:57:34.900590+0000","last_unstale":"2024-09-10T05:58:00.813606+0000","last_undegraded":"2024-09-10T05:58:00.813606+0000","last_fullsized":"2024-09-10T05:58:00.813606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:43.260264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":79,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867125+0000","last_change":"2024-09-10T05:57:34.885549+0000","last_active":"2024-09-10T05:57:59.867125+0000","last_peered":"2024-09-10T05:57:59.867125+0000","last_clean":"2024-09-10T05:57:59.867125+0000","last_became_active":"2024-09-10T05:57:34.885213+0000","last_became_peered":"2024-09-10T05:57:34.885213+0000","last_unstale":"2024-09-10T05:57:59.867125+0000","last_undegraded":"2024-09-10T05:57:59.867125+0000","last_fullsized":"2024-09-10T05:57:59.867125+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:56:51.953007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.809823+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:57:59.809823+0000","last_peered":"2024-09-10T05:57:59.809823+0000","last_clean":"2024-09-10T05:57:59.809823+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:57:59.809823+0000","last_undegraded":"2024-09-10T05:57:59.809823+0000","last_fullsized":"2024-09-10T05:57:59.809823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"101'12","reported_seq":213,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823209+0000","last_change":"2024-09-10T05:57:35.916174+0000","last_active":"2024-09-10T05:57:59.823209+0000","last_peered":"2024-09-10T05:57:59.823209+0000","last_clean":"2024-09-10T05:57:59.823209+0000","last_became_active":"2024-09-10T05:57:34.895230+0000","last_became_peered":"2024-09-10T05:57:34.895230+0000","last_unstale":"2024-09-10T05:57:59.823209+0000","last_undegraded":"2024-09-10T05:57:59.823209+0000","last_fullsized":"2024-09-10T05:57:59.823209+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:11.791022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830789+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:58:00.830789+0000","last_peered":"2024-09-10T05:58:00.830789+0000","last_clean":"2024-09-10T05:58:00.830789+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:58:00.830789+0000","last_undegraded":"2024-09-10T05:58:00.830789+0000","last_fullsized":"2024-09-10T05:58:00.830789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"94'21","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826590+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:58:00.826590+0000","last_peered":"2024-09-10T05:58:00.826590+0000","last_clean":"2024-09-10T05:58:00.826590+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:58:00.826590+0000","last_undegraded":"2024-09-10T05:58:00.826590+0000","last_fullsized":"2024-09-10T05:58:00.826590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823310+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:57:59.823310+0000","last_peered":"2024-09-10T05:57:59.823310+0000","last_clean":"2024-09-10T05:57:59.823310+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:57:59.823310+0000","last_undegraded":"2024-09-10T05:57:59.823310+0000","last_fullsized":"2024-09-10T05:57:59.823310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":147,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828032+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:58:00.828032+0000","last_peered":"2024-09-10T05:58:00.828032+0000","last_clean":"2024-09-10T05:58:00.828032+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:58:00.828032+0000","last_undegraded":"2024-09-10T05:58:00.828032+0000","last_fullsized":"2024-09-10T05:58:00.828032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":91,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.828918+0000","last_change":"2024-09-10T05:57:34.924583+0000","last_active":"2024-09-10T05:57:59.828918+0000","last_peered":"2024-09-10T05:57:59.828918+0000","last_clean":"2024-09-10T05:57:59.828918+0000","last_became_active":"2024-09-10T05:57:34.886829+0000","last_became_peered":"2024-09-10T05:57:34.886829+0000","last_unstale":"2024-09-10T05:57:59.828918+0000","last_undegraded":"2024-09-10T05:57:59.828918+0000","last_fullsized":"2024-09-10T05:57:59.828918+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:01.926326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"101'10","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815975+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:57:59.815975+0000","last_peered":"2024-09-10T05:57:59.815975+0000","last_clean":"2024-09-10T05:57:59.815975+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:57:59.815975+0000","last_undegraded":"2024-09-10T05:57:59.815975+0000","last_fullsized":"2024-09-10T05:57:59.815975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":265,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815886+0000","last_change":"2024-09-10T05:57:35.527576+0000","last_active":"2024-09-10T05:57:59.815886+0000","last_peered":"2024-09-10T05:57:59.815886+0000","last_clean":"2024-09-10T05:57:59.815886+0000","last_became_active":"2024-09-10T05:57:34.896336+0000","last_became_peered":"2024-09-10T05:57:34.896336+0000","last_unstale":"2024-09-10T05:57:59.815886+0000","last_undegraded":"2024-09-10T05:57:59.815886+0000","last_fullsized":"2024-09-10T05:57:59.815886+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:09.114562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":2979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"94'26","reported_seq":97,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830522+0000","last_change":"2024-09-10T05:57:35.179841+0000","last_active":"2024-09-10T05:58:00.830522+0000","last_peered":"2024-09-10T05:58:00.830522+0000","last_clean":"2024-09-10T05:58:00.830522+0000","last_became_active":"2024-09-10T05:57:34.906915+0000","last_became_peered":"2024-09-10T05:57:34.906915+0000","last_unstale":"2024-09-10T05:58:00.830522+0000","last_undegraded":"2024-09-10T05:58:00.830522+0000","last_fullsized":"2024-09-10T05:58:00.830522+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:01.642379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62802,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823455+0000","last_change":"2024-09-10T05:57:34.896939+0000","last_active":"2024-09-10T05:57:59.823455+0000","last_peered":"2024-09-10T05:57:59.823455+0000","last_clean":"2024-09-10T05:57:59.823455+0000","last_became_active":"2024-09-10T05:57:34.896593+0000","last_became_peered":"2024-09-10T05:57:34.896593+0000","last_unstale":"2024-09-10T05:57:59.823455+0000","last_undegraded":"2024-09-10T05:57:59.823455+0000","last_fullsized":"2024-09-10T05:57:59.823455+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:41.062262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":153,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.811796+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:58:00.811796+0000","last_peered":"2024-09-10T05:58:00.811796+0000","last_clean":"2024-09-10T05:58:00.811796+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:58:00.811796+0000","last_undegraded":"2024-09-10T05:58:00.811796+0000","last_fullsized":"2024-09-10T05:58:00.811796+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867901+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:57:59.867901+0000","last_peered":"2024-09-10T05:57:59.867901+0000","last_clean":"2024-09-10T05:57:59.867901+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:57:59.867901+0000","last_undegraded":"2024-09-10T05:57:59.867901+0000","last_fullsized":"2024-09-10T05:57:59.867901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"101'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808462+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:57:59.808462+0000","last_peered":"2024-09-10T05:57:59.808462+0000","last_clean":"2024-09-10T05:57:59.808462+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:57:59.808462+0000","last_undegraded":"2024-09-10T05:57:59.808462+0000","last_fullsized":"2024-09-10T05:57:59.808462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56623104,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.828955+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:57:59.828955+0000","last_peered":"2024-09-10T05:57:59.828955+0000","last_clean":"2024-09-10T05:57:59.828955+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:57:59.828955+0000","last_undegraded":"2024-09-10T05:57:59.828955+0000","last_fullsized":"2024-09-10T05:57:59.828955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.816754+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:57:59.816754+0000","last_peered":"2024-09-10T05:57:59.816754+0000","last_clean":"2024-09-10T05:57:59.816754+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:57:59.816754+0000","last_undegraded":"2024-09-10T05:57:59.816754+0000","last_fullsized":"2024-09-10T05:57:59.816754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"99'116","reported_seq":297,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830377+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:58:00.830377+0000","last_peered":"2024-09-10T05:58:00.830377+0000","last_clean":"2024-09-10T05:58:00.830377+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:58:00.830377+0000","last_undegraded":"2024-09-10T05:58:00.830377+0000","last_fullsized":"2024-09-10T05:58:00.830377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.825554+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:58:00.825554+0000","last_peered":"2024-09-10T05:58:00.825554+0000","last_clean":"2024-09-10T05:58:00.825554+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:58:00.825554+0000","last_undegraded":"2024-09-10T05:58:00.825554+0000","last_fullsized":"2024-09-10T05:58:00.825554+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815127+0000","last_change":"2024-09-10T05:57:35.534005+0000","last_active":"2024-09-10T05:57:59.815127+0000","last_peered":"2024-09-10T05:57:59.815127+0000","last_clean":"2024-09-10T05:57:59.815127+0000","last_became_active":"2024-09-10T05:57:34.904280+0000","last_became_peered":"2024-09-10T05:57:34.904280+0000","last_unstale":"2024-09-10T05:57:59.815127+0000","last_undegraded":"2024-09-10T05:57:59.815127+0000","last_fullsized":"2024-09-10T05:57:59.815127+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:51:01.371103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"101'9","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.814022+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:58:00.814022+0000","last_peered":"2024-09-10T05:58:00.814022+0000","last_clean":"2024-09-10T05:58:00.814022+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:58:00.814022+0000","last_undegraded":"2024-09-10T05:58:00.814022+0000","last_fullsized":"2024-09-10T05:58:00.814022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827677+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:58:00.827677+0000","last_peered":"2024-09-10T05:58:00.827677+0000","last_clean":"2024-09-10T05:58:00.827677+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:58:00.827677+0000","last_undegraded":"2024-09-10T05:58:00.827677+0000","last_fullsized":"2024-09-10T05:58:00.827677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"94'45","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.813876+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:58:00.813876+0000","last_peered":"2024-09-10T05:58:00.813876+0000","last_clean":"2024-09-10T05:58:00.813876+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:58:00.813876+0000","last_undegraded":"2024-09-10T05:58:00.813876+0000","last_fullsized":"2024-09-10T05:58:00.813876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.806471+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:57:59.806471+0000","last_peered":"2024-09-10T05:57:59.806471+0000","last_clean":"2024-09-10T05:57:59.806471+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:57:59.806471+0000","last_undegraded":"2024-09-10T05:57:59.806471+0000","last_fullsized":"2024-09-10T05:57:59.806471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830384+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:58:00.830384+0000","last_peered":"2024-09-10T05:58:00.830384+0000","last_clean":"2024-09-10T05:58:00.830384+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:58:00.830384+0000","last_undegraded":"2024-09-10T05:58:00.830384+0000","last_fullsized":"2024-09-10T05:58:00.830384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"99'4","reported_seq":204,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815674+0000","last_change":"2024-09-10T05:57:34.905534+0000","last_active":"2024-09-10T05:57:59.815674+0000","last_peered":"2024-09-10T05:57:59.815674+0000","last_clean":"2024-09-10T05:57:59.815674+0000","last_became_active":"2024-09-10T05:57:34.880600+0000","last_became_peered":"2024-09-10T05:57:34.880600+0000","last_unstale":"2024-09-10T05:57:59.815674+0000","last_undegraded":"2024-09-10T05:57:59.815674+0000","last_fullsized":"2024-09-10T05:57:59.815674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:15.003563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"102'8","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.815998+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:58:00.815998+0000","last_peered":"2024-09-10T05:58:00.815998+0000","last_clean":"2024-09-10T05:58:00.815998+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:58:00.815998+0000","last_undegraded":"2024-09-10T05:58:00.815998+0000","last_fullsized":"2024-09-10T05:58:00.815998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.812186+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:58:00.812186+0000","last_peered":"2024-09-10T05:58:00.812186+0000","last_clean":"2024-09-10T05:58:00.812186+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:58:00.812186+0000","last_undegraded":"2024-09-10T05:58:00.812186+0000","last_fullsized":"2024-09-10T05:58:00.812186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"94'21","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.806630+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:57:59.806630+0000","last_peered":"2024-09-10T05:57:59.806630+0000","last_clean":"2024-09-10T05:57:59.806630+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:57:59.806630+0000","last_undegraded":"2024-09-10T05:57:59.806630+0000","last_fullsized":"2024-09-10T05:57:59.806630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827167+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:58:00.827167+0000","last_peered":"2024-09-10T05:58:00.827167+0000","last_clean":"2024-09-10T05:58:00.827167+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:58:00.827167+0000","last_undegraded":"2024-09-10T05:58:00.827167+0000","last_fullsized":"2024-09-10T05:58:00.827167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":68,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.867626+0000","last_change":"2024-09-10T05:57:34.973691+0000","last_active":"2024-09-10T05:57:59.867626+0000","last_peered":"2024-09-10T05:57:59.867626+0000","last_clean":"2024-09-10T05:57:59.867626+0000","last_became_active":"2024-09-10T05:57:34.889850+0000","last_became_peered":"2024-09-10T05:57:34.889850+0000","last_unstale":"2024-09-10T05:57:59.867626+0000","last_undegraded":"2024-09-10T05:57:59.867626+0000","last_fullsized":"2024-09-10T05:57:59.867626+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:38.429289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":82,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.866289+0000","last_change":"2024-09-10T05:57:34.888711+0000","last_active":"2024-09-10T05:57:59.866289+0000","last_peered":"2024-09-10T05:57:59.866289+0000","last_clean":"2024-09-10T05:57:59.866289+0000","last_became_active":"2024-09-10T05:57:34.879475+0000","last_became_peered":"2024-09-10T05:57:34.879475+0000","last_unstale":"2024-09-10T05:57:59.866289+0000","last_undegraded":"2024-09-10T05:57:59.866289+0000","last_fullsized":"2024-09-10T05:57:59.866289+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:40.043285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"102'16","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826641+0000","last_change":"2024-09-10T05:57:35.150656+0000","last_active":"2024-09-10T05:58:00.826641+0000","last_peered":"2024-09-10T05:58:00.826641+0000","last_clean":"2024-09-10T05:58:00.826641+0000","last_became_active":"2024-09-10T05:57:34.900143+0000","last_became_peered":"2024-09-10T05:57:34.900143+0000","last_unstale":"2024-09-10T05:58:00.826641+0000","last_undegraded":"2024-09-10T05:58:00.826641+0000","last_fullsized":"2024-09-10T05:58:00.826641+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:23.403288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.813949+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:57:59.813949+0000","last_peered":"2024-09-10T05:57:59.813949+0000","last_clean":"2024-09-10T05:57:59.813949+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:57:59.813949+0000","last_undegraded":"2024-09-10T05:57:59.813949+0000","last_fullsized":"2024-09-10T05:57:59.813949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"94'17","reported_seq":140,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827821+0000","last_change":"2024-09-10T05:57:35.516105+0000","last_active":"2024-09-10T05:58:00.827821+0000","last_peered":"2024-09-10T05:58:00.827821+0000","last_clean":"2024-09-10T05:58:00.827821+0000","last_became_active":"2024-09-10T05:57:34.934263+0000","last_became_peered":"2024-09-10T05:57:34.934263+0000","last_unstale":"2024-09-10T05:58:00.827821+0000","last_undegraded":"2024-09-10T05:58:00.827821+0000","last_fullsized":"2024-09-10T05:58:00.827821+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:41:08.603263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815259+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:57:59.815259+0000","last_peered":"2024-09-10T05:57:59.815259+0000","last_clean":"2024-09-10T05:57:59.815259+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:57:59.815259+0000","last_undegraded":"2024-09-10T05:57:59.815259+0000","last_fullsized":"2024-09-10T05:57:59.815259+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829011+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:58:00.829011+0000","last_peered":"2024-09-10T05:58:00.829011+0000","last_clean":"2024-09-10T05:58:00.829011+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:58:00.829011+0000","last_undegraded":"2024-09-10T05:58:00.829011+0000","last_fullsized":"2024-09-10T05:58:00.829011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814361+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:57:59.814361+0000","last_peered":"2024-09-10T05:57:59.814361+0000","last_clean":"2024-09-10T05:57:59.814361+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:57:59.814361+0000","last_undegraded":"2024-09-10T05:57:59.814361+0000","last_fullsized":"2024-09-10T05:57:59.814361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"101'12","reported_seq":138,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.868107+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:57:59.868107+0000","last_peered":"2024-09-10T05:57:59.868107+0000","last_clean":"2024-09-10T05:57:59.868107+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:57:59.868107+0000","last_undegraded":"2024-09-10T05:57:59.868107+0000","last_fullsized":"2024-09-10T05:57:59.868107+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.828965+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:57:59.828965+0000","last_peered":"2024-09-10T05:57:59.828965+0000","last_clean":"2024-09-10T05:57:59.828965+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:57:59.828965+0000","last_undegraded":"2024-09-10T05:57:59.828965+0000","last_fullsized":"2024-09-10T05:57:59.828965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"94'28","reported_seq":200,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.814831+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:57:59.814831+0000","last_peered":"2024-09-10T05:57:59.814831+0000","last_clean":"2024-09-10T05:57:59.814831+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:57:59.814831+0000","last_undegraded":"2024-09-10T05:57:59.814831+0000","last_fullsized":"2024-09-10T05:57:59.814831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808510+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:57:59.808510+0000","last_peered":"2024-09-10T05:57:59.808510+0000","last_clean":"2024-09-10T05:57:59.808510+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:57:59.808510+0000","last_undegraded":"2024-09-10T05:57:59.808510+0000","last_fullsized":"2024-09-10T05:57:59.808510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815895+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:57:59.815895+0000","last_peered":"2024-09-10T05:57:59.815895+0000","last_clean":"2024-09-10T05:57:59.815895+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:57:59.815895+0000","last_undegraded":"2024-09-10T05:57:59.815895+0000","last_fullsized":"2024-09-10T05:57:59.815895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"99'3","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.834035+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:57:59.834035+0000","last_peered":"2024-09-10T05:57:59.834035+0000","last_clean":"2024-09-10T05:57:59.834035+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:57:59.834035+0000","last_undegraded":"2024-09-10T05:57:59.834035+0000","last_fullsized":"2024-09-10T05:57:59.834035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"102'16","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.830007+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:58:00.830007+0000","last_peered":"2024-09-10T05:58:00.830007+0000","last_clean":"2024-09-10T05:58:00.830007+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:58:00.830007+0000","last_undegraded":"2024-09-10T05:58:00.830007+0000","last_fullsized":"2024-09-10T05:58:00.830007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.829597+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:57:59.829597+0000","last_peered":"2024-09-10T05:57:59.829597+0000","last_clean":"2024-09-10T05:57:59.829597+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:57:59.829597+0000","last_undegraded":"2024-09-10T05:57:59.829597+0000","last_fullsized":"2024-09-10T05:57:59.829597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"102'12","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.865810+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:57:59.865810+0000","last_peered":"2024-09-10T05:57:59.865810+0000","last_clean":"2024-09-10T05:57:59.865810+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:57:59.865810+0000","last_undegraded":"2024-09-10T05:57:59.865810+0000","last_fullsized":"2024-09-10T05:57:59.865810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"94'4","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.815570+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:58:00.815570+0000","last_peered":"2024-09-10T05:58:00.815570+0000","last_clean":"2024-09-10T05:58:00.815570+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:58:00.815570+0000","last_undegraded":"2024-09-10T05:58:00.815570+0000","last_fullsized":"2024-09-10T05:58:00.815570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"103'12","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.814469+0000","last_change":"2024-09-10T05:57:35.484866+0000","last_active":"2024-09-10T05:58:00.814469+0000","last_peered":"2024-09-10T05:58:00.814469+0000","last_clean":"2024-09-10T05:58:00.814469+0000","last_became_active":"2024-09-10T05:57:34.882487+0000","last_became_peered":"2024-09-10T05:57:34.882487+0000","last_unstale":"2024-09-10T05:58:00.814469+0000","last_undegraded":"2024-09-10T05:58:00.814469+0000","last_fullsized":"2024-09-10T05:58:00.814469+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:21.428966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":20,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.829177+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:57:59.829177+0000","last_peered":"2024-09-10T05:57:59.829177+0000","last_clean":"2024-09-10T05:57:59.829177+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:57:59.829177+0000","last_undegraded":"2024-09-10T05:57:59.829177+0000","last_fullsized":"2024-09-10T05:57:59.829177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"101'11","reported_seq":204,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808576+0000","last_change":"2024-09-10T05:57:35.615541+0000","last_active":"2024-09-10T05:57:59.808576+0000","last_peered":"2024-09-10T05:57:59.808576+0000","last_clean":"2024-09-10T05:57:59.808576+0000","last_became_active":"2024-09-10T05:57:34.894050+0000","last_became_peered":"2024-09-10T05:57:34.894050+0000","last_unstale":"2024-09-10T05:57:59.808576+0000","last_undegraded":"2024-09-10T05:57:59.808576+0000","last_fullsized":"2024-09-10T05:57:59.808576+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:42.240516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":40,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826942+0000","last_change":"2024-09-10T05:57:35.457402+0000","last_active":"2024-09-10T05:58:00.826942+0000","last_peered":"2024-09-10T05:58:00.826942+0000","last_clean":"2024-09-10T05:58:00.826942+0000","last_became_active":"2024-09-10T05:57:34.931063+0000","last_became_peered":"2024-09-10T05:57:34.931063+0000","last_unstale":"2024-09-10T05:58:00.826942+0000","last_undegraded":"2024-09-10T05:58:00.826942+0000","last_fullsized":"2024-09-10T05:58:00.826942+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:02.639019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"101'15","reported_seq":106,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815257+0000","last_change":"2024-09-10T05:57:35.438809+0000","last_active":"2024-09-10T05:57:59.815257+0000","last_peered":"2024-09-10T05:57:59.815257+0000","last_clean":"2024-09-10T05:57:59.815257+0000","last_became_active":"2024-09-10T05:57:34.883766+0000","last_became_peered":"2024-09-10T05:57:34.883766+0000","last_unstale":"2024-09-10T05:57:59.815257+0000","last_undegraded":"2024-09-10T05:57:59.815257+0000","last_fullsized":"2024-09-10T05:57:59.815257+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:29.144309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.22","version":"99'7","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815949+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:57:59.815949+0000","last_peered":"2024-09-10T05:57:59.815949+0000","last_clean":"2024-09-10T05:57:59.815949+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:57:59.815949+0000","last_undegraded":"2024-09-10T05:57:59.815949+0000","last_fullsized":"2024-09-10T05:57:59.815949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"102'16","reported_seq":215,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.829142+0000","last_change":"2024-09-10T05:57:35.323338+0000","last_active":"2024-09-10T05:57:59.829142+0000","last_peered":"2024-09-10T05:57:59.829142+0000","last_clean":"2024-09-10T05:57:59.829142+0000","last_became_active":"2024-09-10T05:57:34.890914+0000","last_became_peered":"2024-09-10T05:57:34.890914+0000","last_unstale":"2024-09-10T05:57:59.829142+0000","last_undegraded":"2024-09-10T05:57:59.829142+0000","last_fullsized":"2024-09-10T05:57:59.829142+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:52.493067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":80,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.822924+0000","last_change":"2024-09-10T05:57:34.890350+0000","last_active":"2024-09-10T05:57:59.822924+0000","last_peered":"2024-09-10T05:57:59.822924+0000","last_clean":"2024-09-10T05:57:59.822924+0000","last_became_active":"2024-09-10T05:57:34.886664+0000","last_became_peered":"2024-09-10T05:57:34.886664+0000","last_unstale":"2024-09-10T05:57:59.822924+0000","last_undegraded":"2024-09-10T05:57:59.822924+0000","last_fullsized":"2024-09-10T05:57:59.822924+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:38.972813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"103'12","reported_seq":179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827490+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:58:00.827490+0000","last_peered":"2024-09-10T05:58:00.827490+0000","last_clean":"2024-09-10T05:58:00.827490+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:58:00.827490+0000","last_undegraded":"2024-09-10T05:58:00.827490+0000","last_fullsized":"2024-09-10T05:58:00.827490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826555+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:58:00.826555+0000","last_peered":"2024-09-10T05:58:00.826555+0000","last_clean":"2024-09-10T05:58:00.826555+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:58:00.826555+0000","last_undegraded":"2024-09-10T05:58:00.826555+0000","last_fullsized":"2024-09-10T05:58:00.826555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"101'11","reported_seq":91,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.833667+0000","last_change":"2024-09-10T05:57:35.524824+0000","last_active":"2024-09-10T05:57:59.833667+0000","last_peered":"2024-09-10T05:57:59.833667+0000","last_clean":"2024-09-10T05:57:59.833667+0000","last_became_active":"2024-09-10T05:57:34.895665+0000","last_became_peered":"2024-09-10T05:57:34.895665+0000","last_unstale":"2024-09-10T05:57:59.833667+0000","last_undegraded":"2024-09-10T05:57:59.833667+0000","last_fullsized":"2024-09-10T05:57:59.833667+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:19.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.810255+0000","last_change":"2024-09-10T05:57:35.449869+0000","last_active":"2024-09-10T05:57:59.810255+0000","last_peered":"2024-09-10T05:57:59.810255+0000","last_clean":"2024-09-10T05:57:59.810255+0000","last_became_active":"2024-09-10T05:57:34.889600+0000","last_became_peered":"2024-09-10T05:57:34.889600+0000","last_unstale":"2024-09-10T05:57:59.810255+0000","last_undegraded":"2024-09-10T05:57:59.810255+0000","last_fullsized":"2024-09-10T05:57:59.810255+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:14.293955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"103'17","reported_seq":210,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.812592+0000","last_change":"2024-09-10T05:57:35.438599+0000","last_active":"2024-09-10T05:58:00.812592+0000","last_peered":"2024-09-10T05:58:00.812592+0000","last_clean":"2024-09-10T05:58:00.812592+0000","last_became_active":"2024-09-10T05:57:34.882067+0000","last_became_peered":"2024-09-10T05:57:34.882067+0000","last_unstale":"2024-09-10T05:58:00.812592+0000","last_undegraded":"2024-09-10T05:58:00.812592+0000","last_fullsized":"2024-09-10T05:58:00.812592+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:57.832900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":199,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.817050+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:57:59.817050+0000","last_peered":"2024-09-10T05:57:59.817050+0000","last_clean":"2024-09-10T05:57:59.817050+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:57:59.817050+0000","last_undegraded":"2024-09-10T05:57:59.817050+0000","last_fullsized":"2024-09-10T05:57:59.817050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"101'11","reported_seq":94,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815147+0000","last_change":"2024-09-10T05:57:35.631263+0000","last_active":"2024-09-10T05:57:59.815147+0000","last_peered":"2024-09-10T05:57:59.815147+0000","last_clean":"2024-09-10T05:57:59.815147+0000","last_became_active":"2024-09-10T05:57:34.904305+0000","last_became_peered":"2024-09-10T05:57:34.904305+0000","last_unstale":"2024-09-10T05:57:59.815147+0000","last_undegraded":"2024-09-10T05:57:59.815147+0000","last_fullsized":"2024-09-10T05:57:59.815147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:11.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.868485+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:57:59.868485+0000","last_peered":"2024-09-10T05:57:59.868485+0000","last_clean":"2024-09-10T05:57:59.868485+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:57:59.868485+0000","last_undegraded":"2024-09-10T05:57:59.868485+0000","last_fullsized":"2024-09-10T05:57:59.868485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"102'18","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.814092+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:58:00.814092+0000","last_peered":"2024-09-10T05:58:00.814092+0000","last_clean":"2024-09-10T05:58:00.814092+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:58:00.814092+0000","last_undegraded":"2024-09-10T05:58:00.814092+0000","last_fullsized":"2024-09-10T05:58:00.814092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.815591+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:57:59.815591+0000","last_peered":"2024-09-10T05:57:59.815591+0000","last_clean":"2024-09-10T05:57:59.815591+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:57:59.815591+0000","last_undegraded":"2024-09-10T05:57:59.815591+0000","last_fullsized":"2024-09-10T05:57:59.815591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"101'9","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808768+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:57:59.808768+0000","last_peered":"2024-09-10T05:57:59.808768+0000","last_clean":"2024-09-10T05:57:59.808768+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:57:59.808768+0000","last_undegraded":"2024-09-10T05:57:59.808768+0000","last_fullsized":"2024-09-10T05:57:59.808768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"74'2","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.827337+0000","last_change":"2024-09-10T05:57:35.483503+0000","last_active":"2024-09-10T05:58:00.827337+0000","last_peered":"2024-09-10T05:58:00.827337+0000","last_clean":"2024-09-10T05:58:00.827337+0000","last_became_active":"2024-09-10T05:57:34.931929+0000","last_became_peered":"2024-09-10T05:57:34.931929+0000","last_unstale":"2024-09-10T05:58:00.827337+0000","last_undegraded":"2024-09-10T05:58:00.827337+0000","last_fullsized":"2024-09-10T05:58:00.827337+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:59.029617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"102'8","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.828439+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:58:00.828439+0000","last_peered":"2024-09-10T05:58:00.828439+0000","last_clean":"2024-09-10T05:58:00.828439+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:58:00.828439+0000","last_undegraded":"2024-09-10T05:58:00.828439+0000","last_fullsized":"2024-09-10T05:58:00.828439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.807780+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:57:59.807780+0000","last_peered":"2024-09-10T05:57:59.807780+0000","last_clean":"2024-09-10T05:57:59.807780+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:57:59.807780+0000","last_undegraded":"2024-09-10T05:57:59.807780+0000","last_fullsized":"2024-09-10T05:57:59.807780+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"102'12","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.829891+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:58:00.829891+0000","last_peered":"2024-09-10T05:58:00.829891+0000","last_clean":"2024-09-10T05:58:00.829891+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:58:00.829891+0000","last_undegraded":"2024-09-10T05:58:00.829891+0000","last_fullsized":"2024-09-10T05:58:00.829891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":98,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.808091+0000","last_change":"2024-09-10T05:57:34.895117+0000","last_active":"2024-09-10T05:57:59.808091+0000","last_peered":"2024-09-10T05:57:59.808091+0000","last_clean":"2024-09-10T05:57:59.808091+0000","last_became_active":"2024-09-10T05:57:34.878726+0000","last_became_peered":"2024-09-10T05:57:34.878726+0000","last_unstale":"2024-09-10T05:57:59.808091+0000","last_undegraded":"2024-09-10T05:57:59.808091+0000","last_fullsized":"2024-09-10T05:57:59.808091+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:19.627229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"101'11","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.868104+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:57:59.868104+0000","last_peered":"2024-09-10T05:57:59.868104+0000","last_clean":"2024-09-10T05:57:59.868104+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:57:59.868104+0000","last_undegraded":"2024-09-10T05:57:59.868104+0000","last_fullsized":"2024-09-10T05:57:59.868104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.826232+0000","last_change":"2024-09-10T05:57:34.915374+0000","last_active":"2024-09-10T05:58:00.826232+0000","last_peered":"2024-09-10T05:58:00.826232+0000","last_clean":"2024-09-10T05:58:00.826232+0000","last_became_active":"2024-09-10T05:57:34.907499+0000","last_became_peered":"2024-09-10T05:57:34.907499+0000","last_unstale":"2024-09-10T05:58:00.826232+0000","last_undegraded":"2024-09-10T05:58:00.826232+0000","last_fullsized":"2024-09-10T05:58:00.826232+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:41.555271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"102'10","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.819055+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:58:00.819055+0000","last_peered":"2024-09-10T05:58:00.819055+0000","last_clean":"2024-09-10T05:58:00.819055+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:58:00.819055+0000","last_undegraded":"2024-09-10T05:58:00.819055+0000","last_fullsized":"2024-09-10T05:58:00.819055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"101'14","reported_seq":87,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.865711+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:57:59.865711+0000","last_peered":"2024-09-10T05:57:59.865711+0000","last_clean":"2024-09-10T05:57:59.865711+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:57:59.865711+0000","last_undegraded":"2024-09-10T05:57:59.865711+0000","last_fullsized":"2024-09-10T05:57:59.865711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56623104,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"99'3","reported_seq":198,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.810083+0000","last_change":"2024-09-10T05:57:35.780375+0000","last_active":"2024-09-10T05:57:59.810083+0000","last_peered":"2024-09-10T05:57:59.810083+0000","last_clean":"2024-09-10T05:57:59.810083+0000","last_became_active":"2024-09-10T05:57:34.900095+0000","last_became_peered":"2024-09-10T05:57:34.900095+0000","last_unstale":"2024-09-10T05:57:59.810083+0000","last_undegraded":"2024-09-10T05:57:59.810083+0000","last_fullsized":"2024-09-10T05:57:59.810083+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:38.515409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"102'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T05:57:59.823089+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:57:59.823089+0000","last_peered":"2024-09-10T05:57:59.823089+0000","last_clean":"2024-09-10T05:57:59.823089+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:57:59.823089+0000","last_undegraded":"2024-09-10T05:57:59.823089+0000","last_fullsized":"2024-09-10T05:57:59.823089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T05:58:00.816680+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:58:00.816680+0000","last_peered":"2024-09-10T05:58:00.816680+0000","last_clean":"2024-09-10T05:58:00.816680+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:58:00.816680+0000","last_undegraded":"2024-09-10T05:58:00.816680+0000","last_fullsized":"2024-09-10T05:58:00.816680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":309,"num_read_kb":291,"num_write":261,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":938,"ondisk_log_size":938,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":141661,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1105,"num_read_kb":835,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":3636,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":245228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":869,"ondisk_log_size":869,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":384,"num_read_kb":384,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":2979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1200,"num_read_kb":1176,"num_write":267,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":255,"ondisk_log_size":255,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":3334471680,"num_objects":797,"num_object_clones":0,"num_object_copies":1594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":797,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":857,"num_write_kb":3280896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":318767104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6947864576,"data_stored":6947864576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":809,"ondisk_log_size":809,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163512,"kb_used_data":1132320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93208328,"statfs":{"total":96636764160,"available":95445327872,"internally_reserved":0,"allocated":1159495680,"data_stored":1158924397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":708312,"kb_used_data":673028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93663528,"statfs":{"total":96636764160,"available":95911452672,"internally_reserved":0,"allocated":689180672,"data_stored":688623342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923472,"kb_used_data":892284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93448368,"statfs":{"total":96636764160,"available":95691128832,"internally_reserved":0,"allocated":913698816,"data_stored":913078012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":970380,"kb_used_data":939192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93401460,"statfs":{"total":96636764160,"available":95643095040,"internally_reserved":0,"allocated":961732608,"data_stored":961186578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":0,"seq":60129542182,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":882364,"kb_used_data":847016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93489476,"statfs":{"total":96636764160,"available":95733223424,"internally_reserved":0,"allocated":867344384,"data_stored":866813831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710428,"kb_used_data":675080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93661412,"statfs":{"total":96636764160,"available":95909285888,"internally_reserved":0,"allocated":691281920,"data_stored":690711279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1009924,"kb_used_data":970484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93361916,"statfs":{"total":96636764160,"available":95602601984,"internally_reserved":0,"allocated":993775616,"data_stored":993233046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1080033280,"data_stored":1080033280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":769654784,"data_stored":769654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":878706688,"data_stored":878706688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1052770304,"data_stored":1052770304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":966787072,"data_stored":966787072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":725614592,"data_stored":725614592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1166016512,"data_stored":1166016512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":119707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:58:04.272 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:04.269+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:04.344 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:04.344 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:04.358 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:58:04.403 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:04.400+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:04.473 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:04.469+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:04.479 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:04.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:58:04.579 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:04.575+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:04.663 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:04.663 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:04.674 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:04.667+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:04.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:58:04.775 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:04.771+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:04.787 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:04.788 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:04.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:58:04.876 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:04.871+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:04.908 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:04.908 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:04.920 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:58:04.977 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:04.971+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:05.037 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:05.037 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:05.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:58:05.096 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:05.093+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:05.170 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:05.170 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:05.179 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:05.173+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:05.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:58:05.279 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:05.277+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:05.345 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:05.346 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:05.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:58:05.404 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:05.401+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:05.481 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:05.475+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:05.520 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:05.520 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:05.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:58:05.581 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:05.579+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:05.654 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:05.654 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:05.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:58:05.712 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:05.709+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:05.784 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:05.779+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:05.792 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:05.793 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:05.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:58:05.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:58:05.892 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:05.889+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:05.966 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:05.967 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:05.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:58:05.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:58:05.984 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:05.979+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:06.085 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:06.081+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:06.120 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:06.120 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:06.137 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:06.154 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:06.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:58:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:06.171 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:06.192 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:06.193 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:06.189+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:06.212 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:06.252 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:06.282 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:58:06.283 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:58:06.283 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:06.286 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:06.281+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:06.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:58:06.392 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:06.389+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:58:06.468 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 152.83708383499999, 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010104906, 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 207 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.469 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.470 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.470 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:58:06.470 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627543+0000", 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627547+0000", 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0770000000000001e-06 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.471 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627563+0000", 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6045999999999998e-05 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627599+0000", 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6417e-05 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627616+0000", 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7350000000000002e-05 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.472 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627743+0000", 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012628199999999999 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.627754+0000", 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1034e-05 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.473 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.633939+0000", 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061847159999999998 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634232+0000", 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00029319399999999999 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.634686+0000", 2024-09-10T05:58:06.474 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00045385299999999999 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.636040+0000", 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0013540830000000001 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637467+0000", 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014278120000000001 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.475 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637549+0000", 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.1679000000000002e-05 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:55:33.637647+0000", 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8363000000000007e-05 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.476 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:1811 3.28 e66/57 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head v 66'1, mlcod=0'0)", 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 79.031561832999998, 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019385262, 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433065+0000", 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.433066+0000", 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7409999999999999e-06 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.478 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446756+0000", 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013689944000000001 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446775+0000", 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8329999999999999e-05 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446783+0000", 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4130000000000006e-06 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.479 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446850+0000", 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6884000000000005e-05 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.446866+0000", 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6506000000000001e-05 2024-09-10T05:58:06.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452385+0000", 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055187869999999998 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:56:47.452450+0000", 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4657000000000001e-05 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.481 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2680 3.27 3:e6eaa51c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 66.062983686999999, 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010116000999999999, 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2680 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401643+0000", 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.483 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.401647+0000", 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3930000000000001e-06 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403703+0000", 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002055491 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.484 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403735+0000", 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1999000000000003e-05 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403747+0000", 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2675e-05 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.403828+0000", 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.0465999999999998e-05 2024-09-10T05:58:06.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404004+0000", 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176587 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.404180+0000", 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017579499999999999 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.486 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411188+0000", 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0070081529999999996 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411646+0000", 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000457789 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411704+0000", 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7553000000000003e-05 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.487 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.411759+0000", 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5099999999999998e-05 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2702 3.33 3:cdf4d9d1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.800265809999999, 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013949700000000001, 2024-09-10T05:58:06.488 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2702 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664361+0000", 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.664364+0000", 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2490000000000001e-06 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665847+0000", 2024-09-10T05:58:06.490 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001483378 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665873+0000", 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5649000000000001e-05 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665883+0000", 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0514e-05 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.491 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.665956+0000", 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2509999999999995e-05 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666117+0000", 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016102400000000001 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.666225+0000", 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010846299999999999 2024-09-10T05:58:06.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.672149+0000", 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059233660000000002 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678189+0000", 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0060403799999999997 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.493 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678259+0000", 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9900000000000005e-05 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.678310+0000", 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1267000000000002e-05 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.494 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2707 3.5 e73/57 3:a33e2989:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_170:head v 73'1, mlcod=0'0)", 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.744967170999999, 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01031051, 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.495 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719659+0000", 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.719662+0000", 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3949999999999999e-06 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.496 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724033+0000", 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043711870000000003 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724060+0000", 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7160000000000001e-05 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724072+0000", 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2174000000000001e-05 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.497 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724157+0000", 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.4390999999999999e-05 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.724184+0000", 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6954999999999999e-05 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729906+0000", 2024-09-10T05:58:06.498 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057227170000000004 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.729970+0000", 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3530999999999999e-05 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2710 3.1e 3:79d92554:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:58:06.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.715656202999995, 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019527347, 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2710 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.500 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748970+0000", 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.748973+0000", 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5409999999999999e-06 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.501 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751016+0000", 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002043595 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751056+0000", 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9220000000000001e-05 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751075+0000", 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9500999999999998e-05 2024-09-10T05:58:06.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751184+0000", 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000108541 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751289+0000", 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105818 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.751376+0000", 2024-09-10T05:58:06.503 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6536e-05 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.755737+0000", 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043612970000000001 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768291+0000", 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012553887999999999 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.504 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768414+0000", 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012268899999999999 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.768498+0000", 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.3720999999999993e-05 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.505 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2712 3.1e 3:78359c9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.693901029000003, 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.018181349999999999, 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2712 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.506 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770725+0000", 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.770728+0000", 2024-09-10T05:58:06.507 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7130000000000001e-06 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772914+0000", 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0021856929999999998 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772942+0000", 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8360999999999998e-05 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.508 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.772958+0000", 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5665e-05 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773051+0000", 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2791e-05 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773186+0000", 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000135227 2024-09-10T05:58:06.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.773279+0000", 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3622000000000006e-05 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.781369+0000", 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0080894199999999999 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.510 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788803+0000", 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0074339089999999998 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788850+0000", 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7562000000000003e-05 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.511 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.788907+0000", 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.6387000000000001e-05 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2722 3.1e 3:7975af91:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.588321489999998, 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017602772999999999, 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2722 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876305+0000", 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.876308+0000", 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.965e-06 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.514 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877907+0000", 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0015995510000000001 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877951+0000", 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3192000000000003e-05 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.877970+0000", 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9383000000000001e-05 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.515 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878084+0000", 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000113528 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878272+0000", 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188147 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.878408+0000", 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013625900000000001 2024-09-10T05:58:06.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.885333+0000", 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069253880000000002 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893789+0000", 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0084555870000000005 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.517 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893856+0000", 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.7576000000000005e-05 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893908+0000", 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1196999999999998e-05 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.518 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2723 3.24 3:27903ac0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.577513612999994, 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014463088000000001, 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2723 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.519 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887113+0000", 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.887115+0000", 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4499999999999998e-06 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.520 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888476+0000", 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001360347 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888504+0000", 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8368999999999999e-05 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.521 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888515+0000", 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1362000000000001e-05 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888606+0000", 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0248999999999996e-05 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888785+0000", 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017939400000000001 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.522 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.888881+0000", 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6314e-05 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.893170+0000", 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042891750000000001 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901448+0000", 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0082774179999999999 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901524+0000", 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6544000000000004e-05 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.901576+0000", 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1465999999999998e-05 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.524 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2736 3.15 e74/57 3:ab40be98:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_199:head v 74'3, mlcod=71'1)", 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.443144181999997, 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01181012, 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:58:06.525 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021482+0000", 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.021485+0000", 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3300000000000001e-06 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.526 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026517+0000", 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050327200000000001 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026537+0000", 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9338999999999999e-05 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026549+0000", 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2503999999999999e-05 2024-09-10T05:58:06.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026632+0000", 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.2812999999999995e-05 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.026662+0000", 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0487000000000001e-05 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033237+0000", 2024-09-10T05:58:06.528 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0065745860000000003 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.033292+0000", 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5340999999999998e-05 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2745 3.24 3:27fa2e7c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:58:06.529 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.358430827999996, 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01530926, 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2745 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.530 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106196+0000", 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.106198+0000", 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1210000000000001e-06 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.531 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108168+0000", 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001970739 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108192+0000", 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3295e-05 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108202+0000", 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0570999999999999e-05 2024-09-10T05:58:06.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108305+0000", 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102372 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108488+0000", 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018349300000000001 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:06.533 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.108664+0000", 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017548600000000001 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.114060+0000", 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053960980000000002 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121391+0000", 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073313329999999998 2024-09-10T05:58:06.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121451+0000", 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0192000000000002e-05 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.121505+0000", 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3560000000000002e-05 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.535 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2752 3.29 3:97fc6057:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.288909493999995, 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016439492, 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2752 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.536 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175717+0000", 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.537 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.175720+0000", 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.004e-06 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177135+0000", 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0014152769999999999 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177165+0000", 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.538 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177181+0000", 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6059e-05 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177253+0000", 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.2412999999999999e-05 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177399+0000", 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014634000000000001 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.539 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.177545+0000", 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014562900000000001 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.182320+0000", 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047750600000000002 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192070+0000", 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097494950000000004 2024-09-10T05:58:06.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192114+0000", 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4693000000000001e-05 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.192156+0000", 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2091000000000001e-05 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.541 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2761 3.3c e74/57 3:3d0205fd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_224:head v 74'3, mlcod=73'1)", 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.192696643000005, 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011080148, 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271930+0000", 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.271932+0000", 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.543 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276147+0000", 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042151669999999997 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276169+0000", 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787999999999999e-05 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.544 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276181+0000", 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2160999999999999e-05 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276252+0000", 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0913000000000004e-05 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.276286+0000", 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3568000000000001e-05 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.545 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282940+0000", 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0066542149999999998 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.283010+0000", 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0066000000000003e-05 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.546 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2762 3.7 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.192550284999996, 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029944691999999998, 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2762 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.547 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272076+0000", 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.548 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.272079+0000", 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4420000000000001e-06 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274398+0000", 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.002319467 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274427+0000", 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9071e-05 2024-09-10T05:58:06.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274441+0000", 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4358999999999999e-05 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274527+0000", 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5414000000000006e-05 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274712+0000", 2024-09-10T05:58:06.550 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000185217 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.274827+0000", 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114509 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.282012+0000", 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0071857620000000001 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.551 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301885+0000", 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019872190000000001 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.301958+0000", 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3034000000000006e-05 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.302021+0000", 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.3226999999999996e-05 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2763 3.28 e74/57 3:17590569:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_226:head v 74'3, mlcod=66'1)", 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.176411795999996, 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012663901, 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.553 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288215+0000", 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.288217+0000", 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9889999999999999e-06 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.554 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291966+0000", 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037495570000000002 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.291993+0000", 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6652000000000002e-05 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292010+0000", 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6974e-05 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.556 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.556 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292106+0000", 2024-09-10T05:58:06.556 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6395000000000001e-05 2024-09-10T05:58:06.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.556 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.292122+0000", 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6239000000000002e-05 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300844+0000", 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0087211800000000003 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.300879+0000", 2024-09-10T05:58:06.557 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4915e-05 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2764 3.18 3:1b0940c2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.171570853000006, 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010823460999999999, 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.558 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2764 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293056+0000", 2024-09-10T05:58:06.559 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.293059+0000", 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0759999999999999e-06 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294945+0000", 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018859809999999999 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.560 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294969+0000", 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4664999999999998e-05 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.294984+0000", 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5065999999999999e-05 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295070+0000", 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6020999999999995e-05 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.561 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295235+0000", 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016487699999999999 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.295405+0000", 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016958699999999999 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303800+0000", 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083954000000000008 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.562 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303816+0000", 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5971e-05 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303852+0000", 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5435000000000002e-05 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.563 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.303879+0000", 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.7382e-05 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2774 3.1e 3:7aa7fd4b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.060494464000001, 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019083935, 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2774 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.565 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404132+0000", 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.404135+0000", 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2770000000000001e-06 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405892+0000", 2024-09-10T05:58:06.566 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017566260000000001 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405924+0000", 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1900000000000003e-05 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.405940+0000", 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5965999999999999e-05 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.567 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406034+0000", 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.4223999999999998e-05 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406159+0000", 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012542900000000001 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.406250+0000", 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.0741000000000004e-05 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.410956+0000", 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0047059830000000004 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423121+0000", 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012165362000000001 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423168+0000", 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6805000000000003e-05 2024-09-10T05:58:06.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.423216+0000", 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.7621999999999999e-05 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2778 3.15 e74/57 3:a95be5e6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_241:head v 74'4, mlcod=73'2)", 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 65.008731115000003, 2024-09-10T05:58:06.570 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011481007, 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455895+0000", 2024-09-10T05:58:06.571 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.455898+0000", 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.2069999999999998e-06 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460741+0000", 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048438889999999997 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460780+0000", 2024-09-10T05:58:06.572 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8748999999999998e-05 2024-09-10T05:58:06.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.573 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.573 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.573 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460796+0000", 2024-09-10T05:58:06.573 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5398999999999999e-05 2024-09-10T05:58:06.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.576 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.576 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.576 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460902+0000", 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010618199999999999 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.460943+0000", 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0949999999999999e-05 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.577 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467313+0000", 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063707149999999999 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.467376+0000", 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2916000000000005e-05 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:2780 3.15 e74/57 3:ab3ffea7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_243:head v 74'5, mlcod=74'3)", 2024-09-10T05:58:06.578 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.982931413000003, 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.015900708999999999, 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.579 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481695+0000", 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.481700+0000", 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.6539999999999998e-06 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485567+0000", 2024-09-10T05:58:06.580 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003867597 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485594+0000", 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6811000000000001e-05 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485606+0000", 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2381000000000001e-05 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485702+0000", 2024-09-10T05:58:06.581 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6031000000000003e-05 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.485736+0000", 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3247999999999997e-05 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497525+0000", 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011789721 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.582 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.497596+0000", 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0265999999999994e-05 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2784 3.8 3:135a450c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 64.940930390999995, 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011806379000000001, 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:06.583 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2784 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:06.584 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523696+0000", 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.523699+0000", 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.348e-06 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526257+0000", 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0025575540000000001 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.585 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526294+0000", 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7397000000000001e-05 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526309+0000", 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4871e-05 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526469+0000", 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015961 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.586 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526643+0000", 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017424199999999999 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.526803+0000", 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000159803 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.532006+0000", 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.005203582 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.587 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535433+0000", 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034261000000000001 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535471+0000", 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.8457000000000001e-05 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.535502+0000", 2024-09-10T05:58:06.588 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1415000000000003e-05 2024-09-10T05:58:06.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.589 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:06.589 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:06.589 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:06.591 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:58:06.591 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:06.585+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:06.692 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:06.687+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:06.724 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:06.724 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:06.724 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:06.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:58:06.793 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:06.789+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:06.819 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:58:06.893 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:06.889+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:06.911 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:06.911 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:06.911 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:06.911 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:06.911 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:06.926 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:58:06.993 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:06.987+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:07.050 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:07.050 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 158.488600042, 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.051 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:58:07.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.109457774999996, 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.056 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:07.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:58:07.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.062 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.100463113000004, 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:58:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3001 3.13 e90/24 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head v 90'4, mlcod=72'2)", 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.915154035999997, 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024776917999999998, 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131428+0000", 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.016e-06 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137163+0000", 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057351640000000001 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137204+0000", 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0836e-05 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137222+0000", 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137415+0000", 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019288399999999999 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137480+0000", 2024-09-10T05:58:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4776000000000005e-05 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156077+0000", 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018596850000000002 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156202+0000", 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012555500000000001 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3005 3.34 3:2febc67c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.871707495000003, 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024327333999999999, 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3005 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174875+0000", 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181125+0000", 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062498969999999999 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181161+0000", 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569999999999997e-05 2024-09-10T05:58:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181179+0000", 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8088999999999999e-05 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181333+0000", 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015358799999999999 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181593+0000", 2024-09-10T05:58:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025959699999999997 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181822+0000", 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022906700000000001 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.193600+0000", 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01177797 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.198883+0000", 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052831070000000004 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199068+0000", 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184821 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199199+0000", 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013147199999999999 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3012 3.24 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.777633023, 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.645952105, 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3012 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268950+0000", 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273458+0000", 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045087410000000001 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273497+0000", 2024-09-10T05:58:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8822000000000002e-05 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273516+0000", 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9300000000000002e-05 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273651+0000", 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273672+0000", 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1676999999999999e-05 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.884862+0000", 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.61118961599999999 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885232+0000", 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037011500000000002 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885644+0000", 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186100000000002 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.904417+0000", 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018772858999999999 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.910331+0000", 2024-09-10T05:58:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059138699999999999 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914700+0000", 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043697279999999998 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914898+0000", 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198035 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3020 3.14 3:2b6e0d00:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.079248661000001, 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033030490000000003, 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3020 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967333+0000", 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972079+0000", 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047458250000000004 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972114+0000", 2024-09-10T05:58:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5197999999999997e-05 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972130+0000", 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6317999999999999e-05 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972256+0000", 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012557599999999999 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972555+0000", 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029879599999999999 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972831+0000", 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027629999999999999 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.999160+0000", 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026329128 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000129+0000", 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096927000000000005 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000279+0000", 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014958300000000001 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000361+0000", 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2225999999999995e-05 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3021 3.b e91/90 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head v 91'3, mlcod=0'0)", 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.067496032999998, 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026046184999999999, 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979128+0000", 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5216000000000002e-05 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983799+0000", 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046708660000000001 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983819+0000", 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9996e-05 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983829+0000", 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173999999999999e-05 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983909+0000", 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9677000000000003e-05 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983938+0000", 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8506000000000001e-05 2024-09-10T05:58:07.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005057+0000", 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021119150999999999 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005129+0000", 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2599000000000001e-05 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3038 3.9 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.878263815, 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029031866999999999, 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3038 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.098 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168317+0000", 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172702+0000", 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043843019999999996 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172720+0000", 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8284999999999999e-05 2024-09-10T05:58:07.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172733+0000", 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3047999999999999e-05 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172846+0000", 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113281 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173043+0000", 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019643300000000001 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173322+0000", 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027913500000000002 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.186287+0000", 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012965302 2024-09-10T05:58:07.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197185+0000", 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010897831 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197278+0000", 2024-09-10T05:58:07.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2906999999999997e-05 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197347+0000", 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9252999999999996e-05 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3056 3.14 3:29c50966:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:07.104 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.659721750999999, 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023839230999999999, 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3056 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386860+0000", 2024-09-10T05:58:07.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.638e-06 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392248+0000", 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053876490000000004 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392276+0000", 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8240000000000001e-05 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392290+0000", 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4357e-05 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392397+0000", 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106897 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392568+0000", 2024-09-10T05:58:07.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017104800000000001 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392731+0000", 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162922 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.406474+0000", 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013743155999999999 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409945+0000", 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034706659999999999 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410581+0000", 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063596099999999999 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410697+0000", 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115697 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.110 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3059 3.34 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.624816897999999, 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026671028999999999, 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3059 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421765+0000", 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2510000000000001e-06 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425935+0000", 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041702730000000004 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425960+0000", 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5041999999999998e-05 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425976+0000", 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426110+0000", 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013405700000000001 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426325+0000", 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000215131 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426519+0000", 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000194246 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.436549+0000", 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010029688 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448235+0000", 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0116861 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448379+0000", 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143747 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448433+0000", 2024-09-10T05:58:07.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4759000000000002e-05 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3416 3.1 e100/24 3:808843e2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_5:head v 100'9, mlcod=93'7)", 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.365335465999999, 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027979082999999998, 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681246+0000", 2024-09-10T05:58:07.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6769999999999999e-06 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691491+0000", 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010244237 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691528+0000", 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7151999999999999e-05 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691547+0000", 2024-09-10T05:58:07.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8709999999999999e-05 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691714+0000", 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000167369 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691760+0000", 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5695999999999998e-05 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709087+0000", 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017327259000000001 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709223+0000", 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135983 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3457 3.14 3:2831b25f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:07.121 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.045332842000001, 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024902178000000001, 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3457 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:07.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001250+0000", 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5559999999999999e-06 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005190+0000", 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039401180000000003 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005220+0000", 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005236+0000", 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:58:07.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005366+0000", 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013042899999999999 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005583+0000", 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216698 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005795+0000", 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021261199999999999 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.015756+0000", 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009960076 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025862+0000", 2024-09-10T05:58:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010106484000000001 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026023+0000", 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016126899999999999 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026149+0000", 2024-09-10T05:58:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012524300000000001 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3527 3.34 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.1218587020000008, 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029448789, 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.128 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3527 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924725+0000", 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4340000000000002e-06 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929795+0000", 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050704119999999998 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929844+0000", 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8529999999999998e-05 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929870+0000", 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6273000000000001e-05 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930059+0000", 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189338 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930358+0000", 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029820500000000001 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930585+0000", 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227801 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.943164+0000", 2024-09-10T05:58:07.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012578045 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954035+0000", 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010871822 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954112+0000", 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6377000000000004e-05 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954169+0000", 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7552000000000001e-05 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3540 3.3 3:c0a030d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.8757811659999994, 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025740391000000001, 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.134 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3540 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:07.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170800+0000", 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3420000000000002e-06 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174879+0000", 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040782479999999996 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174907+0000", 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8507e-05 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174917+0000", 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0162e-05 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174986+0000", 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8929000000000004e-05 2024-09-10T05:58:07.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175105+0000", 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119156 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175205+0000", 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9630000000000007e-05 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.183734+0000", 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008529165 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196451+0000", 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012716867 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196501+0000", 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9495e-05 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196538+0000", 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7889999999999998e-05 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3805 3.f e103/24 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head v 103'13, mlcod=100'11)", 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5271100359999998, 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024687252, 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519471+0000", 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1629999999999999e-06 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521818+0000", 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002346622 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521856+0000", 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7651000000000003e-05 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521885+0000", 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9833999999999999e-05 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522050+0000", 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016488700000000001 2024-09-10T05:58:07.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522135+0000", 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4870000000000006e-05 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544022+0000", 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021886663000000001 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544156+0000", 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013456199999999999 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3886 3.34 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8074086969999996, 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.037223538, 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3886 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239173+0000", 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669999999999999e-06 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244645+0000", 2024-09-10T05:58:07.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054724689999999998 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244680+0000", 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.485e-05 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244699+0000", 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8732999999999998e-05 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244825+0000", 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012615400000000001 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245045+0000", 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022069900000000001 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245231+0000", 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000185236 2024-09-10T05:58:07.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.271326+0000", 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026095063000000002 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276174+0000", 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048486559999999998 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276304+0000", 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013003400000000001 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276394+0000", 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9577e-05 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3888 3.1c e103/24 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head v 103'14, mlcod=103'12)", 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:07.151 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7806432900000004, 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024494029, 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:07.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265938+0000", 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.418e-06 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268943+0000", 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030050979999999999 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268989+0000", 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6013000000000001e-05 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269014+0000", 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4403e-05 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269160+0000", 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146582 2024-09-10T05:58:07.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269218+0000", 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7238999999999999e-05 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290347+0000", 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021129577 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290430+0000", 2024-09-10T05:58:07.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699000000000002e-05 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3889 3.1a 3:59af3e8e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_458:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7804714879999999, 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023755387999999999, 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3889 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266111+0000", 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.207e-06 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272923+0000", 2024-09-10T05:58:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006812411 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272969+0000", 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6109999999999997e-05 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272995+0000", 2024-09-10T05:58:07.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5507000000000002e-05 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273138+0000", 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014260799999999999 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273453+0000", 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031509399999999998 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273736+0000", 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000283486 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284653+0000", 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010916571 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289571+0000", 2024-09-10T05:58:07.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049184830000000004 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289745+0000", 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017408500000000001 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289863+0000", 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011782600000000001 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3910 3.14 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4982807920000001, 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032209085999999998, 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3910 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.163 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548302+0000", 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9169999999999999e-06 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552324+0000", 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040218169999999996 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552352+0000", 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7606e-05 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552375+0000", 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3663e-05 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552452+0000", 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6762999999999997e-05 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552562+0000", 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110011 2024-09-10T05:58:07.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552695+0000", 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132371 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.561844+0000", 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091494290000000006 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580364+0000", 2024-09-10T05:58:07.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018519889000000001 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580464+0000", 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100008 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580507+0000", 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3612000000000002e-05 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.169 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:07.170 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:58:07.171 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:07.165+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:07.271 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:07.265+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:07.337 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:07.337 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:07.337 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:07.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:58:07.396 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:07.391+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:07.468 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:07.468 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:07.468 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:07.469 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:07.469 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:07.473 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:07.467+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:07.484 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:58:07.575 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:07.571+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:07.653 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.228572279000005, 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.654 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:07.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:58:07.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.721797719999998, 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:07.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:58:07.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.642100579000001, 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:58:07.666 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:58:07.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:58:07.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:07.672 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 66.453749732000006, 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:58:07.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3264 3.1c 3:3923a6c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:58:07.678 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.610903876999998, 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02663254, 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3264 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:07.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038547+0000", 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1860000000000002e-06 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044703+0000", 2024-09-10T05:58:07.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061553579999999997 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044742+0000", 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9156000000000003e-05 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044760+0000", 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.863e-05 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044913+0000", 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153048 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.045181+0000", 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026741299999999998 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.046065+0000", 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088462999999999996 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.062104+0000", 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016038812999999999 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.064938+0000", 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028335249999999999 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065088+0000", 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974500000000001 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065176+0000", 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8035999999999995e-05 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3417 3.37 e100/24 3:ee859745:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_6:head v 100'10, mlcod=91'8)", 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.954709391, 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028417909000000002, 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699999999999998e-07 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701552+0000", 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068132100000000001 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701602+0000", 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0482999999999998e-05 2024-09-10T05:58:07.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701627+0000", 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4530000000000001e-05 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701806+0000", 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179192 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701865+0000", 2024-09-10T05:58:07.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9416000000000002e-05 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723088+0000", 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021222933999999999 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723155+0000", 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7317000000000006e-05 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3469 3.28 3:15b30b29:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.524554793, 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026322306, 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3469 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124896+0000", 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999997e-06 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132908+0000", 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080112889999999996 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132952+0000", 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4663000000000003e-05 2024-09-10T05:58:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132983+0000", 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0800000000000003e-05 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133152+0000", 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168581 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133458+0000", 2024-09-10T05:58:07.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000306192 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133744+0000", 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028567399999999998 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.149676+0000", 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015932457000000001 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151030+0000", 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013541060000000001 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151127+0000", 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6274999999999996e-05 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151214+0000", 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7933e-05 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3517 3.2 3:42481240:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.8500749919999997, 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026698706999999999, 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3517 2024-09-10T05:58:07.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799376+0000", 2024-09-10T05:58:07.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1729999999999997e-06 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803201+0000", 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003825186 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803245+0000", 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4187000000000002e-05 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803263+0000", 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7467999999999999e-05 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803403+0000", 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013966900000000001 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803414+0000", 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1593999999999999e-05 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809545+0000", 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061312449999999996 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809926+0000", 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038063399999999997 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.810277+0000", 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035085699999999999 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.823285+0000", 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013008426999999999 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.825994+0000", 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027082510000000001 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826036+0000", 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2462000000000001e-05 2024-09-10T05:58:07.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826071+0000", 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4554000000000002e-05 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3808 3.2 3:41ef7625:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1050331690000004, 2024-09-10T05:58:07.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025521107000000001, 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3808 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544419+0000", 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3430000000000003e-06 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549878+0000", 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054584589999999997 2024-09-10T05:58:07.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549915+0000", 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7472999999999998e-05 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549932+0000", 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7136e-05 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550060+0000", 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012812699999999999 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550275+0000", 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021436400000000001 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550458+0000", 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018312800000000001 2024-09-10T05:58:07.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.558866+0000", 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084081569999999994 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569623+0000", 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010757139000000001 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569801+0000", 2024-09-10T05:58:07.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017797200000000001 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569935+0000", 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013380900000000001 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3815 3.5 3:a26771db:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_394:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.0377909909999996, 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024682987, 2024-09-10T05:58:07.707 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3815 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:07.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611660+0000", 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6370000000000001e-06 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615460+0000", 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00380088 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615496+0000", 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5772999999999998e-05 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615523+0000", 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6859000000000002e-05 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615724+0000", 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201366 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616167+0000", 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044238600000000002 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616565+0000", 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039797999999999998 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.629207+0000", 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012642146999999999 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636048+0000", 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068409880000000001 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636198+0000", 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014965900000000001 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636339+0000", 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014131199999999999 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3822 3.2f 3:f5691873:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_401:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9703587890000005, 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029772514, 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.713 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3822 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679092+0000", 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9910000000000004e-06 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682947+0000", 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038550630000000002 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682976+0000", 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8988000000000001e-05 2024-09-10T05:58:07.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682992+0000", 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6209e-05 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683193+0000", 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000200185 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683489+0000", 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296717 2024-09-10T05:58:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683725+0000", 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023543500000000001 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.695201+0000", 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011476513000000001 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708548+0000", 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013346373 2024-09-10T05:58:07.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708739+0000", 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019118499999999999 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708861+0000", 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121855 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3842 3.2f 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8632738910000004, 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034550046000000001, 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3842 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786179+0000", 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8069999999999996e-06 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791316+0000", 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051367679999999999 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791355+0000", 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9440000000000002e-05 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791373+0000", 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8352999999999999e-05 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791572+0000", 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019850799999999999 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791832+0000", 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025995199999999998 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792070+0000", 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023838099999999999 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.806866+0000", 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014796073999999999 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820440+0000", 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013573528 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820604+0000", 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016399599999999999 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820723+0000", 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119239 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3853 3.2 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7469014109999996, 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032847466999999998, 2024-09-10T05:58:07.724 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3853 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902549+0000", 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6880000000000001e-06 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908028+0000", 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054786820000000003 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908063+0000", 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4792999999999997e-05 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908087+0000", 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4499e-05 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908218+0000", 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130977 2024-09-10T05:58:07.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908410+0000", 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019136399999999999 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908651+0000", 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024184 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927151+0000", 2024-09-10T05:58:07.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018500103 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935254+0000", 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081027359999999993 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935323+0000", 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880000000000005e-05 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935393+0000", 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9905000000000002e-05 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3854 3.2 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7376550379999998, 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032334535999999997, 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.730 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3854 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911796+0000", 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7799999999999998e-06 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915942+0000", 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041458290000000002 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915977+0000", 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5682000000000002e-05 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916000+0000", 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2364000000000001e-05 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916619+0000", 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061924400000000002 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917000+0000", 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000381651 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917409+0000", 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040862500000000003 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.931292+0000", 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013882495 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943964+0000", 2024-09-10T05:58:07.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012672843 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944047+0000", 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2371000000000001e-05 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944126+0000", 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9652000000000002e-05 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3874 3.2 3:414c7108:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_443:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5371442220000002, 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028695409000000002, 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3874 2024-09-10T05:58:07.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112306+0000", 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.117951+0000", 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056447779999999996 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118011+0000", 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0179000000000001e-05 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118040+0000", 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.885e-05 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118251+0000", 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021135199999999999 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118565+0000", 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031331399999999998 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118877+0000", 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031258099999999998 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.137138+0000", 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018260345000000001 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140708+0000", 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035707590000000002 2024-09-10T05:58:07.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140883+0000", 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017462200000000001 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140998+0000", 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011507599999999999 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3878 3.2a 3:5587957a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_447:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4919952810000003, 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029379293000000001, 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3878 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.742 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157455+0000", 2024-09-10T05:58:07.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1999999999999999e-06 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161427+0000", 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039726149999999997 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161465+0000", 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7883000000000003e-05 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161484+0000", 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8465999999999999e-05 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161632+0000", 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014848199999999999 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161895+0000", 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000262835 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.162126+0000", 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230471 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.183957+0000", 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021831547 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186575+0000", 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002617608 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186718+0000", 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014299199999999999 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186831+0000", 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113194 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.747 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3879 3.2a 3:5472b1a4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_448:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4851647960000003, 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027503584000000001, 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3879 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164285+0000", 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0929999999999999e-06 2024-09-10T05:58:07.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171662+0000", 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073767499999999996 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171705+0000", 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2599999999999999e-05 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171731+0000", 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6812999999999999e-05 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171914+0000", 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018210899999999999 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172318+0000", 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040407699999999997 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172753+0000", 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043529899999999999 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.189712+0000", 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016959044 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191568+0000", 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018557510000000001 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191692+0000", 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012407299999999999 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191786+0000", 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3974999999999994e-05 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3887 3.36 e103/24 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head v 103'16, mlcod=102'14)", 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.395854011, 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025460763000000001, 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253596+0000", 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3349999999999998e-06 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255939+0000", 2024-09-10T05:58:07.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002342481 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255990+0000", 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1595999999999999e-05 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256015+0000", 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.438e-05 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256167+0000", 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015261699999999999 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256221+0000", 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3455999999999998e-05 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.278813+0000", 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022591946000000002 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279054+0000", 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024095200000000001 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3888 3.1c 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3905823850000001, 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032020736000000001, 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.758 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3888 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258869+0000", 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8899999999999998e-06 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265112+0000", 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062428429999999997 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265150+0000", 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7366000000000001e-05 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265169+0000", 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9089999999999998e-05 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265288+0000", 2024-09-10T05:58:07.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119085 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265498+0000", 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020986299999999999 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265757+0000", 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025964299999999999 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.280209+0000", 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014451311 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290711+0000", 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010502589 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290793+0000", 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1310999999999995e-05 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290885+0000", 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2744999999999994e-05 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3895 3.1d 3:b90a3a7e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_464:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3180289030000001, 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024479635999999999, 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:07.764 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3895 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331422+0000", 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.76e-06 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335102+0000", 2024-09-10T05:58:07.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003680104 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335143+0000", 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1006e-05 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335161+0000", 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8567999999999999e-05 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:07.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335338+0000", 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017661099999999999 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335689+0000", 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035125800000000002 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.336048+0000", 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035893299999999997 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.347421+0000", 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011372597999999999 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355631+0000", 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082105349999999997 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355779+0000", 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014740200000000001 2024-09-10T05:58:07.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355898+0000", 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118861 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:07.770 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:07.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:58:07.772 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:07.767+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:07.873 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:07.869+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:07.942 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:07.942 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:07.942 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:07.942 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:07.956 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:58:07.974 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:07.969+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:08.075 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:08.069+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:08.080 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:08.080 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:08.080 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:08.080 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:08.080 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:08.094 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:58:08.176 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:08.173+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 157.62729898200001, 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:58:08.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:58:08.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:58:08.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:58:08.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3000 3.26 3:66b3ccfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.114185550000002, 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026540508000000001, 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.226 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3000 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102039+0000", 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.213e-06 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108021+0000", 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059826480000000001 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108061+0000", 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9382999999999999e-05 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108079+0000", 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8542999999999998e-05 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108260+0000", 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018121000000000001 2024-09-10T05:58:08.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108677+0000", 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041657899999999998 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.109094+0000", 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000416807 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.127165+0000", 2024-09-10T05:58:08.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018071348000000001 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128257+0000", 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001091741 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128485+0000", 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022827700000000001 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128576+0000", 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0759000000000003e-05 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3002 3.36 3:6ef358c6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.081813420000003, 2024-09-10T05:58:08.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026032893000000001, 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3002 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134413+0000", 2024-09-10T05:58:08.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5639999999999996e-06 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140435+0000", 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060217939999999996 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140485+0000", 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0089000000000001e-05 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140505+0000", 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0186999999999998e-05 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140663+0000", 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157744 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141102+0000", 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043870399999999999 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141512+0000", 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041073500000000002 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.153730+0000", 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012217608 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160105+0000", 2024-09-10T05:58:08.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063753949999999998 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160301+0000", 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195551 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160440+0000", 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139522 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3009 3.33 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.993147137999998, 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71394179300000005, 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3009 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.239 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223079+0000", 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8029999999999996e-06 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227044+0000", 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003965021 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227081+0000", 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7153000000000002e-05 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227106+0000", 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5522999999999999e-05 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227283+0000", 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017625099999999999 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227305+0000", 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2200000000000001e-05 2024-09-10T05:58:08.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.911736+0000", 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.68443125800000004 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912098+0000", 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000361527 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912509+0000", 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186899999999998 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.930388+0000", 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017878817000000002 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936858+0000", 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064700369999999997 2024-09-10T05:58:08.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936908+0000", 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9792e-05 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.937016+0000", 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010754199999999999 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3042 3.a 3:50a6a854:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.996590986999998, 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023353200000000001, 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3042 2024-09-10T05:58:08.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219633+0000", 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0060000000000001e-06 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225187+0000", 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055536630000000003 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225218+0000", 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1353999999999998e-05 2024-09-10T05:58:08.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225234+0000", 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5519000000000002e-05 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225372+0000", 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013812699999999999 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225669+0000", 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029757699999999999 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225934+0000", 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026508599999999999 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239222+0000", 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01328796 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242760+0000", 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035374289999999999 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242891+0000", 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013163399999999999 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242983+0000", 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1844999999999999e-05 2024-09-10T05:58:08.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3046 3.1e 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.945063337000001, 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023372101999999999, 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.252 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3046 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:08.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271160+0000", 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275046+0000", 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003885707 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275067+0000", 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1642e-05 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275083+0000", 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5477000000000001e-05 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275168+0000", 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5079000000000003e-05 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275391+0000", 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022318699999999999 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275563+0000", 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017160499999999999 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.284169+0000", 2024-09-10T05:58:08.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086058950000000006 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294378+0000", 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010209885 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294463+0000", 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4661999999999997e-05 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294530+0000", 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6688999999999998e-05 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3062 3.a 3:510cfa22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.756925574999997, 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023825417000000002, 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.258 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3062 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459299+0000", 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0829999999999997e-06 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464231+0000", 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049315019999999999 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464266+0000", 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4904000000000003e-05 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464282+0000", 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464381+0000", 2024-09-10T05:58:08.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8698999999999998e-05 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464599+0000", 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218533 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:08.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464788+0000", 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188247 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475654+0000", 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010866549 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.482934+0000", 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072803160000000002 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483038+0000", 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010331 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483121+0000", 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3101000000000003e-05 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.264 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3419 3.1e 3:7bbb5ef4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.507508393, 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024061241000000001, 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3419 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708717+0000", 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999997e-06 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717539+0000", 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088221600000000008 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717582+0000", 2024-09-10T05:58:08.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999998e-05 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717607+0000", 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4532000000000002e-05 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717749+0000", 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014247500000000001 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718284+0000", 2024-09-10T05:58:08.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053459199999999997 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718669+0000", 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038528400000000001 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.729703+0000", 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011033687 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732433+0000", 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027304439999999998 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732615+0000", 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018145800000000001 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732774+0000", 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159149 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3449 3.20 3:06b085c8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.298887946000001, 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023229774000000002, 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.271 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3449 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917337+0000", 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922049+0000", 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004711135 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922104+0000", 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.592e-05 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922135+0000", 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0329e-05 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922305+0000", 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017053899999999999 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922568+0000", 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026224799999999997 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922808+0000", 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240678 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.932764+0000", 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099562020000000008 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940253+0000", 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074887970000000002 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940434+0000", 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018096799999999999 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940563+0000", 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128615 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3463 3.36 3:6eb508a9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.154051847, 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02333292, 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3463 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062176+0000", 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.956e-06 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066729+0000", 2024-09-10T05:58:08.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045528799999999996 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066763+0000", 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4471999999999998e-05 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066781+0000", 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7917000000000001e-05 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066948+0000", 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016702199999999999 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067181+0000", 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232869 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067421+0000", 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023939299999999999 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.076526+0000", 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091050300000000001 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085179+0000", 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086531899999999998 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085358+0000", 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017913900000000001 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085502+0000", 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014405200000000001 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3464 3.26 3:670772ec:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.1432982, 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027033292, 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3464 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072927+0000", 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7459999999999998e-06 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077023+0000", 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040969040000000002 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077070+0000", 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6876000000000003e-05 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077102+0000", 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1766e-05 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077220+0000", 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011787599999999999 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077448+0000", 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228175 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077666+0000", 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218216 2024-09-10T05:58:08.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099266+0000", 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021599679 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099650+0000", 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000384096 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099819+0000", 2024-09-10T05:58:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168746 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099956+0000", 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137212 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3515 3.33 3:cdf573bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:08.289 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.461160026, 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022302426, 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3515 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755064+0000", 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2969999999999999e-06 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759036+0000", 2024-09-10T05:58:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003971484 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759069+0000", 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3654e-05 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759086+0000", 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6736e-05 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759206+0000", 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120363 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759485+0000", 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027802399999999998 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759727+0000", 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024243499999999999 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.768857+0000", 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091297849999999996 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777204+0000", 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083474719999999999 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777293+0000", 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8306000000000005e-05 2024-09-10T05:58:08.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777363+0000", 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0870000000000004e-05 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3527 3.34 e101/24 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head v 101'12, mlcod=93'10)", 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.285332741, 2024-09-10T05:58:08.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022764337999999999, 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:08.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930889+0000", 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2130000000000001e-06 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934309+0000", 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034198950000000001 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934342+0000", 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2483000000000001e-05 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934358+0000", 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6439999999999998e-05 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934490+0000", 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013154599999999999 2024-09-10T05:58:08.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934530+0000", 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0590000000000003e-05 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953524+0000", 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018993344999999998 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953653+0000", 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882599999999999 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3570 3.26 3:67afa84d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5147912899999998, 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023228478, 2024-09-10T05:58:08.300 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3570 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701432+0000", 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6340000000000001e-06 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705705+0000", 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042724269999999996 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705729+0000", 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4107000000000001e-05 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705741+0000", 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2335e-05 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705897+0000", 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015548100000000001 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706177+0000", 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028081500000000001 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706408+0000", 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230991 2024-09-10T05:58:08.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.715905+0000", 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094962859999999996 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724359+0000", 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084545820000000004 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724526+0000", 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016648499999999999 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724658+0000", 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132335 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3853 3.2 e103/90 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head v 103'11, mlcod=103'9)", 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:08.306 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3073908970000003, 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026052486999999999, 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908833+0000", 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3050000000000001e-06 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912185+0000", 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00335177 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912243+0000", 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7635e-05 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912271+0000", 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7974e-05 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913259+0000", 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098803699999999999 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913318+0000", 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422000000000001e-05 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934525+0000", 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021206610000000001 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934883+0000", 2024-09-10T05:58:08.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035773400000000001 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3854 3.2 e103/90 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head v 103'12, mlcod=103'9)", 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.298571827, 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025998609999999998, 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.311 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917653+0000", 2024-09-10T05:58:08.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4000000000000001e-06 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922882+0000", 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052294120000000001 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922916+0000", 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4425999999999999e-05 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922939+0000", 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3050000000000001e-05 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923078+0000", 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013832800000000001 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923128+0000", 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0127000000000003e-05 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943488+0000", 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020360165999999999 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943648+0000", 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015970099999999999 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.315 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3883 3.26 3:6770c43b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_452:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.009734055, 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024529107000000001, 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3883 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206504+0000", 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6835999999999999e-05 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210252+0000", 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037487179999999998 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210283+0000", 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0341999999999999e-05 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210299+0000", 2024-09-10T05:58:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6663e-05 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210406+0000", 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106648 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210618+0000", 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021149600000000001 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:08.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210809+0000", 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000191418 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.229667+0000", 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018857604 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230689+0000", 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010224920000000001 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230877+0000", 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018767799999999999 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.231016+0000", 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013921199999999999 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.321 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3886 3.34 e103/24 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head v 103'21, mlcod=103'19)", 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9707934500000004, 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029486221999999999, 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245431+0000", 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7529999999999999e-06 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249357+0000", 2024-09-10T05:58:08.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039260179999999999 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249399+0000", 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1536999999999999e-05 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249419+0000", 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249577+0000", 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158021 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249722+0000", 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014495900000000001 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274800+0000", 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025077941999999999 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274914+0000", 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011417900000000001 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3887 3.36 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:08.326 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9680500609999996, 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031800800999999997, 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3887 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248176+0000", 2024-09-10T05:58:08.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6920000000000001e-06 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252399+0000", 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042231289999999999 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252445+0000", 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6678999999999998e-05 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252475+0000", 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9957000000000001e-05 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252597+0000", 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012193699999999999 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252960+0000", 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036250600000000002 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253367+0000", 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040692000000000001 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279695+0000", 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026328706 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279755+0000", 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9942999999999999e-05 2024-09-10T05:58:08.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279861+0000", 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279972+0000", 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111216 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3890 3.35 3:acfee5d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_459:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.9388103640000001, 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027993634999999999, 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3890 2024-09-10T05:58:08.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277414+0000", 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283323+0000", 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059094550000000001 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283358+0000", 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4260000000000001e-05 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283376+0000", 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7957000000000001e-05 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283518+0000", 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141884 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283786+0000", 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026811800000000002 2024-09-10T05:58:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284076+0000", 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029020000000000001 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.296068+0000", 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011992523 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:08.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305096+0000", 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090274710000000005 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305275+0000", 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178982 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305404+0000", 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012940200000000001 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.339 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:08.339 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:08.339 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:08.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:58:08.341 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:58:08.341 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:08.335+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:08.441 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:08.435+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:08.497 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:08.498 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:08.510 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:08.510 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:08.514 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:08.514 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:08.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:58:08.531 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:08.531 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:08.542 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:08.537+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:08.547 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:08.547 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:08.565 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:08.566 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:08.584 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:08.602 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:08.602 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:08.620 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:08.620 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:08.680 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:08.677+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:08.686 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:08.687 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:08.701 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:58:08.751 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:08.747+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:08.823 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:08.823 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:08.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:58:08.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:58:08.884 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:08.881+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:08.946 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:08.941+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:08.970 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:08.970 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:08.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:58:09.076 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:09.073+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:09.141 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:09.141 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:09.148 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:09.145+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:09.155 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:58:09.250 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:09.245+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:09.310 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:09.310 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:09.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:58:09.351 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:09.347+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:09.452 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:09.447+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:09.487 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:09.487 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:09.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:58:09.552 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:09.549+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:09.615 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:09.616 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:09.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:58:09.672 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:09.669+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:09.754 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:09.749+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:09.792 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:09.792 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:09.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:58:09.853 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:58:09.869 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:09.865+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:09.955 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:09.951+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:09.974 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:09.974 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:09.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:58:10.057 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:10.053+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:10.110 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:10.110 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:10.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:58:10.168 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:10.165+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:10.260 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:10.259+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:10.294 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:10.294 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:10.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:58:10.360 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:10.357+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:10.426 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:10.427 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:10.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:58:10.461 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:10.455+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:10.562 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:10.555+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:10.611 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:10.611 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:10.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:58:10.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:58:10.663 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:10.659+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:10.751 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:10.751 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:10.764 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:10.763+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:10.767 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:58:10.813 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:10.814 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:10.831 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:10.831 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:10.847 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:10.864 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:10.861+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:10.866 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:10.887 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:10.887 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:10.902 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:10.903 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:10.903 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:10.903 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:10.906 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:10.906 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:10.918 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:58:10.926 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:10.927 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:10.947 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:10.947 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:10.967 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:10.963+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:11.040 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:11.040 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:11.040 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:11.054 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:58:11.099 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:11.095+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:11.167 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:11.163+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:11.224 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:11.224 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:11.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:11.224 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:11.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.224 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:58:11.224 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 162.662676594, 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:58:11.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:58:11.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:58:11.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.283534326999998, 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:58:11.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:58:11.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:58:11.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:58:11.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:58:11.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:58:11.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:58:11.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:58:11.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.274539665000006, 2024-09-10T05:58:11.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:58:11.240 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:11.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:58:11.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:58:11.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:58:11.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3001 3.13 e90/24 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head v 90'4, mlcod=72'2)", 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.089230587999999, 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024776917999999998, 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131428+0000", 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.016e-06 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137163+0000", 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057351640000000001 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137204+0000", 2024-09-10T05:58:11.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0836e-05 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137222+0000", 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137415+0000", 2024-09-10T05:58:11.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019288399999999999 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137480+0000", 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4776000000000005e-05 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156077+0000", 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018596850000000002 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156202+0000", 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012555500000000001 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3005 3.34 3:2febc67c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.045784046999998, 2024-09-10T05:58:11.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024327333999999999, 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3005 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:11.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174875+0000", 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181125+0000", 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062498969999999999 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181161+0000", 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569999999999997e-05 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181179+0000", 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8088999999999999e-05 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181333+0000", 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015358799999999999 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181593+0000", 2024-09-10T05:58:11.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025959699999999997 2024-09-10T05:58:11.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181822+0000", 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022906700000000001 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.193600+0000", 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01177797 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.198883+0000", 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052831070000000004 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199068+0000", 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184821 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199199+0000", 2024-09-10T05:58:11.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013147199999999999 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3012 3.24 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.951709575000002, 2024-09-10T05:58:11.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.645952105, 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3012 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268950+0000", 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273458+0000", 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045087410000000001 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273497+0000", 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8822000000000002e-05 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273516+0000", 2024-09-10T05:58:11.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9300000000000002e-05 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273651+0000", 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273672+0000", 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1676999999999999e-05 2024-09-10T05:58:11.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.884862+0000", 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.61118961599999999 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885232+0000", 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037011500000000002 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885644+0000", 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186100000000002 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.904417+0000", 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018772858999999999 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.910331+0000", 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059138699999999999 2024-09-10T05:58:11.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914700+0000", 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043697279999999998 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914898+0000", 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198035 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.268 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3020 3.14 3:2b6e0d00:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.253325212999997, 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033030490000000003, 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.269 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3020 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967333+0000", 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972079+0000", 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047458250000000004 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972114+0000", 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5197999999999997e-05 2024-09-10T05:58:11.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972130+0000", 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6317999999999999e-05 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972256+0000", 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012557599999999999 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972555+0000", 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029879599999999999 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972831+0000", 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027629999999999999 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.999160+0000", 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026329128 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000129+0000", 2024-09-10T05:58:11.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096927000000000005 2024-09-10T05:58:11.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000279+0000", 2024-09-10T05:58:11.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014958300000000001 2024-09-10T05:58:11.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000361+0000", 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2225999999999995e-05 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3021 3.b e91/90 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head v 91'3, mlcod=0'0)", 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.241572585, 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026046184999999999, 2024-09-10T05:58:11.276 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979128+0000", 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5216000000000002e-05 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983799+0000", 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046708660000000001 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983819+0000", 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9996e-05 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983829+0000", 2024-09-10T05:58:11.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173999999999999e-05 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983909+0000", 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9677000000000003e-05 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983938+0000", 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8506000000000001e-05 2024-09-10T05:58:11.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005057+0000", 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021119150999999999 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005129+0000", 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2599000000000001e-05 2024-09-10T05:58:11.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3038 3.9 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.052340366999999, 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029031866999999999, 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.282 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3038 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168317+0000", 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172702+0000", 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043843019999999996 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172720+0000", 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8284999999999999e-05 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172733+0000", 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3047999999999999e-05 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172846+0000", 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113281 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173043+0000", 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019643300000000001 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173322+0000", 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027913500000000002 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.186287+0000", 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012965302 2024-09-10T05:58:11.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197185+0000", 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010897831 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197278+0000", 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2906999999999997e-05 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197347+0000", 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9252999999999996e-05 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3056 3.14 3:29c50966:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.833798303000002, 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023839230999999999, 2024-09-10T05:58:11.288 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3056 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.289 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:11.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386860+0000", 2024-09-10T05:58:11.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.638e-06 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392248+0000", 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053876490000000004 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392276+0000", 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8240000000000001e-05 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392290+0000", 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4357e-05 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392397+0000", 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106897 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392568+0000", 2024-09-10T05:58:11.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017104800000000001 2024-09-10T05:58:11.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392731+0000", 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162922 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.406474+0000", 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013743155999999999 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409945+0000", 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034706659999999999 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410581+0000", 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063596099999999999 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410697+0000", 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115697 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3059 3.34 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.798893450000001, 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026671028999999999, 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.298 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3059 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421765+0000", 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2510000000000001e-06 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425935+0000", 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041702730000000004 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425960+0000", 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5041999999999998e-05 2024-09-10T05:58:11.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425976+0000", 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426110+0000", 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013405700000000001 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426325+0000", 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000215131 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426519+0000", 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000194246 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.436549+0000", 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010029688 2024-09-10T05:58:11.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448235+0000", 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0116861 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448379+0000", 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143747 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448433+0000", 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4759000000000002e-05 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3416 3.1 e100/24 3:808843e2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_5:head v 100'9, mlcod=93'7)", 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.539412018, 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027979082999999998, 2024-09-10T05:58:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:11.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681246+0000", 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6769999999999999e-06 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691491+0000", 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010244237 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691528+0000", 2024-09-10T05:58:11.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7151999999999999e-05 2024-09-10T05:58:11.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691547+0000", 2024-09-10T05:58:11.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8709999999999999e-05 2024-09-10T05:58:11.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691714+0000", 2024-09-10T05:58:11.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000167369 2024-09-10T05:58:11.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691760+0000", 2024-09-10T05:58:11.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5695999999999998e-05 2024-09-10T05:58:11.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709087+0000", 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017327259000000001 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709223+0000", 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135983 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.311 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.312 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3457 3.14 3:2831b25f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:11.312 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:11.312 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.219409393999999, 2024-09-10T05:58:11.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024902178000000001, 2024-09-10T05:58:11.313 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.313 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.313 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3457 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:11.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001250+0000", 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5559999999999999e-06 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005190+0000", 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039401180000000003 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005220+0000", 2024-09-10T05:58:11.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:58:11.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005236+0000", 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005366+0000", 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013042899999999999 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005583+0000", 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216698 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005795+0000", 2024-09-10T05:58:11.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021261199999999999 2024-09-10T05:58:11.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.015756+0000", 2024-09-10T05:58:11.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009960076 2024-09-10T05:58:11.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025862+0000", 2024-09-10T05:58:11.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010106484000000001 2024-09-10T05:58:11.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026023+0000", 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016126899999999999 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026149+0000", 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012524300000000001 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3527 3.34 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.295935254, 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029448789, 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.323 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3527 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924725+0000", 2024-09-10T05:58:11.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4340000000000002e-06 2024-09-10T05:58:11.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929795+0000", 2024-09-10T05:58:11.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050704119999999998 2024-09-10T05:58:11.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929844+0000", 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8529999999999998e-05 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929870+0000", 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6273000000000001e-05 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930059+0000", 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189338 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930358+0000", 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029820500000000001 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930585+0000", 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227801 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.943164+0000", 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012578045 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954035+0000", 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010871822 2024-09-10T05:58:11.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954112+0000", 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6377000000000004e-05 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954169+0000", 2024-09-10T05:58:11.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7552000000000001e-05 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3540 3.3 3:c0a030d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.049857718, 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025740391000000001, 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3540 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170800+0000", 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3420000000000002e-06 2024-09-10T05:58:11.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174879+0000", 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040782479999999996 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174907+0000", 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8507e-05 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174917+0000", 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0162e-05 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174986+0000", 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8929000000000004e-05 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175105+0000", 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119156 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175205+0000", 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9630000000000007e-05 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.183734+0000", 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008529165 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196451+0000", 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012716867 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196501+0000", 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9495e-05 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196538+0000", 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7889999999999998e-05 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.337 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3805 3.f e103/24 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head v 103'13, mlcod=100'11)", 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7011865880000006, 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024687252, 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519471+0000", 2024-09-10T05:58:11.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1629999999999999e-06 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521818+0000", 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002346622 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521856+0000", 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7651000000000003e-05 2024-09-10T05:58:11.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521885+0000", 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9833999999999999e-05 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522050+0000", 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016488700000000001 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522135+0000", 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4870000000000006e-05 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544022+0000", 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021886663000000001 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544156+0000", 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013456199999999999 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3886 3.34 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9814852490000003, 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.037223538, 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3886 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239173+0000", 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669999999999999e-06 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244645+0000", 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054724689999999998 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244680+0000", 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.485e-05 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244699+0000", 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8732999999999998e-05 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244825+0000", 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012615400000000001 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245045+0000", 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022069900000000001 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245231+0000", 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000185236 2024-09-10T05:58:11.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.271326+0000", 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026095063000000002 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276174+0000", 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048486559999999998 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276304+0000", 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013003400000000001 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276394+0000", 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9577e-05 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3888 3.1c e103/24 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head v 103'14, mlcod=103'12)", 2024-09-10T05:58:11.349 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9547198419999994, 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024494029, 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265938+0000", 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.418e-06 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268943+0000", 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030050979999999999 2024-09-10T05:58:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268989+0000", 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6013000000000001e-05 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269014+0000", 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4403e-05 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269160+0000", 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146582 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269218+0000", 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7238999999999999e-05 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290347+0000", 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021129577 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290430+0000", 2024-09-10T05:58:11.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699000000000002e-05 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3889 3.1a 3:59af3e8e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_458:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9545480400000006, 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023755387999999999, 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.355 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3889 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266111+0000", 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.207e-06 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272923+0000", 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006812411 2024-09-10T05:58:11.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272969+0000", 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6109999999999997e-05 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272995+0000", 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5507000000000002e-05 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273138+0000", 2024-09-10T05:58:11.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014260799999999999 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273453+0000", 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031509399999999998 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273736+0000", 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000283486 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284653+0000", 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010916571 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289571+0000", 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049184830000000004 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289745+0000", 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017408500000000001 2024-09-10T05:58:11.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289863+0000", 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011782600000000001 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3910 3.14 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.6723573439999999, 2024-09-10T05:58:11.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032209085999999998, 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3910 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548302+0000", 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9169999999999999e-06 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552324+0000", 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040218169999999996 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552352+0000", 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7606e-05 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552375+0000", 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3663e-05 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552452+0000", 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6762999999999997e-05 2024-09-10T05:58:11.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552562+0000", 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110011 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552695+0000", 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132371 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.561844+0000", 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091494290000000006 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580364+0000", 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018519889000000001 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580464+0000", 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100008 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580507+0000", 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3612000000000002e-05 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.368 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:11.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:58:11.370 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:11.363+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:11.470 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:11.465+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:11.539 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:11.539 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:11.539 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:11.540 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:11.553 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:58:11.599 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:11.595+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:11.671 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:11.671 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:11.671 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:11.669+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:11.685 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:58:11.775 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:11.771+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:11.852 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 84.426790381000004, 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:58:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:58:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.920015821999996, 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:58:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:58:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:58:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.840318680999999, 2024-09-10T05:58:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:58:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:58:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 70.651967834000004, 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:58:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:58:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:58:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:58:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:58:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:58:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3264 3.1c 3:3923a6c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:58:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 33.809121978999997, 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02663254, 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3264 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038547+0000", 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1860000000000002e-06 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044703+0000", 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061553579999999997 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044742+0000", 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9156000000000003e-05 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044760+0000", 2024-09-10T05:58:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.863e-05 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044913+0000", 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153048 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.045181+0000", 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026741299999999998 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.046065+0000", 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088462999999999996 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.062104+0000", 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016038812999999999 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.064938+0000", 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028335249999999999 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065088+0000", 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974500000000001 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065176+0000", 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8035999999999995e-05 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3417 3.37 e100/24 3:ee859745:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_6:head v 100'10, mlcod=91'8)", 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.152927493, 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028417909000000002, 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699999999999998e-07 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701552+0000", 2024-09-10T05:58:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068132100000000001 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701602+0000", 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0482999999999998e-05 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701627+0000", 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4530000000000001e-05 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701806+0000", 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179192 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701865+0000", 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9416000000000002e-05 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723088+0000", 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021222933999999999 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723155+0000", 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7317000000000006e-05 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3469 3.28 3:15b30b29:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.722772895, 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026322306, 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3469 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124896+0000", 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999997e-06 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132908+0000", 2024-09-10T05:58:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080112889999999996 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132952+0000", 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4663000000000003e-05 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132983+0000", 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0800000000000003e-05 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133152+0000", 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168581 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133458+0000", 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000306192 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133744+0000", 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028567399999999998 2024-09-10T05:58:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.149676+0000", 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015932457000000001 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151030+0000", 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013541060000000001 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151127+0000", 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6274999999999996e-05 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151214+0000", 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7933e-05 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3517 3.2 3:42481240:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.048293094, 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026698706999999999, 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3517 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799376+0000", 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1729999999999997e-06 2024-09-10T05:58:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803201+0000", 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003825186 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803245+0000", 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4187000000000002e-05 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803263+0000", 2024-09-10T05:58:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7467999999999999e-05 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803403+0000", 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013966900000000001 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803414+0000", 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1593999999999999e-05 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809545+0000", 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061312449999999996 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809926+0000", 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038063399999999997 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.810277+0000", 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035085699999999999 2024-09-10T05:58:11.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.823285+0000", 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013008426999999999 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.825994+0000", 2024-09-10T05:58:11.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027082510000000001 2024-09-10T05:58:11.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826036+0000", 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2462000000000001e-05 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826071+0000", 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4554000000000002e-05 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3808 3.2 3:41ef7625:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.905 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.303251271000001, 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025521107000000001, 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3808 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544419+0000", 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3430000000000003e-06 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549878+0000", 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054584589999999997 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549915+0000", 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7472999999999998e-05 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549932+0000", 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7136e-05 2024-09-10T05:58:11.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550060+0000", 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012812699999999999 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550275+0000", 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021436400000000001 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550458+0000", 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018312800000000001 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.558866+0000", 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084081569999999994 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569623+0000", 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010757139000000001 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569801+0000", 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017797200000000001 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569935+0000", 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013380900000000001 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.911 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3815 3.5 3:a26771db:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_394:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.236009093, 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024682987, 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3815 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611660+0000", 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6370000000000001e-06 2024-09-10T05:58:11.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615460+0000", 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00380088 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615496+0000", 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5772999999999998e-05 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615523+0000", 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6859000000000002e-05 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615724+0000", 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201366 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616167+0000", 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044238600000000002 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616565+0000", 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039797999999999998 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.629207+0000", 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012642146999999999 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636048+0000", 2024-09-10T05:58:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068409880000000001 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636198+0000", 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014965900000000001 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636339+0000", 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014131199999999999 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3822 3.2f 3:f5691873:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_401:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.168576891000001, 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029772514, 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3822 2024-09-10T05:58:11.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679092+0000", 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9910000000000004e-06 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682947+0000", 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038550630000000002 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682976+0000", 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8988000000000001e-05 2024-09-10T05:58:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682992+0000", 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6209e-05 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683193+0000", 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000200185 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683489+0000", 2024-09-10T05:58:11.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296717 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683725+0000", 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023543500000000001 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.695201+0000", 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011476513000000001 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708548+0000", 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013346373 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708739+0000", 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019118499999999999 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708861+0000", 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121855 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.923 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3842 3.2f 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.061491993000001, 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034550046000000001, 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.924 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3842 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:11.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786179+0000", 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8069999999999996e-06 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791316+0000", 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051367679999999999 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791355+0000", 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9440000000000002e-05 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791373+0000", 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8352999999999999e-05 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791572+0000", 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019850799999999999 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791832+0000", 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025995199999999998 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792070+0000", 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023838099999999999 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.806866+0000", 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014796073999999999 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820440+0000", 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013573528 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820604+0000", 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016399599999999999 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820723+0000", 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119239 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3853 3.2 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.9451195129999999, 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032847466999999998, 2024-09-10T05:58:11.930 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3853 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902549+0000", 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6880000000000001e-06 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908028+0000", 2024-09-10T05:58:11.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054786820000000003 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908063+0000", 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4792999999999997e-05 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908087+0000", 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4499e-05 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908218+0000", 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130977 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908410+0000", 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019136399999999999 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908651+0000", 2024-09-10T05:58:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024184 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927151+0000", 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018500103 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935254+0000", 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081027359999999993 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935323+0000", 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880000000000005e-05 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935393+0000", 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9905000000000002e-05 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3854 3.2 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:11.936 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.93587314, 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032334535999999997, 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3854 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911796+0000", 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7799999999999998e-06 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915942+0000", 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041458290000000002 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915977+0000", 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5682000000000002e-05 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916000+0000", 2024-09-10T05:58:11.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2364000000000001e-05 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916619+0000", 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061924400000000002 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917000+0000", 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000381651 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917409+0000", 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040862500000000003 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.931292+0000", 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013882495 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943964+0000", 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012672843 2024-09-10T05:58:11.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944047+0000", 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2371000000000001e-05 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944126+0000", 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9652000000000002e-05 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3874 3.2 3:414c7108:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_443:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7353623240000005, 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028695409000000002, 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3874 2024-09-10T05:58:11.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112306+0000", 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.117951+0000", 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056447779999999996 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118011+0000", 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0179000000000001e-05 2024-09-10T05:58:11.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118040+0000", 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.885e-05 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118251+0000", 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021135199999999999 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118565+0000", 2024-09-10T05:58:11.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031331399999999998 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118877+0000", 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031258099999999998 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.137138+0000", 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018260345000000001 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140708+0000", 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035707590000000002 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140883+0000", 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017462200000000001 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140998+0000", 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011507599999999999 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.948 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3878 3.2a 3:5587957a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_447:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.6902133829999997, 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029379293000000001, 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.949 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3878 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157455+0000", 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1999999999999999e-06 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161427+0000", 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039726149999999997 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161465+0000", 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7883000000000003e-05 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161484+0000", 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8465999999999999e-05 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161632+0000", 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014848199999999999 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161895+0000", 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000262835 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.162126+0000", 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230471 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.183957+0000", 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021831547 2024-09-10T05:58:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186575+0000", 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002617608 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186718+0000", 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014299199999999999 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186831+0000", 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113194 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3879 3.2a 3:5472b1a4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_448:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.6833828979999996, 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027503584000000001, 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.955 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3879 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164285+0000", 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0929999999999999e-06 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171662+0000", 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073767499999999996 2024-09-10T05:58:11.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171705+0000", 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2599999999999999e-05 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171731+0000", 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6812999999999999e-05 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171914+0000", 2024-09-10T05:58:11.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018210899999999999 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172318+0000", 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040407699999999997 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172753+0000", 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043529899999999999 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.189712+0000", 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016959044 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191568+0000", 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018557510000000001 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191692+0000", 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012407299999999999 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191786+0000", 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3974999999999994e-05 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3887 3.36 e103/24 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head v 103'16, mlcod=102'14)", 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5940721129999993, 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025460763000000001, 2024-09-10T05:58:11.961 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253596+0000", 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3349999999999998e-06 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255939+0000", 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002342481 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255990+0000", 2024-09-10T05:58:11.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1595999999999999e-05 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256015+0000", 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.438e-05 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256167+0000", 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015261699999999999 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256221+0000", 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3455999999999998e-05 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.278813+0000", 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022591946000000002 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279054+0000", 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024095200000000001 2024-09-10T05:58:11.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3888 3.1c 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5888004870000003, 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032020736000000001, 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.966 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3888 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258869+0000", 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8899999999999998e-06 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265112+0000", 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062428429999999997 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265150+0000", 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7366000000000001e-05 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265169+0000", 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9089999999999998e-05 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265288+0000", 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119085 2024-09-10T05:58:11.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265498+0000", 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020986299999999999 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265757+0000", 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025964299999999999 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.280209+0000", 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014451311 2024-09-10T05:58:11.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290711+0000", 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010502589 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290793+0000", 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1310999999999995e-05 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290885+0000", 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2744999999999994e-05 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3895 3.1d 3:b90a3a7e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_464:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.5162470050000003, 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024479635999999999, 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:11.972 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3895 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331422+0000", 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.76e-06 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335102+0000", 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003680104 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335143+0000", 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1006e-05 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335161+0000", 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8567999999999999e-05 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335338+0000", 2024-09-10T05:58:11.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017661099999999999 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335689+0000", 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035125800000000002 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.336048+0000", 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035893299999999997 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.347421+0000", 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011372597999999999 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355631+0000", 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082105349999999997 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355779+0000", 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014740200000000001 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355898+0000", 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118861 2024-09-10T05:58:11.978 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:11.979 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:11.979 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:11.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:58:11.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:58:11.981 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:11.979+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:12.081 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:12.077+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:12.150 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:12.151 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:12.151 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:12.165 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:58:12.182 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:12.177+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:12.283 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:12.279+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:12.289 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:12.289 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:12.289 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:12.289 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:12.289 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:12.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:58:12.384 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:12.381+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:12.478 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:12.478 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 161.88569567900001, 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.479 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:12.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:58:12.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:58:12.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:58:12.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3000 3.26 3:66b3ccfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.372582246999997, 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026540508000000001, 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3000 2024-09-10T05:58:12.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102039+0000", 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.213e-06 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108021+0000", 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059826480000000001 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108061+0000", 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9382999999999999e-05 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108079+0000", 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8542999999999998e-05 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108260+0000", 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018121000000000001 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108677+0000", 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041657899999999998 2024-09-10T05:58:12.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.109094+0000", 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000416807 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.127165+0000", 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018071348000000001 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128257+0000", 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001091741 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128485+0000", 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022827700000000001 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128576+0000", 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0759000000000003e-05 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.492 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3002 3.36 3:6ef358c6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.340210116999998, 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026032893000000001, 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3002 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134413+0000", 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5639999999999996e-06 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140435+0000", 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060217939999999996 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140485+0000", 2024-09-10T05:58:12.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0089000000000001e-05 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140505+0000", 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0186999999999998e-05 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140663+0000", 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157744 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141102+0000", 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043870399999999999 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141512+0000", 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041073500000000002 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.153730+0000", 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012217608 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160105+0000", 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063753949999999998 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160301+0000", 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195551 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160440+0000", 2024-09-10T05:58:12.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139522 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3009 3.33 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.251543835, 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71394179300000005, 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3009 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223079+0000", 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8029999999999996e-06 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227044+0000", 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003965021 2024-09-10T05:58:12.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227081+0000", 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7153000000000002e-05 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227106+0000", 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5522999999999999e-05 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227283+0000", 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017625099999999999 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227305+0000", 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2200000000000001e-05 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.911736+0000", 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.68443125800000004 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912098+0000", 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000361527 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912509+0000", 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186899999999998 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.930388+0000", 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017878817000000002 2024-09-10T05:58:12.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936858+0000", 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064700369999999997 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936908+0000", 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9792e-05 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.937016+0000", 2024-09-10T05:58:12.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010754199999999999 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3042 3.a 3:50a6a854:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.254987684, 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023353200000000001, 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3042 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:12.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219633+0000", 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0060000000000001e-06 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225187+0000", 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055536630000000003 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225218+0000", 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1353999999999998e-05 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225234+0000", 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5519000000000002e-05 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225372+0000", 2024-09-10T05:58:12.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013812699999999999 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225669+0000", 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029757699999999999 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225934+0000", 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026508599999999999 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239222+0000", 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01328796 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242760+0000", 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035374289999999999 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242891+0000", 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013163399999999999 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242983+0000", 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1844999999999999e-05 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3046 3.1e 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.203460034000003, 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023372101999999999, 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.512 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3046 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271160+0000", 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275046+0000", 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003885707 2024-09-10T05:58:12.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275067+0000", 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1642e-05 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275083+0000", 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5477000000000001e-05 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275168+0000", 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5079000000000003e-05 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275391+0000", 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022318699999999999 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275563+0000", 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017160499999999999 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.284169+0000", 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086058950000000006 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294378+0000", 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010209885 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294463+0000", 2024-09-10T05:58:12.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4661999999999997e-05 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294530+0000", 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6688999999999998e-05 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3062 3.a 3:510cfa22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.015322271999999, 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023825417000000002, 2024-09-10T05:58:12.518 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3062 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459299+0000", 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0829999999999997e-06 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464231+0000", 2024-09-10T05:58:12.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049315019999999999 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464266+0000", 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4904000000000003e-05 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464282+0000", 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464381+0000", 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8698999999999998e-05 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464599+0000", 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218533 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464788+0000", 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188247 2024-09-10T05:58:12.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475654+0000", 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010866549 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.482934+0000", 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072803160000000002 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483038+0000", 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010331 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483121+0000", 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3101000000000003e-05 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.524 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3419 3.1e 3:7bbb5ef4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.76590509, 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024061241000000001, 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3419 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708717+0000", 2024-09-10T05:58:12.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999997e-06 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717539+0000", 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088221600000000008 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717582+0000", 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999998e-05 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717607+0000", 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4532000000000002e-05 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717749+0000", 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014247500000000001 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718284+0000", 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053459199999999997 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718669+0000", 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038528400000000001 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.729703+0000", 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011033687 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732433+0000", 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027304439999999998 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732615+0000", 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018145800000000001 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732774+0000", 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159149 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3449 3.20 3:06b085c8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.557284642999999, 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023229774000000002, 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.531 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3449 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917337+0000", 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922049+0000", 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004711135 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922104+0000", 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.592e-05 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922135+0000", 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0329e-05 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922305+0000", 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017053899999999999 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922568+0000", 2024-09-10T05:58:12.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026224799999999997 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922808+0000", 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240678 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.932764+0000", 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099562020000000008 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940253+0000", 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074887970000000002 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940434+0000", 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018096799999999999 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940563+0000", 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128615 2024-09-10T05:58:12.536 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3463 3.36 3:6eb508a9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.412448544, 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02333292, 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.537 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3463 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:12.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062176+0000", 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.956e-06 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066729+0000", 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045528799999999996 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066763+0000", 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4471999999999998e-05 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066781+0000", 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7917000000000001e-05 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066948+0000", 2024-09-10T05:58:12.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016702199999999999 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067181+0000", 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232869 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067421+0000", 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023939299999999999 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.076526+0000", 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091050300000000001 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085179+0000", 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086531899999999998 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085358+0000", 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017913900000000001 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085502+0000", 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014405200000000001 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3464 3.26 3:670772ec:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.401694897, 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027033292, 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.543 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3464 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072927+0000", 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7459999999999998e-06 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077023+0000", 2024-09-10T05:58:12.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040969040000000002 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077070+0000", 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6876000000000003e-05 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077102+0000", 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1766e-05 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077220+0000", 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011787599999999999 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077448+0000", 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228175 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077666+0000", 2024-09-10T05:58:12.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218216 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099266+0000", 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021599679 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099650+0000", 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000384096 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099819+0000", 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168746 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099956+0000", 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137212 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3515 3.33 3:cdf573bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.719556723, 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022302426, 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3515 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755064+0000", 2024-09-10T05:58:12.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2969999999999999e-06 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759036+0000", 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003971484 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759069+0000", 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3654e-05 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759086+0000", 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6736e-05 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759206+0000", 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120363 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759485+0000", 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027802399999999998 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759727+0000", 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024243499999999999 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.768857+0000", 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091297849999999996 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777204+0000", 2024-09-10T05:58:12.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083474719999999999 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777293+0000", 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8306000000000005e-05 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777363+0000", 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0870000000000004e-05 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3527 3.34 e101/24 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head v 101'12, mlcod=93'10)", 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.543729438, 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022764337999999999, 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:12.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930889+0000", 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2130000000000001e-06 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934309+0000", 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034198950000000001 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934342+0000", 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2483000000000001e-05 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934358+0000", 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6439999999999998e-05 2024-09-10T05:58:12.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934490+0000", 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013154599999999999 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934530+0000", 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0590000000000003e-05 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953524+0000", 2024-09-10T05:58:12.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018993344999999998 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953653+0000", 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882599999999999 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3570 3.26 3:67afa84d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:12.560 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.773187987, 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023228478, 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3570 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:12.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701432+0000", 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6340000000000001e-06 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705705+0000", 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042724269999999996 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705729+0000", 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4107000000000001e-05 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705741+0000", 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2335e-05 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705897+0000", 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015548100000000001 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706177+0000", 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028081500000000001 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706408+0000", 2024-09-10T05:58:12.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230991 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.715905+0000", 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094962859999999996 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724359+0000", 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084545820000000004 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724526+0000", 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016648499999999999 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724658+0000", 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132335 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.566 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3853 3.2 e103/90 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head v 103'11, mlcod=103'9)", 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.565787594, 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026052486999999999, 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908833+0000", 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3050000000000001e-06 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912185+0000", 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00335177 2024-09-10T05:58:12.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912243+0000", 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7635e-05 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912271+0000", 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7974e-05 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913259+0000", 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098803699999999999 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913318+0000", 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422000000000001e-05 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934525+0000", 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021206610000000001 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934883+0000", 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035773400000000001 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3854 3.2 e103/90 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head v 103'12, mlcod=103'9)", 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.556968524, 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025998609999999998, 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.571 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917653+0000", 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4000000000000001e-06 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922882+0000", 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052294120000000001 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922916+0000", 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4425999999999999e-05 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922939+0000", 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3050000000000001e-05 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923078+0000", 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013832800000000001 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923128+0000", 2024-09-10T05:58:12.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0127000000000003e-05 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943488+0000", 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020360165999999999 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943648+0000", 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015970099999999999 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3883 3.26 3:6770c43b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_452:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.268130751999999, 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024529107000000001, 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3883 2024-09-10T05:58:12.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206504+0000", 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6835999999999999e-05 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210252+0000", 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037487179999999998 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210283+0000", 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0341999999999999e-05 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210299+0000", 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6663e-05 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210406+0000", 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106648 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210618+0000", 2024-09-10T05:58:12.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021149600000000001 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210809+0000", 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000191418 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.229667+0000", 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018857604 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230689+0000", 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010224920000000001 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230877+0000", 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018767799999999999 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.231016+0000", 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013921199999999999 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.581 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3886 3.34 e103/24 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head v 103'21, mlcod=103'19)", 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.229190147000001, 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029486221999999999, 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245431+0000", 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7529999999999999e-06 2024-09-10T05:58:12.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249357+0000", 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039260179999999999 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249399+0000", 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1536999999999999e-05 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249419+0000", 2024-09-10T05:58:12.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249577+0000", 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158021 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249722+0000", 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014495900000000001 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274800+0000", 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025077941999999999 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274914+0000", 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011417900000000001 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3887 3.36 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:12.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.226446758, 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031800800999999997, 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3887 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248176+0000", 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6920000000000001e-06 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252399+0000", 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042231289999999999 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252445+0000", 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6678999999999998e-05 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252475+0000", 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9957000000000001e-05 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252597+0000", 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012193699999999999 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252960+0000", 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036250600000000002 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253367+0000", 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040692000000000001 2024-09-10T05:58:12.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279695+0000", 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026328706 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279755+0000", 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9942999999999999e-05 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279861+0000", 2024-09-10T05:58:12.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279972+0000", 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111216 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3890 3.35 3:acfee5d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_459:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:12.592 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.197207061, 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027993634999999999, 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3890 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:12.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277414+0000", 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283323+0000", 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059094550000000001 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283358+0000", 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4260000000000001e-05 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283376+0000", 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7957000000000001e-05 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283518+0000", 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141884 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283786+0000", 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026811800000000002 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284076+0000", 2024-09-10T05:58:12.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029020000000000001 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.296068+0000", 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011992523 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305096+0000", 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090274710000000005 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:12.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305275+0000", 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178982 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305404+0000", 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012940200000000001 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:12.598 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:12.600 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:58:12.600 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:12.595+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:12.701 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:12.697+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:12.773 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:12.773 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:12.773 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:12.773 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:12.788 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:58:12.839 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:12.835+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:12.864 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:58:12.903 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:12.899+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:12.911 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:12.911 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:12.911 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:12.926 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:58:12.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:58:13.011 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:13.007+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:13.095 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:13.095 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:13.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:13.095 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:13.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 186.10902796900001, 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.096 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.103 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 86.533871804, 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.104 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:58:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.637259545999996, 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:58:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:58:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:58:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.067550658000002, 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:58:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:58:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:58:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.887072062000001, 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:58:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:58:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 71.817496061, 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:58:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:58:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3001 3.13 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.968469433000003, 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033587631, 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3001 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123352+0000", 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.98e-06 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130553+0000", 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072012509999999997 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130587+0000", 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4353000000000001e-05 2024-09-10T05:58:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130604+0000", 2024-09-10T05:58:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.683e-05 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130729+0000", 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012522400000000001 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130969+0000", 2024-09-10T05:58:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023993699999999999 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131198+0000", 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228934 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140763+0000", 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095652370000000007 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156656+0000", 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015892292999999998 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156816+0000", 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016013099999999999 2024-09-10T05:58:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156935+0000", 2024-09-10T05:58:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119461 2024-09-10T05:58:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3010 3.7 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.857676808000001, 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71061391500000004, 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3010 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234152+0000", 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1463e-05 2024-09-10T05:58:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238146+0000", 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039945559999999998 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238187+0000", 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0930000000000003e-05 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238206+0000", 2024-09-10T05:58:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8379000000000001e-05 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238363+0000", 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015778499999999999 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238381+0000", 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915494+0000", 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.67711229299999998 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915792+0000", 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029809599999999997 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.916087+0000", 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029488000000000002 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.942809+0000", 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026722612999999999 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944396+0000", 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015870750000000001 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944490+0000", 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3985000000000002e-05 2024-09-10T05:58:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944754+0000", 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000264023 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3061 3.e 3:714229d8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.643175718999998, 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027015661999999999, 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3061 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448652+0000", 2024-09-10T05:58:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0242e-05 2024-09-10T05:58:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452737+0000", 2024-09-10T05:58:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040853269999999997 2024-09-10T05:58:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452769+0000", 2024-09-10T05:58:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2141999999999998e-05 2024-09-10T05:58:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452784+0000", 2024-09-10T05:58:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5051999999999999e-05 2024-09-10T05:58:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452925+0000", 2024-09-10T05:58:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014050099999999999 2024-09-10T05:58:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.453096+0000", 2024-09-10T05:58:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017083800000000001 2024-09-10T05:58:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.453245+0000", 2024-09-10T05:58:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014919600000000001 2024-09-10T05:58:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.468730+0000", 2024-09-10T05:58:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015485120999999999 2024-09-10T05:58:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475399+0000", 2024-09-10T05:58:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066694750000000002 2024-09-10T05:58:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475550+0000", 2024-09-10T05:58:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150638 2024-09-10T05:58:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475657+0000", 2024-09-10T05:58:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010713 2024-09-10T05:58:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3458 3.d 3:b0baf69f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.078892365000002, 2024-09-10T05:58:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029316732000000002, 2024-09-10T05:58:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3458 2024-09-10T05:58:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012928+0000", 2024-09-10T05:58:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:58:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019654+0000", 2024-09-10T05:58:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067255250000000004 2024-09-10T05:58:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019684+0000", 2024-09-10T05:58:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0673999999999998e-05 2024-09-10T05:58:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019705+0000", 2024-09-10T05:58:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0196000000000001e-05 2024-09-10T05:58:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019854+0000", 2024-09-10T05:58:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014964199999999999 2024-09-10T05:58:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020099+0000", 2024-09-10T05:58:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024499199999999997 2024-09-10T05:58:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020326+0000", 2024-09-10T05:58:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022693799999999999 2024-09-10T05:58:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.039686+0000", 2024-09-10T05:58:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019360049000000001 2024-09-10T05:58:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.041971+0000", 2024-09-10T05:58:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022845980000000001 2024-09-10T05:58:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042121+0000", 2024-09-10T05:58:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015037899999999999 2024-09-10T05:58:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042242+0000", 2024-09-10T05:58:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120369 2024-09-10T05:58:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3459 3.7 3:e377e840:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.071124394000002, 2024-09-10T05:58:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035558590000000001, 2024-09-10T05:58:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3459 2024-09-10T05:58:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020695+0000", 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7159999999999999e-06 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025414+0000", 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004718112 2024-09-10T05:58:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025455+0000", 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1343e-05 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025478+0000", 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3385999999999999e-05 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025669+0000", 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019060600000000001 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026052+0000", 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038261000000000002 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026463+0000", 2024-09-10T05:58:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000411016 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.049026+0000", 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022563436999999999 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056038+0000", 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070124879999999999 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056178+0000", 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139462 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056251+0000", 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3413999999999999e-05 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3557 3.11 3:882beea5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.617232741, 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031410517999999998, 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3557 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474588+0000", 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9829999999999998e-06 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480942+0000", 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006353605 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480984+0000", 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2092999999999998e-05 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481009+0000", 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5323000000000001e-05 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481184+0000", 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017464600000000001 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481422+0000", 2024-09-10T05:58:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023791799999999999 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481649+0000", 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227111 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.502907+0000", 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021257547000000002 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505706+0000", 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027996380000000001 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505859+0000", 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015259799999999999 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505995+0000", 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013605600000000001 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3805 3.f 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.578015600000001, 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032364751999999997, 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3805 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513804+0000", 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7659999999999999e-06 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518449+0000", 2024-09-10T05:58:13.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046447620000000002 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518479+0000", 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9583000000000001e-05 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518499+0000", 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0707999999999999e-05 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518612+0000", 2024-09-10T05:58:13.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011232599999999999 2024-09-10T05:58:13.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518918+0000", 2024-09-10T05:58:13.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030618099999999999 2024-09-10T05:58:13.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519295+0000", 2024-09-10T05:58:13.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037720100000000002 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545713+0000", 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026418322000000001 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545851+0000", 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013759899999999999 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546022+0000", 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017056800000000001 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546166+0000", 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014473599999999999 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3842 3.2f e103/24 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head v 103'13, mlcod=103'11)", 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.299494162, 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026955135000000002, 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792325+0000", 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3499999999999999e-06 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795292+0000", 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029671160000000001 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795320+0000", 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7869999999999999e-05 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795337+0000", 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6336000000000001e-05 2024-09-10T05:58:13.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795487+0000", 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150352 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795532+0000", 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4629999999999998e-05 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.819115+0000", 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023583415999999999 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.819278+0000", 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163065 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3850 3.3f 3:fda66161:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.220162153, 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028103604000000001, 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.210 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3850 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871659+0000", 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.783e-06 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875788+0000", 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041287629999999997 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875838+0000", 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0120000000000001e-05 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875864+0000", 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6285e-05 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876003+0000", 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013910499999999999 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876243+0000", 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023953200000000001 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876443+0000", 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020025899999999999 2024-09-10T05:58:13.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899442+0000", 2024-09-10T05:58:13.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022998779 2024-09-10T05:58:13.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899506+0000", 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4497000000000003e-05 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899661+0000", 2024-09-10T05:58:13.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155227 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899759+0000", 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7254000000000001e-05 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3855 3.11 3:892729bc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_424:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:13.217 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.167952079000001, 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028027435, 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3855 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923868+0000", 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1379999999999999e-06 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927312+0000", 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034438659999999999 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927346+0000", 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3569999999999999e-05 2024-09-10T05:58:13.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927364+0000", 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8749999999999998e-05 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927537+0000", 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017227599999999999 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927890+0000", 2024-09-10T05:58:13.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035353499999999998 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.928239+0000", 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000348434 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.947716+0000", 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019477305 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951690+0000", 2024-09-10T05:58:13.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039739709999999998 2024-09-10T05:58:13.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951800+0000", 2024-09-10T05:58:13.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011006900000000001 2024-09-10T05:58:13.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951893+0000", 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2521000000000004e-05 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3880 3.37 3:ec881012:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_449:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.918101874, 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029579850000000001, 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3880 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173719+0000", 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4599999999999999e-06 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178656+0000", 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049375230000000001 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178700+0000", 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.409e-05 2024-09-10T05:58:13.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178726+0000", 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5503e-05 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178895+0000", 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000169572 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179154+0000", 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025896399999999998 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179410+0000", 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025568800000000001 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.202784+0000", 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023373701 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203018+0000", 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234064 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203148+0000", 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013007900000000001 2024-09-10T05:58:13.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203295+0000", 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014720600000000001 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3891 3.3f 3:fc60bd0c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_460:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.287109+0000", 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.804708408, 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026950976000000001, 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3891 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.232 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.287109+0000", 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.287109+0000", 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.287113+0000", 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3939999999999998e-06 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291270+0000", 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041571500000000001 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291305+0000", 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4462000000000003e-05 2024-09-10T05:58:13.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291325+0000", 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0366000000000001e-05 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291456+0000", 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013085000000000001 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291694+0000", 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023788100000000001 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291914+0000", 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000220087 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.308924+0000", 2024-09-10T05:58:13.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017010042999999999 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.309299+0000", 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000374624 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.309460+0000", 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016100500000000001 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.314060+0000", 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046001139999999998 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3894 3.e 3:72a2f092:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.769904297, 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027366047000000001, 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.238 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3894 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321917+0000", 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2189999999999998e-06 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325869+0000", 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039515990000000001 2024-09-10T05:58:13.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325900+0000", 2024-09-10T05:58:13.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1745000000000002e-05 2024-09-10T05:58:13.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325916+0000", 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5934999999999999e-05 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326020+0000", 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103359 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326241+0000", 2024-09-10T05:58:13.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022122999999999999 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326541+0000", 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000299678 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.342668+0000", 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016127266000000001 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:13.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349093+0000", 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064252349999999996 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349194+0000", 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100462 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349279+0000", 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5319000000000001e-05 2024-09-10T05:58:13.244 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3910 3.14 e103/24 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head v 103'17, mlcod=103'15)", 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.538963209, 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027277861, 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:13.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552855+0000", 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:58:13.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555222+0000", 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023664390000000001 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555263+0000", 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152000000000002e-05 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:13.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555277+0000", 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4092e-05 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555414+0000", 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013695299999999999 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:13.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555459+0000", 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5272999999999998e-05 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580075+0000", 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024615818000000001 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580132+0000", 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6841e-05 2024-09-10T05:58:13.249 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.250 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.250 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.250 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:13.250 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:13.250 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:13.251 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:13.252 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:13.252 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:13.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:58:13.253 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:13.254 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:13.255 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:13.255 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:13.256 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:13.256 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:13.245+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:13.257 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:13.353 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:13.347+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:13.374 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:13.374 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:13.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:58:13.454 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:13.449+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:13.513 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:13.514 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:13.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:58:13.555 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:13.551+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:13.656 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:13.653+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:13.694 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:13.694 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:13.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:58:13.757 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:13.751+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:13.857 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:13.851+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:13.885 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:13.885 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:13.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:58:13.962 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:13.955+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:14.020 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:14.020 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:14.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:58:14.063 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:14.059+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:14.152 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:14.152 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:14.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:58:14.167 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:14.159+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:14.268 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:14.263+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:14.294 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:14.294 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:14.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:58:14.368 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:14.365+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:14.425 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:14.425 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:14.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:58:14.469 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:14.467+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:14.573 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:14.565+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:14.609 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:14.610 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:14.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:58:14.671 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:14.667+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:14.772 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:14.771+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:14.791 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:14.791 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:14.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:58:14.872 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:14.867+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:14.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:58:14.934 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:14.934 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:14.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:58:14.973 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:14.967+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:15.074 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:15.069+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:15.084 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:15.084 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:15.099 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:58:15.175 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:15.169+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:15.232 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:15.232 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:15.246 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:58:15.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:58:15.291 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:15.287+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:15.364 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:15.364 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:15.376 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:15.373+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:15.378 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:58:15.427 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:15.428 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:15.444 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:15.445 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:15.461 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:15.461 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:15.476 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:15.471+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:15.477 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:15.477 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:15.497 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:15.497 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:15.517 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:15.517 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:15.537 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:15.538 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:15.540 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-10T05:58:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 166.97869217300001, 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030106378, 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 43 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557979+0000", 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.557982+0000", 2024-09-10T05:58:15.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1889999999999999e-06 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558003+0000", 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0293999999999999e-05 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558036+0000", 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3776000000000003e-05 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.558060+0000", 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3104000000000001e-05 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559482+0000", 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014224369999999999 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:15.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.559503+0000", 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0886999999999998e-05 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.587774+0000", 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028270805999999999 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:28.588086+0000", 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031188500000000003 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.545 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2728 3.34 3:2c154f56:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.599549905999993, 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033136613000000002, 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.546 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2728 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937121+0000", 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.937126+0000", 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1760000000000003e-06 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.941991+0000", 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048650689999999996 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942026+0000", 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4953000000000002e-05 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.942053+0000", 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7158999999999999e-05 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948425+0000", 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063727000000000002 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948629+0000", 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020374100000000001 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.948839+0000", 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000209667 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969354+0000", 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020515249999999999 2024-09-10T05:58:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.969941+0000", 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058675999999999997 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970110+0000", 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016881599999999999 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970258+0000", 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014832199999999999 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2729 3.3 3:c22325f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.590555244000001, 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024463555000000001, 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2729 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946116+0000", 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.946119+0000", 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953909+0000", 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077895100000000004 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953945+0000", 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6158999999999997e-05 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.953970+0000", 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5131999999999999e-05 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954132+0000", 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016154 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954496+0000", 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036422199999999998 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.954938+0000", 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044235500000000002 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.967452+0000", 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012514177 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970374+0000", 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029212489999999999 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970467+0000", 2024-09-10T05:58:15.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3188000000000003e-05 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.970580+0000", 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011281300000000001 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3001 3.13 e90/24 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head v 90'4, mlcod=72'2)", 2024-09-10T05:58:15.558 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.405246167000001, 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024776917999999998, 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131425+0000", 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131428+0000", 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.016e-06 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137163+0000", 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057351640000000001 2024-09-10T05:58:15.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137204+0000", 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0836e-05 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137222+0000", 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137415+0000", 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019288399999999999 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.137480+0000", 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4776000000000005e-05 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156077+0000", 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018596850000000002 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156202+0000", 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012555500000000001 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3005 3.34 3:2febc67c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.361799626, 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024327333999999999, 2024-09-10T05:58:15.563 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3005 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174872+0000", 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.174875+0000", 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1559999999999999e-06 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181125+0000", 2024-09-10T05:58:15.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062498969999999999 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181161+0000", 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569999999999997e-05 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181179+0000", 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8088999999999999e-05 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181333+0000", 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015358799999999999 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181593+0000", 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025959699999999997 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.181822+0000", 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022906700000000001 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.193600+0000", 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01177797 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.198883+0000", 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052831070000000004 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199068+0000", 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184821 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.199199+0000", 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013147199999999999 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.569 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3012 3.24 3:2690994d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.267725153999997, 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.645952105, 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.570 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3012 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268946+0000", 2024-09-10T05:58:15.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.268950+0000", 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273458+0000", 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045087410000000001 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273497+0000", 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8822000000000002e-05 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273516+0000", 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9300000000000002e-05 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273651+0000", 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013411799999999999 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.273672+0000", 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1676999999999999e-05 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.884862+0000", 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.61118961599999999 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885232+0000", 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037011500000000002 2024-09-10T05:58:15.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.885644+0000", 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186100000000002 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.904417+0000", 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018772858999999999 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.910331+0000", 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059138699999999999 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914700+0000", 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043697279999999998 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.914898+0000", 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000198035 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.576 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3020 3.14 3:2b6e0d00:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.569340791999998, 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033030490000000003, 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.577 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3020 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967331+0000", 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.967333+0000", 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972079+0000", 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047458250000000004 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972114+0000", 2024-09-10T05:58:15.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5197999999999997e-05 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972130+0000", 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6317999999999999e-05 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972256+0000", 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012557599999999999 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972555+0000", 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029879599999999999 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.972831+0000", 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027629999999999999 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.999160+0000", 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026329128 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000129+0000", 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00096927000000000005 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000279+0000", 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014958300000000001 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.000361+0000", 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2225999999999995e-05 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.582 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3021 3.b e91/90 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head v 91'3, mlcod=0'0)", 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.557588164000002, 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026046184999999999, 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979083+0000", 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.979128+0000", 2024-09-10T05:58:15.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5216000000000002e-05 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983799+0000", 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046708660000000001 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983819+0000", 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9996e-05 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983829+0000", 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173999999999999e-05 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983909+0000", 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9677000000000003e-05 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.983938+0000", 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8506000000000001e-05 2024-09-10T05:58:15.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005057+0000", 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021119150999999999 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.005129+0000", 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2599000000000001e-05 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3038 3.9 3:9262e99f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.368355946000001, 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029031866999999999, 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.588 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3038 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168315+0000", 2024-09-10T05:58:15.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.168317+0000", 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0899999999999999e-06 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172702+0000", 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043843019999999996 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172720+0000", 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8284999999999999e-05 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172733+0000", 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3047999999999999e-05 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.172846+0000", 2024-09-10T05:58:15.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113281 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173043+0000", 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019643300000000001 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.173322+0000", 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027913500000000002 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.186287+0000", 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012965302 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197185+0000", 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010897831 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197278+0000", 2024-09-10T05:58:15.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2906999999999997e-05 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.197347+0000", 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9252999999999996e-05 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3056 3.14 3:29c50966:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.149813881999997, 2024-09-10T05:58:15.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023839230999999999, 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3056 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386857+0000", 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.386860+0000", 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.638e-06 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392248+0000", 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053876490000000004 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392276+0000", 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8240000000000001e-05 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392290+0000", 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4357e-05 2024-09-10T05:58:15.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392397+0000", 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106897 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392568+0000", 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017104800000000001 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.392731+0000", 2024-09-10T05:58:15.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000162922 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.406474+0000", 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013743155999999999 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.409945+0000", 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034706659999999999 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410581+0000", 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063596099999999999 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.410697+0000", 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115697 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3059 3.34 3:2f11a9af:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:15.600 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.114909029000003, 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026671028999999999, 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3059 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421762+0000", 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.421765+0000", 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2510000000000001e-06 2024-09-10T05:58:15.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425935+0000", 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041702730000000004 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425960+0000", 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5041999999999998e-05 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.425976+0000", 2024-09-10T05:58:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5735000000000001e-05 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426110+0000", 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013405700000000001 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426325+0000", 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000215131 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:15.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.426519+0000", 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000194246 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.436549+0000", 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010029688 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448235+0000", 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0116861 2024-09-10T05:58:15.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448379+0000", 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000143747 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448433+0000", 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4759000000000002e-05 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3416 3.1 e100/24 3:808843e2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_5:head v 100'9, mlcod=93'7)", 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.855427596999998, 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027979082999999998, 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:15.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681244+0000", 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.681246+0000", 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6769999999999999e-06 2024-09-10T05:58:15.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691491+0000", 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010244237 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691528+0000", 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7151999999999999e-05 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691547+0000", 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8709999999999999e-05 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691714+0000", 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000167369 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.691760+0000", 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5695999999999998e-05 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709087+0000", 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017327259000000001 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.709223+0000", 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135983 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3457 3.14 3:2831b25f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.535424973000001, 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024902178000000001, 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3457 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001246+0000", 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.001250+0000", 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5559999999999999e-06 2024-09-10T05:58:15.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005190+0000", 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039401180000000003 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005220+0000", 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0363000000000001e-05 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005236+0000", 2024-09-10T05:58:15.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5330000000000001e-05 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005366+0000", 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013042899999999999 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005583+0000", 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216698 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.005795+0000", 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021261199999999999 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.015756+0000", 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009960076 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025862+0000", 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010106484000000001 2024-09-10T05:58:15.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026023+0000", 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016126899999999999 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026149+0000", 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012524300000000001 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3527 3.34 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.611950833000002, 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029448789, 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3527 2024-09-10T05:58:15.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924720+0000", 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.924725+0000", 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4340000000000002e-06 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929795+0000", 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050704119999999998 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929844+0000", 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8529999999999998e-05 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.929870+0000", 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6273000000000001e-05 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930059+0000", 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000189338 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930358+0000", 2024-09-10T05:58:15.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029820500000000001 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930585+0000", 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227801 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.943164+0000", 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012578045 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954035+0000", 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010871822 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954112+0000", 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6377000000000004e-05 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.954169+0000", 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7552000000000001e-05 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3540 3.3 3:c0a030d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.365873297, 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025740391000000001, 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.624 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3540 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170798+0000", 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.170800+0000", 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3420000000000002e-06 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174879+0000", 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040782479999999996 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174907+0000", 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8507e-05 2024-09-10T05:58:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174917+0000", 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0162e-05 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.174986+0000", 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8929000000000004e-05 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175105+0000", 2024-09-10T05:58:15.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119156 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.175205+0000", 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9630000000000007e-05 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.183734+0000", 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008529165 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196451+0000", 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012716867 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196501+0000", 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9495e-05 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.196538+0000", 2024-09-10T05:58:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7889999999999998e-05 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3805 3.f e103/24 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head v 103'13, mlcod=100'11)", 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.017202167000001, 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024687252, 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.630 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519469+0000", 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519471+0000", 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1629999999999999e-06 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521818+0000", 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002346622 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521856+0000", 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7651000000000003e-05 2024-09-10T05:58:15.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.521885+0000", 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9833999999999999e-05 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522050+0000", 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016488700000000001 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.522135+0000", 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4870000000000006e-05 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544022+0000", 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021886663000000001 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544156+0000", 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013456199999999999 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3886 3.34 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.297500828, 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.037223538, 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.635 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3886 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239170+0000", 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.239173+0000", 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0669999999999999e-06 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244645+0000", 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054724689999999998 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244680+0000", 2024-09-10T05:58:15.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.485e-05 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244699+0000", 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8732999999999998e-05 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.244825+0000", 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012615400000000001 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245045+0000", 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022069900000000001 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245231+0000", 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000185236 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.271326+0000", 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026095063000000002 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276174+0000", 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048486559999999998 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276304+0000", 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013003400000000001 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.276394+0000", 2024-09-10T05:58:15.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9577e-05 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3888 3.1c e103/24 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head v 103'14, mlcod=103'12)", 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.270735420999999, 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024494029, 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.641 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265936+0000", 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265938+0000", 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.418e-06 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268943+0000", 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030050979999999999 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.268989+0000", 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6013000000000001e-05 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269014+0000", 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4403e-05 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269160+0000", 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146582 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.269218+0000", 2024-09-10T05:58:15.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7238999999999999e-05 2024-09-10T05:58:15.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290347+0000", 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021129577 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290430+0000", 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699000000000002e-05 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.648 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3889 3.1a 3:59af3e8e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_458:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.270563619000001, 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023755387999999999, 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3889 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.649 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266108+0000", 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.266111+0000", 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.207e-06 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272923+0000", 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006812411 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272969+0000", 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6109999999999997e-05 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.272995+0000", 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5507000000000002e-05 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273138+0000", 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014260799999999999 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273453+0000", 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031509399999999998 2024-09-10T05:58:15.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.273736+0000", 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000283486 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284653+0000", 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010916571 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289571+0000", 2024-09-10T05:58:15.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049184830000000004 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289745+0000", 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017408500000000001 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.289863+0000", 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011782600000000001 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3910 3.14 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 12.988372923, 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032209085999999998, 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3910 2024-09-10T05:58:15.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548298+0000", 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.548302+0000", 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9169999999999999e-06 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552324+0000", 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040218169999999996 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552352+0000", 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7606e-05 2024-09-10T05:58:15.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552375+0000", 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3663e-05 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552452+0000", 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6762999999999997e-05 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:15.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552562+0000", 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110011 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552695+0000", 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132371 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.561844+0000", 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091494290000000006 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580364+0000", 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018519889000000001 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580464+0000", 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100008 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580507+0000", 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3612000000000002e-05 2024-09-10T05:58:15.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.661 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.661 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:15.661 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:15.661 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:15.662 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:15.663 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:58:15.663 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:15.655+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:15.664 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:15.763 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:15.757+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:15.835 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:15.835 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:15.836 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:15.836 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:15.850 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:58:15.876 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:58:15.895 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:15.891+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:15.965 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:15.959+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:15.977 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:15.977 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:15.977 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:15.977 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:15.977 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:15.992 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:58:16.079 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:16.075+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:16.163 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:16.163 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 88.738602499999999, 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:58:16.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:58:16.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 75.231827941000006, 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:58:16.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:58:16.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:58:16.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 75.152130799999995, 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.176 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:58:16.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:58:16.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 74.963779953, 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:58:16.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.187 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3264 3.1c 3:3923a6c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 38.120934097999999, 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02663254, 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.188 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3264 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038547+0000", 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1860000000000002e-06 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044703+0000", 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061553579999999997 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044742+0000", 2024-09-10T05:58:16.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9156000000000003e-05 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044760+0000", 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.863e-05 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044913+0000", 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153048 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.045181+0000", 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026741299999999998 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.046065+0000", 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088462999999999996 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.062104+0000", 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016038812999999999 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.064938+0000", 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028335249999999999 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065088+0000", 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974500000000001 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065176+0000", 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8035999999999995e-05 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3417 3.37 e100/24 3:ee859745:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_6:head v 100'10, mlcod=91'8)", 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.464739611999999, 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028417909000000002, 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699999999999998e-07 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701552+0000", 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068132100000000001 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701602+0000", 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0482999999999998e-05 2024-09-10T05:58:16.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701627+0000", 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4530000000000001e-05 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701806+0000", 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179192 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701865+0000", 2024-09-10T05:58:16.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9416000000000002e-05 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723088+0000", 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021222933999999999 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723155+0000", 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7317000000000006e-05 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3469 3.28 3:15b30b29:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.034585014000001, 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026322306, 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3469 2024-09-10T05:58:16.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124896+0000", 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999997e-06 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132908+0000", 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080112889999999996 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132952+0000", 2024-09-10T05:58:16.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4663000000000003e-05 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132983+0000", 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0800000000000003e-05 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133152+0000", 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168581 2024-09-10T05:58:16.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133458+0000", 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000306192 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133744+0000", 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028567399999999998 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.149676+0000", 2024-09-10T05:58:16.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015932457000000001 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151030+0000", 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013541060000000001 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151127+0000", 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6274999999999996e-05 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151214+0000", 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7933e-05 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3517 3.2 3:42481240:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.360105213000001, 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026698706999999999, 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3517 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799376+0000", 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1729999999999997e-06 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803201+0000", 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003825186 2024-09-10T05:58:16.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803245+0000", 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4187000000000002e-05 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803263+0000", 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7467999999999999e-05 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803403+0000", 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013966900000000001 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803414+0000", 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1593999999999999e-05 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809545+0000", 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061312449999999996 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809926+0000", 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038063399999999997 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.810277+0000", 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035085699999999999 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.823285+0000", 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013008426999999999 2024-09-10T05:58:16.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.825994+0000", 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027082510000000001 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826036+0000", 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2462000000000001e-05 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826071+0000", 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4554000000000002e-05 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3808 3.2 3:41ef7625:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_387:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.61506339, 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025521107000000001, 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3808 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544414+0000", 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.544419+0000", 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3430000000000003e-06 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549878+0000", 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054584589999999997 2024-09-10T05:58:16.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549915+0000", 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7472999999999998e-05 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.549932+0000", 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7136e-05 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550060+0000", 2024-09-10T05:58:16.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012812699999999999 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550275+0000", 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021436400000000001 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.550458+0000", 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018312800000000001 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.558866+0000", 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084081569999999994 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569623+0000", 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010757139000000001 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569801+0000", 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017797200000000001 2024-09-10T05:58:16.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.569935+0000", 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013380900000000001 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3815 3.5 3:a26771db:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_394:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.547821212000001, 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024682987, 2024-09-10T05:58:16.218 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3815 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611656+0000", 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.611660+0000", 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6370000000000001e-06 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615460+0000", 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00380088 2024-09-10T05:58:16.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615496+0000", 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5772999999999998e-05 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615523+0000", 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6859000000000002e-05 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.615724+0000", 2024-09-10T05:58:16.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000201366 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616167+0000", 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044238600000000002 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.616565+0000", 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039797999999999998 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.629207+0000", 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012642146999999999 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636048+0000", 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068409880000000001 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636198+0000", 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014965900000000001 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.636339+0000", 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014131199999999999 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3822 3.2f 3:f5691873:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_401:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.48038901, 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029772514, 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3822 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679092+0000", 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9910000000000004e-06 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682947+0000", 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038550630000000002 2024-09-10T05:58:16.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682976+0000", 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8988000000000001e-05 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682992+0000", 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6209e-05 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683193+0000", 2024-09-10T05:58:16.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000200185 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683489+0000", 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296717 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683725+0000", 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023543500000000001 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.695201+0000", 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011476513000000001 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708548+0000", 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013346373 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708739+0000", 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019118499999999999 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708861+0000", 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121855 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3842 3.2f 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.373304112, 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034550046000000001, 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.230 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3842 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786179+0000", 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8069999999999996e-06 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791316+0000", 2024-09-10T05:58:16.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051367679999999999 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791355+0000", 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9440000000000002e-05 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791373+0000", 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8352999999999999e-05 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791572+0000", 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019850799999999999 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791832+0000", 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025995199999999998 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792070+0000", 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023838099999999999 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.806866+0000", 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014796073999999999 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820440+0000", 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013573528 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820604+0000", 2024-09-10T05:58:16.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016399599999999999 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820723+0000", 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119239 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3853 3.2 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:16.236 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.256931632000001, 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032847466999999998, 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3853 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902549+0000", 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6880000000000001e-06 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908028+0000", 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054786820000000003 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908063+0000", 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4792999999999997e-05 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908087+0000", 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4499e-05 2024-09-10T05:58:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908218+0000", 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130977 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908410+0000", 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019136399999999999 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:16.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908651+0000", 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024184 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927151+0000", 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018500103 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935254+0000", 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081027359999999993 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935323+0000", 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880000000000005e-05 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935393+0000", 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9905000000000002e-05 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3854 3.2 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.247685259000001, 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032334535999999997, 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3854 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.243 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911796+0000", 2024-09-10T05:58:16.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7799999999999998e-06 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915942+0000", 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041458290000000002 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915977+0000", 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5682000000000002e-05 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916000+0000", 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2364000000000001e-05 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916619+0000", 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061924400000000002 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917000+0000", 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000381651 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917409+0000", 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040862500000000003 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.931292+0000", 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013882495 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943964+0000", 2024-09-10T05:58:16.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012672843 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944047+0000", 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2371000000000001e-05 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944126+0000", 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9652000000000002e-05 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3874 3.2 3:414c7108:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_443:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.047174442999999, 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028695409000000002, 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3874 2024-09-10T05:58:16.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112306+0000", 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.117951+0000", 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056447779999999996 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118011+0000", 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0179000000000001e-05 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118040+0000", 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.885e-05 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118251+0000", 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021135199999999999 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118565+0000", 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031331399999999998 2024-09-10T05:58:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118877+0000", 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031258099999999998 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.137138+0000", 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018260345000000001 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140708+0000", 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035707590000000002 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140883+0000", 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017462200000000001 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140998+0000", 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011507599999999999 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3878 3.2a 3:5587957a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_447:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.002025502, 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029379293000000001, 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3878 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157455+0000", 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1999999999999999e-06 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161427+0000", 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039726149999999997 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161465+0000", 2024-09-10T05:58:16.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7883000000000003e-05 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161484+0000", 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8465999999999999e-05 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161632+0000", 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014848199999999999 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161895+0000", 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000262835 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.162126+0000", 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230471 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.183957+0000", 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021831547 2024-09-10T05:58:16.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186575+0000", 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002617608 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186718+0000", 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014299199999999999 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186831+0000", 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113194 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3879 3.2a 3:5472b1a4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_448:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.995195017, 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027503584000000001, 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3879 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164285+0000", 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0929999999999999e-06 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171662+0000", 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073767499999999996 2024-09-10T05:58:16.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171705+0000", 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2599999999999999e-05 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171731+0000", 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6812999999999999e-05 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171914+0000", 2024-09-10T05:58:16.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018210899999999999 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172318+0000", 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040407699999999997 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172753+0000", 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043529899999999999 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.189712+0000", 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016959044 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191568+0000", 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018557510000000001 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191692+0000", 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012407299999999999 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191786+0000", 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3974999999999994e-05 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3887 3.36 e103/24 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head v 103'16, mlcod=102'14)", 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.905884232, 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025460763000000001, 2024-09-10T05:58:16.267 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253593+0000", 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253596+0000", 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3349999999999998e-06 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255939+0000", 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002342481 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.255990+0000", 2024-09-10T05:58:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1595999999999999e-05 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256015+0000", 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.438e-05 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256167+0000", 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015261699999999999 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.256221+0000", 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3455999999999998e-05 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.278813+0000", 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022591946000000002 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279054+0000", 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024095200000000001 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3888 3.1c 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.900612605999999, 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032020736000000001, 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.272 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3888 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258869+0000", 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8899999999999998e-06 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265112+0000", 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062428429999999997 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265150+0000", 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7366000000000001e-05 2024-09-10T05:58:16.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265169+0000", 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9089999999999998e-05 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265288+0000", 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119085 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265498+0000", 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020986299999999999 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265757+0000", 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025964299999999999 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.280209+0000", 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014451311 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290711+0000", 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010502589 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290793+0000", 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1310999999999995e-05 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290885+0000", 2024-09-10T05:58:16.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2744999999999994e-05 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3895 3.1d 3:b90a3a7e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_464:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.828059123999999, 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024479635999999999, 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3895 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331418+0000", 2024-09-10T05:58:16.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.331422+0000", 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.76e-06 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335102+0000", 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003680104 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335143+0000", 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1006e-05 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335161+0000", 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8567999999999999e-05 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335338+0000", 2024-09-10T05:58:16.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017661099999999999 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.335689+0000", 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035125800000000002 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.336048+0000", 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035893299999999997 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.347421+0000", 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011372597999999999 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355631+0000", 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082105349999999997 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355779+0000", 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014740200000000001 2024-09-10T05:58:16.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.355898+0000", 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118861 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.284 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:16.286 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:58:16.286 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:16.281+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:16.386 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:16.379+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:16.455 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:16.455 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:16.455 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:16.469 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:58:16.511 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:16.507+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:16.588 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:16.585+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:16.639 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:16.639 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:16.639 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:16.639 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:16.639 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:16.649 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records in 2024-09-10T05:58:16.649 INFO:tasks.workunit.client.0.smithi070.stderr:200+0 records out 2024-09-10T05:58:16.649 INFO:tasks.workunit.client.0.smithi070.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.2467 s, 158 MB/s 2024-09-10T05:58:16.653 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:58:16.689 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:16.685+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:16.785 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:16.785 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:16.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:16.785 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 166.19381569999999, 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.786 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:16.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:58:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3000 3.26 3:66b3ccfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:16.793 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.680702267999997, 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026540508000000001, 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3000 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102039+0000", 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.213e-06 2024-09-10T05:58:16.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108021+0000", 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059826480000000001 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108061+0000", 2024-09-10T05:58:16.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9382999999999999e-05 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108079+0000", 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8542999999999998e-05 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108260+0000", 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018121000000000001 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108677+0000", 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041657899999999998 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.109094+0000", 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000416807 2024-09-10T05:58:16.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.127165+0000", 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018071348000000001 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128257+0000", 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001091741 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128485+0000", 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022827700000000001 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128576+0000", 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0759000000000003e-05 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3002 3.36 3:6ef358c6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.648330137999999, 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026032893000000001, 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3002 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.801 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134413+0000", 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5639999999999996e-06 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140435+0000", 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060217939999999996 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140485+0000", 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0089000000000001e-05 2024-09-10T05:58:16.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140505+0000", 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0186999999999998e-05 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140663+0000", 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157744 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141102+0000", 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043870399999999999 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141512+0000", 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041073500000000002 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.153730+0000", 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012217608 2024-09-10T05:58:16.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160105+0000", 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063753949999999998 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160301+0000", 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195551 2024-09-10T05:58:16.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160440+0000", 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139522 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3009 3.33 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 42.559663856, 2024-09-10T05:58:16.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71394179300000005, 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3009 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:16.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223079+0000", 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8029999999999996e-06 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227044+0000", 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003965021 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227081+0000", 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7153000000000002e-05 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227106+0000", 2024-09-10T05:58:16.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5522999999999999e-05 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227283+0000", 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017625099999999999 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227305+0000", 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2200000000000001e-05 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.911736+0000", 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.68443125800000004 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912098+0000", 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000361527 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912509+0000", 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186899999999998 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.930388+0000", 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017878817000000002 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936858+0000", 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064700369999999997 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936908+0000", 2024-09-10T05:58:16.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9792e-05 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.937016+0000", 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010754199999999999 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3042 3.a 3:50a6a854:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:16.814 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.563107705, 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023353200000000001, 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3042 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219633+0000", 2024-09-10T05:58:16.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0060000000000001e-06 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225187+0000", 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055536630000000003 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225218+0000", 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1353999999999998e-05 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225234+0000", 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5519000000000002e-05 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225372+0000", 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013812699999999999 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225669+0000", 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029757699999999999 2024-09-10T05:58:16.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225934+0000", 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026508599999999999 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239222+0000", 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01328796 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242760+0000", 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035374289999999999 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242891+0000", 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013163399999999999 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242983+0000", 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1844999999999999e-05 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3046 3.1e 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.511580055000003, 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023372101999999999, 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3046 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271160+0000", 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275046+0000", 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003885707 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275067+0000", 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1642e-05 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275083+0000", 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5477000000000001e-05 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275168+0000", 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5079000000000003e-05 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275391+0000", 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022318699999999999 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275563+0000", 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017160499999999999 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.284169+0000", 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086058950000000006 2024-09-10T05:58:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294378+0000", 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010209885 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294463+0000", 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4661999999999997e-05 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294530+0000", 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6688999999999998e-05 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3062 3.a 3:510cfa22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.323442292999999, 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023825417000000002, 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3062 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459299+0000", 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0829999999999997e-06 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464231+0000", 2024-09-10T05:58:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049315019999999999 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464266+0000", 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4904000000000003e-05 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464282+0000", 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464381+0000", 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8698999999999998e-05 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464599+0000", 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218533 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464788+0000", 2024-09-10T05:58:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188247 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475654+0000", 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010866549 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.482934+0000", 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072803160000000002 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483038+0000", 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010331 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483121+0000", 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3101000000000003e-05 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3419 3.1e 3:7bbb5ef4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.074025111000001, 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024061241000000001, 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3419 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708717+0000", 2024-09-10T05:58:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999997e-06 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717539+0000", 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088221600000000008 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717582+0000", 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999998e-05 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717607+0000", 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4532000000000002e-05 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717749+0000", 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014247500000000001 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718284+0000", 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053459199999999997 2024-09-10T05:58:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718669+0000", 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038528400000000001 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.729703+0000", 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011033687 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732433+0000", 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027304439999999998 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732615+0000", 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018145800000000001 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732774+0000", 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159149 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3449 3.20 3:06b085c8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.865404664, 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023229774000000002, 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3449 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917337+0000", 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922049+0000", 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004711135 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922104+0000", 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.592e-05 2024-09-10T05:58:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922135+0000", 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0329e-05 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922305+0000", 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017053899999999999 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922568+0000", 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026224799999999997 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922808+0000", 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240678 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.932764+0000", 2024-09-10T05:58:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099562020000000008 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940253+0000", 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074887970000000002 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940434+0000", 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018096799999999999 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940563+0000", 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128615 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3463 3.36 3:6eb508a9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.720568565000001, 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02333292, 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3463 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062176+0000", 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.956e-06 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066729+0000", 2024-09-10T05:58:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045528799999999996 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066763+0000", 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4471999999999998e-05 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066781+0000", 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7917000000000001e-05 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066948+0000", 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016702199999999999 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067181+0000", 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232869 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067421+0000", 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023939299999999999 2024-09-10T05:58:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.076526+0000", 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091050300000000001 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085179+0000", 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086531899999999998 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085358+0000", 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017913900000000001 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085502+0000", 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014405200000000001 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3464 3.26 3:670772ec:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.709814917999999, 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027033292, 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3464 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072927+0000", 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7459999999999998e-06 2024-09-10T05:58:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077023+0000", 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040969040000000002 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077070+0000", 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6876000000000003e-05 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077102+0000", 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1766e-05 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077220+0000", 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011787599999999999 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077448+0000", 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228175 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077666+0000", 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218216 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099266+0000", 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021599679 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099650+0000", 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000384096 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099819+0000", 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168746 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099956+0000", 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137212 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3515 3.33 3:cdf573bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.027676744000001, 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022302426, 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3515 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755064+0000", 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2969999999999999e-06 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759036+0000", 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003971484 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759069+0000", 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3654e-05 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759086+0000", 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6736e-05 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759206+0000", 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120363 2024-09-10T05:58:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759485+0000", 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027802399999999998 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759727+0000", 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024243499999999999 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.768857+0000", 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091297849999999996 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777204+0000", 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083474719999999999 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777293+0000", 2024-09-10T05:58:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8306000000000005e-05 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777363+0000", 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0870000000000004e-05 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3527 3.34 e101/24 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head v 101'12, mlcod=93'10)", 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.851849459, 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022764337999999999, 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930889+0000", 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2130000000000001e-06 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934309+0000", 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034198950000000001 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934342+0000", 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2483000000000001e-05 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934358+0000", 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6439999999999998e-05 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934490+0000", 2024-09-10T05:58:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013154599999999999 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934530+0000", 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0590000000000003e-05 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953524+0000", 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018993344999999998 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953653+0000", 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882599999999999 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3570 3.26 3:67afa84d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.081308008000001, 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023228478, 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3570 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701432+0000", 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6340000000000001e-06 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705705+0000", 2024-09-10T05:58:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042724269999999996 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705729+0000", 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4107000000000001e-05 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705741+0000", 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2335e-05 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705897+0000", 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015548100000000001 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706177+0000", 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028081500000000001 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706408+0000", 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230991 2024-09-10T05:58:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.715905+0000", 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094962859999999996 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724359+0000", 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084545820000000004 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724526+0000", 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016648499999999999 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724658+0000", 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132335 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3853 3.2 e103/90 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head v 103'11, mlcod=103'9)", 2024-09-10T05:58:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.873907615, 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026052486999999999, 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908833+0000", 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3050000000000001e-06 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912185+0000", 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00335177 2024-09-10T05:58:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912243+0000", 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7635e-05 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912271+0000", 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7974e-05 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913259+0000", 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098803699999999999 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913318+0000", 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422000000000001e-05 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934525+0000", 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021206610000000001 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934883+0000", 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035773400000000001 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3854 3.2 e103/90 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head v 103'12, mlcod=103'9)", 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.865088545000001, 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025998609999999998, 2024-09-10T05:58:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917653+0000", 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4000000000000001e-06 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922882+0000", 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052294120000000001 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922916+0000", 2024-09-10T05:58:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4425999999999999e-05 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922939+0000", 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3050000000000001e-05 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923078+0000", 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013832800000000001 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923128+0000", 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0127000000000003e-05 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943488+0000", 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020360165999999999 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943648+0000", 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015970099999999999 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3883 3.26 3:6770c43b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_452:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.576250773, 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024529107000000001, 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3883 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206504+0000", 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6835999999999999e-05 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210252+0000", 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037487179999999998 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210283+0000", 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0341999999999999e-05 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210299+0000", 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6663e-05 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210406+0000", 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106648 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210618+0000", 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021149600000000001 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210809+0000", 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000191418 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.229667+0000", 2024-09-10T05:58:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018857604 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230689+0000", 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010224920000000001 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230877+0000", 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018767799999999999 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.231016+0000", 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013921199999999999 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3886 3.34 e103/24 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head v 103'21, mlcod=103'19)", 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.537310167999999, 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029486221999999999, 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245431+0000", 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7529999999999999e-06 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249357+0000", 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039260179999999999 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249399+0000", 2024-09-10T05:58:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1536999999999999e-05 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249419+0000", 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249577+0000", 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158021 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249722+0000", 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014495900000000001 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274800+0000", 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025077941999999999 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274914+0000", 2024-09-10T05:58:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011417900000000001 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3887 3.36 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.534566779, 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031800800999999997, 2024-09-10T05:58:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3887 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248176+0000", 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6920000000000001e-06 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252399+0000", 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042231289999999999 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252445+0000", 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6678999999999998e-05 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252475+0000", 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9957000000000001e-05 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252597+0000", 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012193699999999999 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252960+0000", 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036250600000000002 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253367+0000", 2024-09-10T05:58:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040692000000000001 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279695+0000", 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026328706 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279755+0000", 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9942999999999999e-05 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279861+0000", 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279972+0000", 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111216 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3890 3.35 3:acfee5d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_459:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.505327082000001, 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027993634999999999, 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3890 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277414+0000", 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283323+0000", 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059094550000000001 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283358+0000", 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4260000000000001e-05 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283376+0000", 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7957000000000001e-05 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283518+0000", 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141884 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283786+0000", 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026811800000000002 2024-09-10T05:58:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284076+0000", 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029020000000000001 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.296068+0000", 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011992523 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305096+0000", 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090274710000000005 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305275+0000", 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178982 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305404+0000", 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012940200000000001 2024-09-10T05:58:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:16.910 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:16.911 INFO:tasks.workunit.client.0.smithi070.stdout:Bucket Created: buck_2024_08_10_05_58_16 2024-09-10T05:58:16.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:58:16.912 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:16.905+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:17.013 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:17.007+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:17.047 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.5789.0:7 5.10 5.10 (undecoded) ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e108)", 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:17.047318+0000", 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00011265299999999999, 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150669, 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "queued for pg", 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.048 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.5789", 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/556840594", 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:17.047318+0000", 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:17.047318+0000", 2024-09-10T05:58:17.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:17.047321+0000", 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8600000000000001e-06 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:17.047331+0000", 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.005e-05 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:17.047349+0000", 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8732999999999998e-05 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:17.047364+0000", 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4377e-05 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:17.047496+0000", 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013199500000000001 2024-09-10T05:58:17.051 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.052 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.052 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-10T05:58:17.052 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-10T05:58:17.052 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:17.063 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:58:17.105 INFO:tasks.workunit.client.0.smithi070.stdout:bucket quota max size set for the given user: buck_2024_08_10_05_58_16 2024-09-10T05:58:17.113 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:17.109+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:17.213 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:17.209+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:17.241 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:17.242 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:17.242 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:17.242 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:17.242 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:17.256 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:58:17.314 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:17.307+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:17.379 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 190.39365934400001, 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.380 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:58:17.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.387 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.818503179000004, 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.388 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:58:17.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:58:17.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:58:17.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 89.921890920999999, 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:58:17.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:58:17.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2737 3.e 3:72fb2f28:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.352182033000005, 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026825221999999999, 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2737 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024266+0000", 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.024283+0000", 2024-09-10T05:58:17.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7005000000000001e-05 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029635+0000", 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053518230000000003 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029672+0000", 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6532000000000002e-05 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029693+0000", 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0686000000000002e-05 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.029808+0000", 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115253 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030034+0000", 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022595800000000001 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.030270+0000", 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236393 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.040212+0000", 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099417949999999998 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050770+0000", 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010558122 2024-09-10T05:58:17.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.050954+0000", 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018360199999999999 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.051092+0000", 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013805299999999999 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.406 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.171703437000005, 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:58:17.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:58:17.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:2762 3.7 e74/57 3:e032351f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_225:head v 74'2, mlcod=0'0)", 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.102127436000004, 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026548802999999999, 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274321+0000", 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.274323+0000", 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5099999999999999e-06 2024-09-10T05:58:17.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.283984+0000", 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096614460000000006 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284019+0000", 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4863000000000001e-05 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284036+0000", 2024-09-10T05:58:17.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6813e-05 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284168+0000", 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013210399999999999 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.284222+0000", 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500999999999999e-05 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300775+0000", 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016552931999999999 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.300870+0000", 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4634000000000002e-05 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3001 3.13 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:17.417 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.253100807999999, 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033587631, 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3001 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:17.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123352+0000", 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.98e-06 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130553+0000", 2024-09-10T05:58:17.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072012509999999997 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130587+0000", 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4353000000000001e-05 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130604+0000", 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.683e-05 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130729+0000", 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012522400000000001 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130969+0000", 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023993699999999999 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131198+0000", 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228934 2024-09-10T05:58:17.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140763+0000", 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095652370000000007 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156656+0000", 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015892292999999998 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156816+0000", 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016013099999999999 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156935+0000", 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119461 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.423 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3010 3.7 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 43.142308182999997, 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71061391500000004, 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3010 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.424 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234152+0000", 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1463e-05 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238146+0000", 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039945559999999998 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238187+0000", 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0930000000000003e-05 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238206+0000", 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8379000000000001e-05 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238363+0000", 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015778499999999999 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238381+0000", 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915494+0000", 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.67711229299999998 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915792+0000", 2024-09-10T05:58:17.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029809599999999997 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.916087+0000", 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029488000000000002 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.942809+0000", 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026722612999999999 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944396+0000", 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015870750000000001 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944490+0000", 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3985000000000002e-05 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944754+0000", 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000264023 2024-09-10T05:58:17.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3061 3.e 3:714229d8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.927807094000002, 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027015661999999999, 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.431 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3061 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448652+0000", 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0242e-05 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452737+0000", 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040853269999999997 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452769+0000", 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2141999999999998e-05 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452784+0000", 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5051999999999999e-05 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452925+0000", 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014050099999999999 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.453096+0000", 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017083800000000001 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.453245+0000", 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014919600000000001 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.468730+0000", 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015485120999999999 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475399+0000", 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066694750000000002 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475550+0000", 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150638 2024-09-10T05:58:17.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475657+0000", 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010713 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3458 3.d 3:b0baf69f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.363523740000002, 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029316732000000002, 2024-09-10T05:58:17.437 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3458 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012928+0000", 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019654+0000", 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067255250000000004 2024-09-10T05:58:17.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019684+0000", 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0673999999999998e-05 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019705+0000", 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0196000000000001e-05 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019854+0000", 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014964199999999999 2024-09-10T05:58:17.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020099+0000", 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024499199999999997 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020326+0000", 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022693799999999999 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.039686+0000", 2024-09-10T05:58:17.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019360049000000001 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.041971+0000", 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022845980000000001 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042121+0000", 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015037899999999999 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042242+0000", 2024-09-10T05:58:17.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120369 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3459 3.7 3:e377e840:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.355755769000002, 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035558590000000001, 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.443 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3459 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020695+0000", 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7159999999999999e-06 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025414+0000", 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004718112 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025455+0000", 2024-09-10T05:58:17.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1343e-05 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025478+0000", 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3385999999999999e-05 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025669+0000", 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019060600000000001 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026052+0000", 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038261000000000002 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026463+0000", 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000411016 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.049026+0000", 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022563436999999999 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056038+0000", 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070124879999999999 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056178+0000", 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139462 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056251+0000", 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3413999999999999e-05 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3557 3.11 3:882beea5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.901864115999999, 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031410517999999998, 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3557 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474588+0000", 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9829999999999998e-06 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480942+0000", 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006353605 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480984+0000", 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2092999999999998e-05 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481009+0000", 2024-09-10T05:58:17.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5323000000000001e-05 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481184+0000", 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017464600000000001 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481422+0000", 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023791799999999999 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481649+0000", 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227111 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.502907+0000", 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021257547000000002 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505706+0000", 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027996380000000001 2024-09-10T05:58:17.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505859+0000", 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015259799999999999 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505995+0000", 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013605600000000001 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3805 3.f 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.862646975000001, 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032364751999999997, 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3805 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.456 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513804+0000", 2024-09-10T05:58:17.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7659999999999999e-06 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518449+0000", 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046447620000000002 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518479+0000", 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9583000000000001e-05 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518499+0000", 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0707999999999999e-05 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518612+0000", 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011232599999999999 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518918+0000", 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030618099999999999 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519295+0000", 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037720100000000002 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545713+0000", 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026418322000000001 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545851+0000", 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013759899999999999 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546022+0000", 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017056800000000001 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546166+0000", 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014473599999999999 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3842 3.2f e103/24 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head v 103'13, mlcod=103'11)", 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.584125537, 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026955135000000002, 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:17.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792325+0000", 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3499999999999999e-06 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795292+0000", 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029671160000000001 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795320+0000", 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7869999999999999e-05 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795337+0000", 2024-09-10T05:58:17.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6336000000000001e-05 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795487+0000", 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150352 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795532+0000", 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4629999999999998e-05 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.819115+0000", 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023583415999999999 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.819278+0000", 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163065 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3850 3.3f 3:fda66161:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:17.466 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.504793528, 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028103604000000001, 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3850 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871659+0000", 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.783e-06 2024-09-10T05:58:17.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875788+0000", 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041287629999999997 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875838+0000", 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0120000000000001e-05 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875864+0000", 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6285e-05 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876003+0000", 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013910499999999999 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876243+0000", 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023953200000000001 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876443+0000", 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020025899999999999 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899442+0000", 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022998779 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899506+0000", 2024-09-10T05:58:17.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4497000000000003e-05 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899661+0000", 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155227 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899759+0000", 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7254000000000001e-05 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3855 3.11 3:892729bc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_424:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.452583453999999, 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028027435, 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3855 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923868+0000", 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1379999999999999e-06 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927312+0000", 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034438659999999999 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927346+0000", 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3569999999999999e-05 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927364+0000", 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8749999999999998e-05 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927537+0000", 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017227599999999999 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927890+0000", 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035353499999999998 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.928239+0000", 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000348434 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.947716+0000", 2024-09-10T05:58:17.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019477305 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951690+0000", 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039739709999999998 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951800+0000", 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011006900000000001 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951893+0000", 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2521000000000004e-05 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3880 3.37 3:ec881012:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_449:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.202733249, 2024-09-10T05:58:17.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029579850000000001, 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3880 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173719+0000", 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4599999999999999e-06 2024-09-10T05:58:17.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178656+0000", 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049375230000000001 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178700+0000", 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.409e-05 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178726+0000", 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5503e-05 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178895+0000", 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000169572 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179154+0000", 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025896399999999998 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179410+0000", 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025568800000000001 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.202784+0000", 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023373701 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203018+0000", 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234064 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203148+0000", 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013007900000000001 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203295+0000", 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014720600000000001 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.485 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3891 3.3f 3:fc60bd0c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_460:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.287109+0000", 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.089339783, 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026950976000000001, 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3891 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.287109+0000", 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.287109+0000", 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.287113+0000", 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3939999999999998e-06 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291270+0000", 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041571500000000001 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291305+0000", 2024-09-10T05:58:17.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4462000000000003e-05 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291325+0000", 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0366000000000001e-05 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291456+0000", 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013085000000000001 2024-09-10T05:58:17.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291694+0000", 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023788100000000001 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.291914+0000", 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000220087 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.308924+0000", 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017010042999999999 2024-09-10T05:58:17.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.309299+0000", 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000374624 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.309460+0000", 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016100500000000001 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.314060+0000", 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046001139999999998 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3894 3.e 3:72a2f092:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.054535672, 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027366047000000001, 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3894 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321917+0000", 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2189999999999998e-06 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325869+0000", 2024-09-10T05:58:17.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039515990000000001 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325900+0000", 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1745000000000002e-05 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325916+0000", 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5934999999999999e-05 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326020+0000", 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103359 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326241+0000", 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022122999999999999 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:17.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326541+0000", 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000299678 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.342668+0000", 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016127266000000001 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349093+0000", 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064252349999999996 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349194+0000", 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100462 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349279+0000", 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5319000000000001e-05 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3910 3.14 e103/24 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head v 103'17, mlcod=103'15)", 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.823594584, 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027277861, 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:17.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552855+0000", 2024-09-10T05:58:17.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555222+0000", 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023664390000000001 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555263+0000", 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152000000000002e-05 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555277+0000", 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4092e-05 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555414+0000", 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013695299999999999 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555459+0000", 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5272999999999998e-05 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580075+0000", 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024615818000000001 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580132+0000", 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6841e-05 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:17.503 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:17.505 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:17.503+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:17.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:58:17.606 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:17.603+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:17.623 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:17.623 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:17.623 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:58:17.623 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:17.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:58:17.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:58:17.724 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:17.721+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:17.760 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:17.760 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:17.760 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:58:17.760 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:58:17.761 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:17.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:58:17.816 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:17.813+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:17.822 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:17.822 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:17.839 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:17.839 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:17.855 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:17.855 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:17.873 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:17.873 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:17.894 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:17.895 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:17.904 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T05:58:17.909 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:17.903+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:17.915 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:17.929 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:17.929 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:17.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:58:17.949 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:17.949 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:17.969 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:17.970 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:18.010 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:18.007+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:18.062 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:18.062 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:18.076 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:58:18.111 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:18.107+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:18.193 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:18.194 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:18.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:58:18.252 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:18.249+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:18.312 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:18.309+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:18.319 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:18.319 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:18.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:58:18.413 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:18.411+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:18.488 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:18.488 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:18.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:58:18.548 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:18.545+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:18.617 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:18.609+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:18.617 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:18.618 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:18.631 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:58:18.716 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:18.711+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:18.791 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:18.791 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:18.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:58:18.848 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:18.845+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:18.885 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is set 2024-09-10T05:58:18.917 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:18.911+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:18.934 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:18.935 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:18.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:58:19.036 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:19.033+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:19.099 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:19.099 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:19.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:58:19.156 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:19.153+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:19.219 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:19.213+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:19.277 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:19.278 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:19.292 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:58:19.336 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:19.333+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:19.421 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:19.415+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:19.422 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:19.422 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:19.436 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:58:19.521 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:19.517+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:19.602 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:19.602 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:19.617 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:58:19.622 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:19.617+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:19.723 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:19.717+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:19.740 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:19.740 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:19.754 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:58:19.823 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:19.819+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:19.871 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:19.871 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:19.885 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:58:19.927 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:19.923+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:19.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:58:20.032 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:20.029+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:20.049 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:20.049 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:20.063 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:58:20.126 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:20.119+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:20.127 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:20.143 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:20.144 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:20.159 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:20.175 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:20.187 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:20.187 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:20.195 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:20.195 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:20.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:58:20.214 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:20.215 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:20.226 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:20.221+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:20.232 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:20.232 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:20.252 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:20.253 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:20.327 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:20.321+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:20.365 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:20.365 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:20.365 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:20.365 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:20.379 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:58:20.428 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:20.423+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:20.499 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:20.499 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:20.499 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:20.514 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:58:20.555 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:20.551+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:20.630 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:20.625+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:20.685 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.685 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 170.09247257499999, 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:58:20.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:58:20.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3000 3.26 3:66b3ccfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.579359142999998, 2024-09-10T05:58:20.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026540508000000001, 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3000 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102039+0000", 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.213e-06 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108021+0000", 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059826480000000001 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108061+0000", 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9382999999999999e-05 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108079+0000", 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8542999999999998e-05 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108260+0000", 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018121000000000001 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108677+0000", 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041657899999999998 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.109094+0000", 2024-09-10T05:58:20.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000416807 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.127165+0000", 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018071348000000001 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128257+0000", 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001091741 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128485+0000", 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022827700000000001 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128576+0000", 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0759000000000003e-05 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3002 3.36 3:6ef358c6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:20.699 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.546987012999999, 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026032893000000001, 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3002 2024-09-10T05:58:20.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134413+0000", 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5639999999999996e-06 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140435+0000", 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060217939999999996 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140485+0000", 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0089000000000001e-05 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140505+0000", 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0186999999999998e-05 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140663+0000", 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157744 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141102+0000", 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043870399999999999 2024-09-10T05:58:20.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141512+0000", 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041073500000000002 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.153730+0000", 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012217608 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160105+0000", 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063753949999999998 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160301+0000", 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195551 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160440+0000", 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139522 2024-09-10T05:58:20.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3009 3.33 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.458320731000001, 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71394179300000005, 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.706 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3009 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223079+0000", 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8029999999999996e-06 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227044+0000", 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003965021 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227081+0000", 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7153000000000002e-05 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227106+0000", 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5522999999999999e-05 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227283+0000", 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017625099999999999 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227305+0000", 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2200000000000001e-05 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.911736+0000", 2024-09-10T05:58:20.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.68443125800000004 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912098+0000", 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000361527 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912509+0000", 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186899999999998 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.930388+0000", 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017878817000000002 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936858+0000", 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064700369999999997 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936908+0000", 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9792e-05 2024-09-10T05:58:20.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.937016+0000", 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010754199999999999 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3042 3.a 3:50a6a854:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.461764580000001, 2024-09-10T05:58:20.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023353200000000001, 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3042 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:20.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219630+0000", 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.219633+0000", 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0060000000000001e-06 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225187+0000", 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055536630000000003 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225218+0000", 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1353999999999998e-05 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225234+0000", 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5519000000000002e-05 2024-09-10T05:58:20.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225372+0000", 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013812699999999999 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225669+0000", 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029757699999999999 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:20.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.225934+0000", 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026508599999999999 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.239222+0000", 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01328796 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242760+0000", 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035374289999999999 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242891+0000", 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013163399999999999 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.242983+0000", 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1844999999999999e-05 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3046 3.1e 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:20.719 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.410236930000003, 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023372101999999999, 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3046 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271160+0000", 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275046+0000", 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003885707 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275067+0000", 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1642e-05 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275083+0000", 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5477000000000001e-05 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275168+0000", 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5079000000000003e-05 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275391+0000", 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022318699999999999 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275563+0000", 2024-09-10T05:58:20.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017160499999999999 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.284169+0000", 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086058950000000006 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294378+0000", 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010209885 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294463+0000", 2024-09-10T05:58:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4661999999999997e-05 2024-09-10T05:58:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294530+0000", 2024-09-10T05:58:20.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6688999999999998e-05 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3062 3.a 3:510cfa22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.222099168, 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023825417000000002, 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.726 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3062 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459299+0000", 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0829999999999997e-06 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464231+0000", 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049315019999999999 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464266+0000", 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4904000000000003e-05 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464282+0000", 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464381+0000", 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8698999999999998e-05 2024-09-10T05:58:20.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464599+0000", 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218533 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464788+0000", 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188247 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475654+0000", 2024-09-10T05:58:20.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010866549 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.482934+0000", 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072803160000000002 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483038+0000", 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010331 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483121+0000", 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3101000000000003e-05 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3419 3.1e 3:7bbb5ef4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.972681986000001, 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024061241000000001, 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.732 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3419 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:20.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708717+0000", 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999997e-06 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717539+0000", 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088221600000000008 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717582+0000", 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999998e-05 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717607+0000", 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4532000000000002e-05 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717749+0000", 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014247500000000001 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718284+0000", 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053459199999999997 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718669+0000", 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038528400000000001 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.729703+0000", 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011033687 2024-09-10T05:58:20.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732433+0000", 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027304439999999998 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732615+0000", 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018145800000000001 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732774+0000", 2024-09-10T05:58:20.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159149 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3449 3.20 3:06b085c8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.764061539, 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023229774000000002, 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.738 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3449 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917333+0000", 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.917337+0000", 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3429999999999998e-06 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922049+0000", 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004711135 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922104+0000", 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.592e-05 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922135+0000", 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0329e-05 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922305+0000", 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017053899999999999 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922568+0000", 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026224799999999997 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.922808+0000", 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000240678 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.932764+0000", 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099562020000000008 2024-09-10T05:58:20.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940253+0000", 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074887970000000002 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940434+0000", 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018096799999999999 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.940563+0000", 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000128615 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3463 3.36 3:6eb508a9:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.619225440000001, 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02333292, 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3463 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062169+0000", 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.062176+0000", 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.956e-06 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066729+0000", 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045528799999999996 2024-09-10T05:58:20.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066763+0000", 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4471999999999998e-05 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066781+0000", 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7917000000000001e-05 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.066948+0000", 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016702199999999999 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067181+0000", 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000232869 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.067421+0000", 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023939299999999999 2024-09-10T05:58:20.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.076526+0000", 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091050300000000001 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085179+0000", 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086531899999999998 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085358+0000", 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017913900000000001 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.085502+0000", 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014405200000000001 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3464 3.26 3:670772ec:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:20.750 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.608471793, 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027033292, 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3464 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072927+0000", 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7459999999999998e-06 2024-09-10T05:58:20.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077023+0000", 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040969040000000002 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077070+0000", 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6876000000000003e-05 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077102+0000", 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1766e-05 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077220+0000", 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011787599999999999 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077448+0000", 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228175 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077666+0000", 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218216 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099266+0000", 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021599679 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099650+0000", 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000384096 2024-09-10T05:58:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099819+0000", 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168746 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099956+0000", 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137212 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3515 3.33 3:cdf573bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.926333619000001, 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022302426, 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.757 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3515 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755061+0000", 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.755064+0000", 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2969999999999999e-06 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759036+0000", 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003971484 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759069+0000", 2024-09-10T05:58:20.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3654e-05 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759086+0000", 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6736e-05 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759206+0000", 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120363 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759485+0000", 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027802399999999998 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.759727+0000", 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024243499999999999 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.768857+0000", 2024-09-10T05:58:20.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091297849999999996 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777204+0000", 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083474719999999999 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777293+0000", 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8306000000000005e-05 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.777363+0000", 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0870000000000004e-05 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3527 3.34 e101/24 3:2d96463c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_106:head v 101'12, mlcod=93'10)", 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.750506334000001, 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022764337999999999, 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930888+0000", 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.930889+0000", 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2130000000000001e-06 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934309+0000", 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034198950000000001 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934342+0000", 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2483000000000001e-05 2024-09-10T05:58:20.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934358+0000", 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6439999999999998e-05 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934490+0000", 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013154599999999999 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.934530+0000", 2024-09-10T05:58:20.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0590000000000003e-05 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953524+0000", 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018993344999999998 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.953653+0000", 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012882599999999999 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3570 3.26 3:67afa84d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.979964883000001, 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023228478, 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.768 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3570 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701430+0000", 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.701432+0000", 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6340000000000001e-06 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705705+0000", 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042724269999999996 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705729+0000", 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4107000000000001e-05 2024-09-10T05:58:20.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705741+0000", 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2335e-05 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.705897+0000", 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015548100000000001 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706177+0000", 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028081500000000001 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.706408+0000", 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230991 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.715905+0000", 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094962859999999996 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724359+0000", 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084545820000000004 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724526+0000", 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016648499999999999 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.724658+0000", 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132335 2024-09-10T05:58:20.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3853 3.2 e103/90 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head v 103'11, mlcod=103'9)", 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.772564490000001, 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026052486999999999, 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.774 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908833+0000", 2024-09-10T05:58:20.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3050000000000001e-06 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912185+0000", 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00335177 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912243+0000", 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7635e-05 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912271+0000", 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7974e-05 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913259+0000", 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098803699999999999 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913318+0000", 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422000000000001e-05 2024-09-10T05:58:20.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934525+0000", 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021206610000000001 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934883+0000", 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035773400000000001 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3854 3.2 e103/90 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head v 103'12, mlcod=103'9)", 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.763745419999999, 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025998609999999998, 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917653+0000", 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4000000000000001e-06 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922882+0000", 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052294120000000001 2024-09-10T05:58:20.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922916+0000", 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4425999999999999e-05 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922939+0000", 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3050000000000001e-05 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923078+0000", 2024-09-10T05:58:20.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013832800000000001 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923128+0000", 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0127000000000003e-05 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943488+0000", 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020360165999999999 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943648+0000", 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015970099999999999 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3883 3.26 3:6770c43b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_452:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.474907647999999, 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024529107000000001, 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.783 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3883 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206504+0000", 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6835999999999999e-05 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210252+0000", 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037487179999999998 2024-09-10T05:58:20.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210283+0000", 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0341999999999999e-05 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210299+0000", 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6663e-05 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210406+0000", 2024-09-10T05:58:20.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106648 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210618+0000", 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021149600000000001 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210809+0000", 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000191418 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.229667+0000", 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018857604 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230689+0000", 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010224920000000001 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230877+0000", 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018767799999999999 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.231016+0000", 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013921199999999999 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3886 3.34 e103/24 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head v 103'21, mlcod=103'19)", 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.435967043000002, 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029486221999999999, 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245431+0000", 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7529999999999999e-06 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249357+0000", 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039260179999999999 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249399+0000", 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1536999999999999e-05 2024-09-10T05:58:20.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249419+0000", 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249577+0000", 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158021 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249722+0000", 2024-09-10T05:58:20.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014495900000000001 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274800+0000", 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025077941999999999 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274914+0000", 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011417900000000001 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3887 3.36 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.433223653999999, 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031800800999999997, 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3887 2024-09-10T05:58:20.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248176+0000", 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6920000000000001e-06 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252399+0000", 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042231289999999999 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252445+0000", 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6678999999999998e-05 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252475+0000", 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9957000000000001e-05 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252597+0000", 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012193699999999999 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252960+0000", 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036250600000000002 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253367+0000", 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040692000000000001 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279695+0000", 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026328706 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279755+0000", 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9942999999999999e-05 2024-09-10T05:58:20.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279861+0000", 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279972+0000", 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111216 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3890 3.35 3:acfee5d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_459:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.403983957000001, 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027993634999999999, 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3890 2024-09-10T05:58:20.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277414+0000", 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283323+0000", 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059094550000000001 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283358+0000", 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4260000000000001e-05 2024-09-10T05:58:20.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283376+0000", 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7957000000000001e-05 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283518+0000", 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141884 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283786+0000", 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026811800000000002 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284076+0000", 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029020000000000001 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.296068+0000", 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011992523 2024-09-10T05:58:20.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305096+0000", 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090274710000000005 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305275+0000", 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178982 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305404+0000", 2024-09-10T05:58:20.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012940200000000001 2024-09-10T05:58:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:20.806 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:20.806 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:20.808 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:58:20.808 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:20.803+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:20.906 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T05:58:20.907 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:20.903+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:20.982 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:20.982 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:20.996 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:58:21.039 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:21.035+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:21.115 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:21.105+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:21.178 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:21.178 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:21.178 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:21.178 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:21.178 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:21.197 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:58:21.212 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:21.205+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:21.311 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:21.307+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:21.336 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:21.336 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 194.35146430699999, 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:58:21.337 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:58:21.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:58:21.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:21.344 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.776308142000005, 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:58:21.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:58:21.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:58:21.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 93.879695884, 2024-09-10T05:58:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:58:21.351 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:58:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:58:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:58:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:58:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:58:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:58:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:58:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:58:21.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:58:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:58:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:58:21.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:58:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:58:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:58:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:58:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:58:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:58:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:58:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:58:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:58:21.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:58:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:58:21.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:58:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.364 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 80.129508400000006, 2024-09-10T05:58:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:58:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.365 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:58:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:58:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:58:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:58:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:58:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:58:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:58:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:58:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:58:21.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:58:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:58:21.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:58:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:58:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:58:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:58:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:58:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:58:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:58:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:58:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:58:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:58:21.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:58:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:58:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3001 3.13 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:21.378 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.210905771, 2024-09-10T05:58:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033587631, 2024-09-10T05:58:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.379 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3001 2024-09-10T05:58:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123352+0000", 2024-09-10T05:58:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.98e-06 2024-09-10T05:58:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130553+0000", 2024-09-10T05:58:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072012509999999997 2024-09-10T05:58:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130587+0000", 2024-09-10T05:58:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4353000000000001e-05 2024-09-10T05:58:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130604+0000", 2024-09-10T05:58:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.683e-05 2024-09-10T05:58:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130729+0000", 2024-09-10T05:58:21.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012522400000000001 2024-09-10T05:58:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130969+0000", 2024-09-10T05:58:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023993699999999999 2024-09-10T05:58:21.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131198+0000", 2024-09-10T05:58:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228934 2024-09-10T05:58:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140763+0000", 2024-09-10T05:58:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095652370000000007 2024-09-10T05:58:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156656+0000", 2024-09-10T05:58:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015892292999999998 2024-09-10T05:58:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156816+0000", 2024-09-10T05:58:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016013099999999999 2024-09-10T05:58:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156935+0000", 2024-09-10T05:58:21.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119461 2024-09-10T05:58:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3010 3.7 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.100113145999998, 2024-09-10T05:58:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71061391500000004, 2024-09-10T05:58:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3010 2024-09-10T05:58:21.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:21.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234152+0000", 2024-09-10T05:58:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1463e-05 2024-09-10T05:58:21.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238146+0000", 2024-09-10T05:58:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039945559999999998 2024-09-10T05:58:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238187+0000", 2024-09-10T05:58:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0930000000000003e-05 2024-09-10T05:58:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238206+0000", 2024-09-10T05:58:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8379000000000001e-05 2024-09-10T05:58:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238363+0000", 2024-09-10T05:58:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015778499999999999 2024-09-10T05:58:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238381+0000", 2024-09-10T05:58:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915494+0000", 2024-09-10T05:58:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.67711229299999998 2024-09-10T05:58:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915792+0000", 2024-09-10T05:58:21.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029809599999999997 2024-09-10T05:58:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.916087+0000", 2024-09-10T05:58:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029488000000000002 2024-09-10T05:58:21.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.942809+0000", 2024-09-10T05:58:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026722612999999999 2024-09-10T05:58:21.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944396+0000", 2024-09-10T05:58:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015870750000000001 2024-09-10T05:58:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944490+0000", 2024-09-10T05:58:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3985000000000002e-05 2024-09-10T05:58:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944754+0000", 2024-09-10T05:58:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000264023 2024-09-10T05:58:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.408 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3061 3.e 3:714229d8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.885612057000003, 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027015661999999999, 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.409 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3061 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448641+0000", 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.448652+0000", 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0242e-05 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452737+0000", 2024-09-10T05:58:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040853269999999997 2024-09-10T05:58:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452769+0000", 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2141999999999998e-05 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452784+0000", 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5051999999999999e-05 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.452925+0000", 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014050099999999999 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.453096+0000", 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017083800000000001 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.453245+0000", 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014919600000000001 2024-09-10T05:58:21.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.468730+0000", 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015485120999999999 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475399+0000", 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066694750000000002 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475550+0000", 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150638 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475657+0000", 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010713 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3458 3.d 3:b0baf69f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:21.417 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.321328702999999, 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029316732000000002, 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3458 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:21.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012928+0000", 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019654+0000", 2024-09-10T05:58:21.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067255250000000004 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019684+0000", 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0673999999999998e-05 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019705+0000", 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0196000000000001e-05 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019854+0000", 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014964199999999999 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020099+0000", 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024499199999999997 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020326+0000", 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022693799999999999 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.039686+0000", 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019360049000000001 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.041971+0000", 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022845980000000001 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042121+0000", 2024-09-10T05:58:21.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015037899999999999 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042242+0000", 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120369 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3459 3.7 3:e377e840:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:21.423 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.313560731999999, 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035558590000000001, 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3459 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:21.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020695+0000", 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7159999999999999e-06 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025414+0000", 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004718112 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025455+0000", 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1343e-05 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025478+0000", 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3385999999999999e-05 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025669+0000", 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019060600000000001 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026052+0000", 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038261000000000002 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026463+0000", 2024-09-10T05:58:21.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000411016 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.049026+0000", 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022563436999999999 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056038+0000", 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070124879999999999 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056178+0000", 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139462 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056251+0000", 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3413999999999999e-05 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3557 3.11 3:882beea5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.859669079, 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031410517999999998, 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3557 2024-09-10T05:58:21.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:21.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474588+0000", 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9829999999999998e-06 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480942+0000", 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006353605 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480984+0000", 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2092999999999998e-05 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481009+0000", 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5323000000000001e-05 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481184+0000", 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017464600000000001 2024-09-10T05:58:21.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481422+0000", 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023791799999999999 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481649+0000", 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227111 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.502907+0000", 2024-09-10T05:58:21.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021257547000000002 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505706+0000", 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027996380000000001 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505859+0000", 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015259799999999999 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505995+0000", 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013605600000000001 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3805 3.f 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.820451938000001, 2024-09-10T05:58:21.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032364751999999997, 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3805 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513804+0000", 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7659999999999999e-06 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518449+0000", 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046447620000000002 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518479+0000", 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9583000000000001e-05 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518499+0000", 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0707999999999999e-05 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518612+0000", 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011232599999999999 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518918+0000", 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030618099999999999 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519295+0000", 2024-09-10T05:58:21.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037720100000000002 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545713+0000", 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026418322000000001 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545851+0000", 2024-09-10T05:58:21.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013759899999999999 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546022+0000", 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017056800000000001 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546166+0000", 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014473599999999999 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.442 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3842 3.2f e103/24 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head v 103'13, mlcod=103'11)", 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.541930499999999, 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026955135000000002, 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.443 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792323+0000", 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792325+0000", 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3499999999999999e-06 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795292+0000", 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029671160000000001 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795320+0000", 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7869999999999999e-05 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795337+0000", 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6336000000000001e-05 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795487+0000", 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000150352 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.795532+0000", 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4629999999999998e-05 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.819115+0000", 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023583415999999999 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.819278+0000", 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000163065 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3850 3.3f 3:fda66161:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.462598491000001, 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028103604000000001, 2024-09-10T05:58:21.448 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3850 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:21.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871659+0000", 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.783e-06 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875788+0000", 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041287629999999997 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875838+0000", 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0120000000000001e-05 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875864+0000", 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6285e-05 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876003+0000", 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013910499999999999 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876243+0000", 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023953200000000001 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876443+0000", 2024-09-10T05:58:21.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020025899999999999 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899442+0000", 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022998779 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899506+0000", 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4497000000000003e-05 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899661+0000", 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155227 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899759+0000", 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7254000000000001e-05 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3855 3.11 3:892729bc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_424:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.410388417, 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028027435, 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3855 2024-09-10T05:58:21.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:21.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923868+0000", 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1379999999999999e-06 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927312+0000", 2024-09-10T05:58:21.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034438659999999999 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927346+0000", 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3569999999999999e-05 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927364+0000", 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8749999999999998e-05 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927537+0000", 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017227599999999999 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927890+0000", 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035353499999999998 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.928239+0000", 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000348434 2024-09-10T05:58:21.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.947716+0000", 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019477305 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951690+0000", 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039739709999999998 2024-09-10T05:58:21.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951800+0000", 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011006900000000001 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951893+0000", 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2521000000000004e-05 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3880 3.37 3:ec881012:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_449:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.160538211999999, 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029579850000000001, 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.462 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.463 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.463 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.463 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.463 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.463 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3880 2024-09-10T05:58:21.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173719+0000", 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4599999999999999e-06 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178656+0000", 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049375230000000001 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178700+0000", 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.409e-05 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178726+0000", 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5503e-05 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178895+0000", 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000169572 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179154+0000", 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025896399999999998 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:21.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179410+0000", 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025568800000000001 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.202784+0000", 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023373701 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203018+0000", 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234064 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203148+0000", 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013007900000000001 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203295+0000", 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014720600000000001 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3894 3.e 3:72a2f092:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.012340635000001, 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027366047000000001, 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3894 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321917+0000", 2024-09-10T05:58:21.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2189999999999998e-06 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325869+0000", 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039515990000000001 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325900+0000", 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1745000000000002e-05 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325916+0000", 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5934999999999999e-05 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326020+0000", 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103359 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326241+0000", 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022122999999999999 2024-09-10T05:58:21.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326541+0000", 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000299678 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.342668+0000", 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016127266000000001 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349093+0000", 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064252349999999996 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349194+0000", 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100462 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349279+0000", 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5319000000000001e-05 2024-09-10T05:58:21.475 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3910 3.14 e103/24 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head v 103'17, mlcod=103'15)", 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.781399546999999, 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027277861, 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552855+0000", 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555222+0000", 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023664390000000001 2024-09-10T05:58:21.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555263+0000", 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152000000000002e-05 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555277+0000", 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4092e-05 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555414+0000", 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013695299999999999 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555459+0000", 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5272999999999998e-05 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580075+0000", 2024-09-10T05:58:21.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024615818000000001 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580132+0000", 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6841e-05 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4091 3.13 3:c9e8f991:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.147562+0000", 2024-09-10T05:58:21.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.186691098, 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.049041548999999997, 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4091 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147562+0000", 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147562+0000", 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147565+0000", 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4770000000000002e-06 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155639+0000", 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080740080000000006 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155685+0000", 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6242999999999998e-05 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155712+0000", 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6735999999999999e-05 2024-09-10T05:58:21.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155851+0000", 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138899 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.156097+0000", 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024613499999999997 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.156310+0000", 2024-09-10T05:58:21.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021261899999999999 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.183527+0000", 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027217228999999999 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196355+0000", 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012828694999999999 2024-09-10T05:58:21.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196491+0000", 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013567900000000001 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196604+0000", 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112829 2024-09-10T05:58:21.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.488 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.488 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4092 3.15 3:a96a4c3b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:21.488 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.158187+0000", 2024-09-10T05:58:21.489 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.17606669999999999, 2024-09-10T05:58:21.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.041152655000000003, 2024-09-10T05:58:21.489 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.489 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.489 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.489 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.489 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.490 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.490 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4092 2024-09-10T05:58:21.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.490 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.158187+0000", 2024-09-10T05:58:21.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.158187+0000", 2024-09-10T05:58:21.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.158190+0000", 2024-09-10T05:58:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7000000000000002e-06 2024-09-10T05:58:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164392+0000", 2024-09-10T05:58:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006201855 2024-09-10T05:58:21.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164440+0000", 2024-09-10T05:58:21.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7512999999999997e-05 2024-09-10T05:58:21.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164466+0000", 2024-09-10T05:58:21.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6035999999999999e-05 2024-09-10T05:58:21.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164627+0000", 2024-09-10T05:58:21.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016090200000000001 2024-09-10T05:58:21.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164882+0000", 2024-09-10T05:58:21.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025479799999999998 2024-09-10T05:58:21.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:21.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.165202+0000", 2024-09-10T05:58:21.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032079400000000001 2024-09-10T05:58:21.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.195633+0000", 2024-09-10T05:58:21.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030430266000000001 2024-09-10T05:58:21.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.199289+0000", 2024-09-10T05:58:21.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036563089999999999 2024-09-10T05:58:21.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.199319+0000", 2024-09-10T05:58:21.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0397999999999999e-05 2024-09-10T05:58:21.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.199339+0000", 2024-09-10T05:58:21.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0083999999999999e-05 2024-09-10T05:58:21.501 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.501 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.502 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.502 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4093 3.3f 3:fcef226c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:21.502 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.167178+0000", 2024-09-10T05:58:21.502 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.16707557100000001, 2024-09-10T05:58:21.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029620480000000001, 2024-09-10T05:58:21.503 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:21.503 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:21.503 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:21.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:21.504 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:21.504 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:21.504 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4093 2024-09-10T05:58:21.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.504 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:21.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:21.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.167178+0000", 2024-09-10T05:58:21.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:21.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.167178+0000", 2024-09-10T05:58:21.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:21.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:21.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.167182+0000", 2024-09-10T05:58:21.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.687e-06 2024-09-10T05:58:21.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:21.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171291+0000", 2024-09-10T05:58:21.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041096400000000003 2024-09-10T05:58:21.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:21.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171328+0000", 2024-09-10T05:58:21.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6470000000000001e-05 2024-09-10T05:58:21.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:21.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171355+0000", 2024-09-10T05:58:21.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7682999999999999e-05 2024-09-10T05:58:21.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:21.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171470+0000", 2024-09-10T05:58:21.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011492799999999999 2024-09-10T05:58:21.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:21.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171736+0000", 2024-09-10T05:58:21.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026610499999999999 2024-09-10T05:58:21.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:21.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.172117+0000", 2024-09-10T05:58:21.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038067400000000001 2024-09-10T05:58:21.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:21.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.193884+0000", 2024-09-10T05:58:21.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02176641 2024-09-10T05:58:21.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:21.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196733+0000", 2024-09-10T05:58:21.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028498260000000002 2024-09-10T05:58:21.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:21.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196772+0000", 2024-09-10T05:58:21.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8631000000000003e-05 2024-09-10T05:58:21.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:21.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:21.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:21.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196798+0000", 2024-09-10T05:58:21.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6426000000000001e-05 2024-09-10T05:58:21.515 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.516 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.516 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.516 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:21.516 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:21.516 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:21.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:58:21.520 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:21.513+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:21.620 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:21.615+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:21.663 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:21.663 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:21.663 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 0 2024-09-10T05:58:21.663 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:21.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:58:21.719 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:21.715+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:21.820 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:21.817+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:21.840 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:21.840 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:21.840 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:58:21.840 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:58:21.840 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:21.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:58:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is set 2024-09-10T05:58:21.922 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:21.915+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:22.022 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:22.015+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:22.067 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:22.067 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.222183623000006, 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.068 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.069 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.070 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:58:22.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.072 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:58:22.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 81.070013926000001, 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.075 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.076 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:58:22.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:58:22.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:58:22.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3006 3.b 3:d167e876:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:22.080 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.877061148000003, 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.73997048700000001, 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3006 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188374+0000", 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4970000000000001e-06 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190071+0000", 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00169713 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190105+0000", 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3581000000000003e-05 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190122+0000", 2024-09-10T05:58:22.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7016000000000001e-05 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190223+0000", 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010094000000000001 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190238+0000", 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5583e-05 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908275+0000", 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.71803706099999998 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908586+0000", 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031096200000000002 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908871+0000", 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028523900000000001 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915859+0000", 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069872830000000004 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928177+0000", 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012318513999999999 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.086 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928243+0000", 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5297999999999997e-05 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928341+0000", 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8382999999999996e-05 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.087 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3010 3.7 e91/90 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head v 91'3, mlcod=0'0)", 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.148633850000003, 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023300923000000001, 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8599999999999998e-07 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931447+0000", 2024-09-10T05:58:22.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014648899999999999 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931467+0000", 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0061999999999999e-05 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931479+0000", 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931547+0000", 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8113000000000003e-05 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931578+0000", 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0669000000000001e-05 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936627+0000", 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050490830000000002 2024-09-10T05:58:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.940099+0000", 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034719429999999999 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3015 3.3d 3:bd148ba2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:58:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.146496728999999, 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020562475, 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3015 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:58:22.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918935+0000", 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.918938+0000", 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.791e-06 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.921985+0000", 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0030470240000000002 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922010+0000", 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5726999999999999e-05 2024-09-10T05:58:22.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922027+0000", 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6741000000000001e-05 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922151+0000", 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012387699999999999 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922302+0000", 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000150827 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.922440+0000", 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000138491 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.930425+0000", 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0079845079999999995 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939338+0000", 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089127400000000006 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939431+0000", 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.2980999999999996e-05 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.939497+0000", 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6767999999999995e-05 2024-09-10T05:58:22.098 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3021 3.b 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 47.088879831, 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029193581, 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.099 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3021 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976554+0000", 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3640000000000002e-06 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978476+0000", 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019221830000000001 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978493+0000", 2024-09-10T05:58:22.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6331e-05 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978503+0000", 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0774000000000001e-05 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978582+0000", 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8651000000000003e-05 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978858+0000", 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000276455 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.979018+0000", 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015947800000000001 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.984809+0000", 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057911280000000004 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005635+0000", 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020826181999999999 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005679+0000", 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3417999999999997e-05 2024-09-10T05:58:22.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005745+0000", 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6617000000000003e-05 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3035 3.b 3:d1267ce1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.920545503, 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021701069, 2024-09-10T05:58:22.105 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3035 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144889+0000", 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146859+0000", 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019707790000000002 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146897+0000", 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7713000000000003e-05 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146914+0000", 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6558999999999998e-05 2024-09-10T05:58:22.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147007+0000", 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3190999999999996e-05 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147200+0000", 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193084 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147389+0000", 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188543 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.153536+0000", 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061479179999999996 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166419+0000", 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01288215 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166489+0000", 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321000000000007e-05 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166587+0000", 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8165000000000006e-05 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3041 3.b 3:d26ad16f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:22.111 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 46.854855917000002, 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030467424999999999, 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3041 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.112 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210578+0000", 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6240000000000002e-06 2024-09-10T05:58:22.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212335+0000", 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00175713 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212364+0000", 2024-09-10T05:58:22.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8208000000000002e-05 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212378+0000", 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4255e-05 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212469+0000", 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1051000000000006e-05 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212656+0000", 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018742699999999999 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212834+0000", 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000177298 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.219661+0000", 2024-09-10T05:58:22.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068273070000000003 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240871+0000", 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021210184 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240938+0000", 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6637999999999995e-05 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.241043+0000", 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105303 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3412 3.12 3:4a855f62:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.631704+0000", 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.433727444999999, 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.032427966000000003, 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3412 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.631704+0000", 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.631704+0000", 2024-09-10T05:58:22.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.631707+0000", 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633626+0000", 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001919502 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633644+0000", 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7435000000000002e-05 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633653+0000", 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6350000000000001e-06 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633718+0000", 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4621000000000004e-05 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633884+0000", 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016593200000000001 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.634040+0000", 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015649699999999999 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.640916+0000", 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068753959999999998 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.664018+0000", 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023102755999999999 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.664081+0000", 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2583999999999996e-05 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.664132+0000", 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1078999999999997e-05 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3416 3.1 3:808843e2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.679338+0000", 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.386093956, 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030652705999999998, 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3416 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.679338+0000", 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.679338+0000", 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.679341+0000", 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.241e-06 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.680965+0000", 2024-09-10T05:58:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001624636 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.680998+0000", 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2592000000000002e-05 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681013+0000", 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5375000000000001e-05 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681099+0000", 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5245000000000001e-05 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681228+0000", 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012934900000000001 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681365+0000", 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013661899999999999 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.686245+0000", 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048806559999999997 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.709846+0000", 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023600493 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.709926+0000", 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9849000000000001e-05 2024-09-10T05:58:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.709990+0000", 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4651000000000002e-05 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3447 3.2b 3:d5c1d222:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.894548+0000", 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.170883663000001, 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021425774000000002, 2024-09-10T05:58:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3447 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.894548+0000", 2024-09-10T05:58:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.894548+0000", 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.894552+0000", 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9110000000000003e-06 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896394+0000", 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001842315 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896424+0000", 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9550999999999999e-05 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896438+0000", 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4052e-05 2024-09-10T05:58:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896518+0000", 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9942000000000001e-05 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896658+0000", 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014000800000000001 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896790+0000", 2024-09-10T05:58:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013240999999999999 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.901373+0000", 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045825689999999999 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.915875+0000", 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0145027 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.915924+0000", 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8223000000000002e-05 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.915974+0000", 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0093000000000003e-05 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3540 3.3 e101/24 3:c0a030d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_119:head v 101'14, mlcod=100'12)", 2024-09-10T05:58:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:58.175798+0000", 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.889633493000002, 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020403641, 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.175798+0000", 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.175798+0000", 2024-09-10T05:58:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.175801+0000", 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0589999999999998e-06 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.184179+0000", 2024-09-10T05:58:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0083777959999999999 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.184224+0000", 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.4715000000000001e-05 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.184242+0000", 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8485e-05 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.184389+0000", 2024-09-10T05:58:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014723399999999999 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.184432+0000", 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.2855000000000002e-05 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.196043+0000", 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011611161 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.196202+0000", 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000158336 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3549 3.32 3:4ff6bc5a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:58.346782+0000", 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 23.718649259999999, 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021094595000000001, 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3549 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.346782+0000", 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.346782+0000", 2024-09-10T05:58:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.346787+0000", 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.5120000000000002e-06 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.349647+0000", 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028601960000000002 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.349681+0000", 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3522999999999997e-05 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.349695+0000", 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4503e-05 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.349868+0000", 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000172759 2024-09-10T05:58:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.350193+0000", 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00032561999999999999 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.350434+0000", 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00024080299999999999 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.363648+0000", 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013213322 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367742+0000", 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0040945670000000003 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367803+0000", 2024-09-10T05:58:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.1222000000000004e-05 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:58.367877+0000", 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3567999999999998e-05 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3826 3.1 3:820e7f9f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_405:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:01.720085+0000", 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.345346175, 2024-09-10T05:58:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020431149999999999, 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3826 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.720085+0000", 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.720085+0000", 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.720088+0000", 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.982e-06 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.722898+0000", 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028092680000000002 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.722933+0000", 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5748999999999999e-05 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.722960+0000", 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6984000000000001e-05 2024-09-10T05:58:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.723058+0000", 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7156000000000003e-05 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.723222+0000", 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016432400000000001 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.723378+0000", 2024-09-10T05:58:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015587399999999999 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.729731+0000", 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063529290000000002 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.740394+0000", 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010663288 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.740463+0000", 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9288999999999993e-05 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.740517+0000", 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3307000000000003e-05 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3845 3.2b 3:d6961cc2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_414:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:01.816840+0000", 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.248591995999998, 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.019869722999999999, 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3845 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.816840+0000", 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.816840+0000", 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.816842+0000", 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9299999999999999e-06 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.818638+0000", 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017950590000000001 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.818669+0000", 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1127000000000002e-05 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.818683+0000", 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.3869000000000001e-05 2024-09-10T05:58:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.818762+0000", 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8955999999999994e-05 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.818887+0000", 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012593000000000001 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.818991+0000", 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010364100000000001 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.823595+0000", 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0046035069999999997 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.836589+0000", 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012994767000000001 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.836659+0000", 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.9933999999999998e-05 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:01.836709+0000", 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0003000000000002e-05 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3863 3.1b 3:dbe80a96:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_432:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:02.000761+0000", 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 20.064670157999998, 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024381217, 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3863 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.000761+0000", 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.000761+0000", 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.000765+0000", 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1039999999999998e-06 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002479+0000", 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017143900000000001 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002498+0000", 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8967999999999999e-05 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002509+0000", 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1304000000000001e-05 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002586+0000", 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082999999999994e-05 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002762+0000", 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017532299999999999 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002916+0000", 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015426799999999999 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.007982+0000", 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050661719999999999 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.025015+0000", 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017033258999999999 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.025085+0000", 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0201000000000001e-05 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.025143+0000", 2024-09-10T05:58:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7145000000000003e-05 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3882 3.12 3:485fadb0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_451:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:02.194280+0000", 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.871151097999999, 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023010781000000001, 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3882 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.194280+0000", 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.194280+0000", 2024-09-10T05:58:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.194283+0000", 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9270000000000001e-06 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196142+0000", 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001858544 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196166+0000", 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4402000000000001e-05 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196176+0000", 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196253+0000", 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6304000000000007e-05 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196452+0000", 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000198965 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196611+0000", 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015898099999999999 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.207344+0000", 2024-09-10T05:58:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010733253 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.217152+0000", 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098077489999999993 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.217231+0000", 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9503000000000001e-05 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.217291+0000", 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0232999999999997e-05 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3885 3.1b 3:d9f72a25:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_454:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:02.231450+0000", 2024-09-10T05:58:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 19.833981118000001, 2024-09-10T05:58:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020540418000000001, 2024-09-10T05:58:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3885 2024-09-10T05:58:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.231450+0000", 2024-09-10T05:58:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.231450+0000", 2024-09-10T05:58:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.231453+0000", 2024-09-10T05:58:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8509999999999999e-06 2024-09-10T05:58:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.232819+0000", 2024-09-10T05:58:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001366108 2024-09-10T05:58:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.232851+0000", 2024-09-10T05:58:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1285000000000003e-05 2024-09-10T05:58:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.232866+0000", 2024-09-10T05:58:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5133000000000001e-05 2024-09-10T05:58:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.232936+0000", 2024-09-10T05:58:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0514999999999998e-05 2024-09-10T05:58:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.233051+0000", 2024-09-10T05:58:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000114182 2024-09-10T05:58:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.233153+0000", 2024-09-10T05:58:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000102512 2024-09-10T05:58:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.237403+0000", 2024-09-10T05:58:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0042503039999999999 2024-09-10T05:58:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.251906+0000", 2024-09-10T05:58:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014503162999999999 2024-09-10T05:58:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.251950+0000", 2024-09-10T05:58:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3315000000000001e-05 2024-09-10T05:58:22.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.251991+0000", 2024-09-10T05:58:22.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1050000000000002e-05 2024-09-10T05:58:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.188 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4117 3.1b 3:dabf6495:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:21.481814+0000", 2024-09-10T05:58:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.58361731800000005, 2024-09-10T05:58:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021058578000000001, 2024-09-10T05:58:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4117 2024-09-10T05:58:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.481814+0000", 2024-09-10T05:58:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.481814+0000", 2024-09-10T05:58:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.481819+0000", 2024-09-10T05:58:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0540000000000002e-06 2024-09-10T05:58:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.485548+0000", 2024-09-10T05:58:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0037284369999999998 2024-09-10T05:58:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.485588+0000", 2024-09-10T05:58:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.0092999999999997e-05 2024-09-10T05:58:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.485607+0000", 2024-09-10T05:58:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8889000000000002e-05 2024-09-10T05:58:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.485736+0000", 2024-09-10T05:58:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000129577 2024-09-10T05:58:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.485993+0000", 2024-09-10T05:58:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00025683100000000001 2024-09-10T05:58:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.486215+0000", 2024-09-10T05:58:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00022210400000000001 2024-09-10T05:58:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.495527+0000", 2024-09-10T05:58:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.009311616 2024-09-10T05:58:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.502751+0000", 2024-09-10T05:58:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0072244359999999999 2024-09-10T05:58:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.502818+0000", 2024-09-10T05:58:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6705000000000006e-05 2024-09-10T05:58:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.502873+0000", 2024-09-10T05:58:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4836000000000001e-05 2024-09-10T05:58:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4165 3.12 3:4928836a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:21.929130+0000", 2024-09-10T05:58:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.13630203099999999, 2024-09-10T05:58:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029035985, 2024-09-10T05:58:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4165 2024-09-10T05:58:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.929130+0000", 2024-09-10T05:58:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.929130+0000", 2024-09-10T05:58:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.929133+0000", 2024-09-10T05:58:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5200000000000002e-06 2024-09-10T05:58:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931603+0000", 2024-09-10T05:58:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024700799999999999 2024-09-10T05:58:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931631+0000", 2024-09-10T05:58:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8143000000000001e-05 2024-09-10T05:58:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931644+0000", 2024-09-10T05:58:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2459e-05 2024-09-10T05:58:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931773+0000", 2024-09-10T05:58:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128942 2024-09-10T05:58:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:58:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931778+0000", 2024-09-10T05:58:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4020000000000001e-06 2024-09-10T05:58:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.939083+0000", 2024-09-10T05:58:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073044759999999999 2024-09-10T05:58:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.939253+0000", 2024-09-10T05:58:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017063700000000001 2024-09-10T05:58:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.939353+0000", 2024-09-10T05:58:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9648999999999994e-05 2024-09-10T05:58:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.949140+0000", 2024-09-10T05:58:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097868429999999999 2024-09-10T05:58:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.958093+0000", 2024-09-10T05:58:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089535090000000001 2024-09-10T05:58:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.958135+0000", 2024-09-10T05:58:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1888999999999998e-05 2024-09-10T05:58:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.958166+0000", 2024-09-10T05:58:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0436000000000001e-05 2024-09-10T05:58:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.226 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:22.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:58:22.229 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:22.223+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:22.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:58:22.328 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:22.325+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:22.377 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:58:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4208 3.27 3:e5a4a45e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:22.368309+0000", 2024-09-10T05:58:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0082255409999999994, 2024-09-10T05:58:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.008271703, 2024-09-10T05:58:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-09-10T05:58:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4208 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.368309+0000", 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.368309+0000", 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.368312+0000", 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8370000000000001e-06 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.370658+0000", 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023457009999999999 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.370691+0000", 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3472000000000001e-05 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.370706+0000", 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4283e-05 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.370795+0000", 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.9151000000000001e-05 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.370972+0000", 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017772600000000001 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.371137+0000", 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016478099999999999 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:58:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 1 2024-09-10T05:58:22.383 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:22.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:58:22.444 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:22.441+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:22.450 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:22.450 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:22.475 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:22.498 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:22.498 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:22.525 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:22.530 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:22.523+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:22.557 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:22.597 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:22.598 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:22.598 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:22.598 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:22.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:58:22.630 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:22.623+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:22.636 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:22.637 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:22.664 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:22.665 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:22.732 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:22.727+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:22.779 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:22.780 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:22.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:58:22.844 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:22.841+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:22.932 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:22.929+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:22.939 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:22.939 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:22.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:58:23.044 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:23.041+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:23.135 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:23.131+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:23.139 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:23.139 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:23.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:58:23.252 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:23.249+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:23.337 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:23.331+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:23.349 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:23.349 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:23.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:58:23.465 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:23.461+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:23.538 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:23.533+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:23.553 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:23.554 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:23.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:58:23.641 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:23.635+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:23.741 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:23.735+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:23.754 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:23.754 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:23.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:58:23.841 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:23.837+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:23.914 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:23.914 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:23.934 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:58:23.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:58:23.976 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:23.973+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:24.043 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:24.039+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:24.082 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:24.082 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:24.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:58:24.147 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:24.143+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:24.245 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:24.241+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:24.285 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:24.286 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:24.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:58:24.351 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:24.347+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:24.445 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:24.445 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:24.447 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:24.441+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:24.463 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:58:24.555 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:24.551+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:24.649 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:24.649 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:24.649 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:24.643+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:24.667 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:58:24.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T05:58:24.751 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:24.745+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:24.852 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:24.847+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:24.856 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:24.856 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:24.862 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:24.862 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:24.877 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:58:24.879 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:24.879 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:24.899 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:24.918 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:24.918 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:24.922 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:58:24.946 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:24.964 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:24.959+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:24.971 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:24.972 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:24.995 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:24.995 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:25.016 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:25.017 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:25.053 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:25.047+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:25.069 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1811 3.28 3:1620589f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3__shadow_.0edGezhxIz6pctEpGmjAi6r4IrvG7Cu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 97.646672773999995, 2024-09-10T05:58:25.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030900642999999998, 2024-09-10T05:58:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.071 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1811 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420875+0000", 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.420878+0000", 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8399999999999997e-06 2024-09-10T05:58:25.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428843+0000", 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079647090000000004 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428886+0000", 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2661999999999999e-05 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.428905+0000", 2024-09-10T05:58:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9386999999999999e-05 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429103+0000", 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019762800000000001 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429380+0000", 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027705299999999998 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 3", 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.429597+0000", 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000216572 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.446540+0000", 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016943939000000002 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451582+0000", 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050419979999999998 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451672+0000", 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9785999999999997e-05 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.451775+0000", 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103069 2024-09-10T05:58:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2727 3.1c 3:39ad0bcc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 84.139898215000002, 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030401846999999999, 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2727 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927649+0000", 2024-09-10T05:58:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.927652+0000", 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2100000000000002e-06 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935543+0000", 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078904100000000005 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935582+0000", 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935600+0000", 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8593e-05 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.935784+0000", 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000183561 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936196+0000", 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041201600000000002 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.936622+0000", 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042600800000000002 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.955105+0000", 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018483613999999999 2024-09-10T05:58:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957770+0000", 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002664661 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.957935+0000", 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016486199999999999 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:00.958051+0000", 2024-09-10T05:58:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011613 2024-09-10T05:58:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2735 3.2a 3:56849eb1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 84.060201074000005, 2024-09-10T05:58:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027698917, 2024-09-10T05:58:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2735 2024-09-10T05:58:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007346+0000", 2024-09-10T05:58:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.007349+0000", 2024-09-10T05:58:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.847e-06 2024-09-10T05:58:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014547+0000", 2024-09-10T05:58:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071975019999999997 2024-09-10T05:58:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014598+0000", 2024-09-10T05:58:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1749000000000002e-05 2024-09-10T05:58:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014626+0000", 2024-09-10T05:58:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7409000000000001e-05 2024-09-10T05:58:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.014810+0000", 2024-09-10T05:58:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018406499999999999 2024-09-10T05:58:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015119+0000", 2024-09-10T05:58:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030915800000000002 2024-09-10T05:58:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.015492+0000", 2024-09-10T05:58:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037325200000000002 2024-09-10T05:58:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.025937+0000", 2024-09-10T05:58:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010444409 2024-09-10T05:58:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034726+0000", 2024-09-10T05:58:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087891719999999996 2024-09-10T05:58:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.034906+0000", 2024-09-10T05:58:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179908 2024-09-10T05:58:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.035045+0000", 2024-09-10T05:58:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013944599999999999 2024-09-10T05:58:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2754 3.2a 3:5744d67a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 83.871850226999996, 2024-09-10T05:58:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028477368999999999, 2024-09-10T05:58:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2754 2024-09-10T05:58:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195697+0000", 2024-09-10T05:58:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.195700+0000", 2024-09-10T05:58:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.157e-06 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200310+0000", 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046092930000000004 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200348+0000", 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8676e-05 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200376+0000", 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7285999999999999e-05 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.200577+0000", 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020089399999999999 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201009+0000", 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043280100000000002 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.201359+0000", 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034938100000000001 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.222611+0000", 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021252614 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.223963+0000", 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001351339 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224069+0000", 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010620000000000001 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224175+0000", 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105728 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3264 3.1c 3:3923a6c0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.029004372000003, 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02663254, 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3264 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038543+0000", 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.038547+0000", 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1860000000000002e-06 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044703+0000", 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061553579999999997 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044742+0000", 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9156000000000003e-05 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044760+0000", 2024-09-10T05:58:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.863e-05 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.044913+0000", 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153048 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.045181+0000", 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026741299999999998 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.046065+0000", 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088462999999999996 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.062104+0000", 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016038812999999999 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.064938+0000", 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028335249999999999 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065088+0000", 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014974500000000001 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:38.065176+0000", 2024-09-10T05:58:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8035999999999995e-05 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3417 3.37 e100/24 3:ee859745:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_6:head v 100'10, mlcod=91'8)", 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.372809885999999, 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028417909000000002, 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.694738+0000", 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2699999999999998e-07 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701552+0000", 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068132100000000001 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701602+0000", 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0482999999999998e-05 2024-09-10T05:58:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701627+0000", 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4530000000000001e-05 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701806+0000", 2024-09-10T05:58:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179192 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.701865+0000", 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9416000000000002e-05 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723088+0000", 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021222933999999999 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.723155+0000", 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7317000000000006e-05 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3469 3.28 3:15b30b29:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.942655288000001, 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026322306, 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3469 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124892+0000", 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.124896+0000", 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999997e-06 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132908+0000", 2024-09-10T05:58:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080112889999999996 2024-09-10T05:58:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132952+0000", 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4663000000000003e-05 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.132983+0000", 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0800000000000003e-05 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133152+0000", 2024-09-10T05:58:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168581 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133458+0000", 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000306192 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.133744+0000", 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028567399999999998 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.149676+0000", 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015932457000000001 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151030+0000", 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013541060000000001 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151127+0000", 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6274999999999996e-05 2024-09-10T05:58:25.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.151214+0000", 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7933e-05 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3517 3.2 3:42481240:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:25.130 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.268175487000001, 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026698706999999999, 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3517 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799372+0000", 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.799376+0000", 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1729999999999997e-06 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803201+0000", 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003825186 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803245+0000", 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4187000000000002e-05 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803263+0000", 2024-09-10T05:58:25.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7467999999999999e-05 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803403+0000", 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013966900000000001 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.803414+0000", 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1593999999999999e-05 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809545+0000", 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061312449999999996 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.809926+0000", 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038063399999999997 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.810277+0000", 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035085699999999999 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.823285+0000", 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013008426999999999 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.825994+0000", 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027082510000000001 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826036+0000", 2024-09-10T05:58:25.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2462000000000001e-05 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.826071+0000", 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4554000000000002e-05 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3822 3.2f 3:f5691873:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_401:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:25.137 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.388459284, 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029772514, 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3822 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679088+0000", 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.679092+0000", 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9910000000000004e-06 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682947+0000", 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038550630000000002 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682976+0000", 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8988000000000001e-05 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.682992+0000", 2024-09-10T05:58:25.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6209e-05 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683193+0000", 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000200185 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683489+0000", 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296717 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.683725+0000", 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023543500000000001 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.695201+0000", 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011476513000000001 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708548+0000", 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013346373 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708739+0000", 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019118499999999999 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.708861+0000", 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121855 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3842 3.2f 3:f567447c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_411:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.281374386, 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034550046000000001, 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3842 2024-09-10T05:58:25.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786173+0000", 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.786179+0000", 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8069999999999996e-06 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791316+0000", 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051367679999999999 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791355+0000", 2024-09-10T05:58:25.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9440000000000002e-05 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791373+0000", 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8352999999999999e-05 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791572+0000", 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019850799999999999 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.791832+0000", 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025995199999999998 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.792070+0000", 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023838099999999999 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.806866+0000", 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014796073999999999 2024-09-10T05:58:25.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820440+0000", 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013573528 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820604+0000", 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016399599999999999 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.820723+0000", 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119239 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3853 3.2 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.165001906000001, 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032847466999999998, 2024-09-10T05:58:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3853 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902546+0000", 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.902549+0000", 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6880000000000001e-06 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908028+0000", 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054786820000000003 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908063+0000", 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4792999999999997e-05 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908087+0000", 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4499e-05 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908218+0000", 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000130977 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908410+0000", 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019136399999999999 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:25.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908651+0000", 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024184 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927151+0000", 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018500103 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935254+0000", 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081027359999999993 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935323+0000", 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8880000000000005e-05 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.935393+0000", 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9905000000000002e-05 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.156 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3854 3.2 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.155755533000001, 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032334535999999997, 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3854 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911792+0000", 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.911796+0000", 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7799999999999998e-06 2024-09-10T05:58:25.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915942+0000", 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041458290000000002 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.915977+0000", 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5682000000000002e-05 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916000+0000", 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2364000000000001e-05 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.916619+0000", 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061924400000000002 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917000+0000", 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000381651 2024-09-10T05:58:25.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917409+0000", 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040862500000000003 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.931292+0000", 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013882495 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943964+0000", 2024-09-10T05:58:25.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012672843 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944047+0000", 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2371000000000001e-05 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.944126+0000", 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9652000000000002e-05 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.162 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3874 3.2 3:414c7108:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_443:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.955244716999999, 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028695409000000002, 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.163 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3874 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112303+0000", 2024-09-10T05:58:25.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.112306+0000", 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5530000000000001e-06 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.117951+0000", 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056447779999999996 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118011+0000", 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0179000000000001e-05 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118040+0000", 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.885e-05 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118251+0000", 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021135199999999999 2024-09-10T05:58:25.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118565+0000", 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031331399999999998 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.118877+0000", 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031258099999999998 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.137138+0000", 2024-09-10T05:58:25.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018260345000000001 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140708+0000", 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035707590000000002 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140883+0000", 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017462200000000001 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.140998+0000", 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011507599999999999 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3878 3.2a 3:5587957a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_447:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.910095775999999, 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029379293000000001, 2024-09-10T05:58:25.169 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3878 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157452+0000", 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.157455+0000", 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1999999999999999e-06 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161427+0000", 2024-09-10T05:58:25.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039726149999999997 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161465+0000", 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7883000000000003e-05 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161484+0000", 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8465999999999999e-05 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161632+0000", 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014848199999999999 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.161895+0000", 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000262835 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.162126+0000", 2024-09-10T05:58:25.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000230471 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.183957+0000", 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021831547 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186575+0000", 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002617608 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186718+0000", 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014299199999999999 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.186831+0000", 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113194 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.175 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3879 3.2a 3:5472b1a4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_448:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.903265291, 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027503584000000001, 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3879 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164282+0000", 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.164285+0000", 2024-09-10T05:58:25.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0929999999999999e-06 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171662+0000", 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073767499999999996 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171705+0000", 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2599999999999999e-05 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171731+0000", 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6812999999999999e-05 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.171914+0000", 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018210899999999999 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172318+0000", 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040407699999999997 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.172753+0000", 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043529899999999999 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.189712+0000", 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016959044 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191568+0000", 2024-09-10T05:58:25.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018557510000000001 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191692+0000", 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012407299999999999 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.191786+0000", 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3974999999999994e-05 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3888 3.1c 3:39a0303b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.808682879999999, 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032020736000000001, 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3888 2024-09-10T05:58:25.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258865+0000", 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.258869+0000", 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8899999999999998e-06 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265112+0000", 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062428429999999997 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265150+0000", 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7366000000000001e-05 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265169+0000", 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9089999999999998e-05 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265288+0000", 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119085 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265498+0000", 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020986299999999999 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.265757+0000", 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025964299999999999 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.280209+0000", 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014451311 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290711+0000", 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010502589 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290793+0000", 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1310999999999995e-05 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.290885+0000", 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2744999999999994e-05 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4090 3.16 3:6b696af3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.137721+0000", 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.929826909, 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034191160999999998, 2024-09-10T05:58:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4090 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.137721+0000", 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.137721+0000", 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.137725+0000", 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1829999999999996e-06 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147096+0000", 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093712719999999999 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147135+0000", 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8766999999999997e-05 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147154+0000", 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8899999999999999e-05 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147332+0000", 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017804799999999999 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147561+0000", 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000229545 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147786+0000", 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022438199999999999 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.169508+0000", 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021722637 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171628+0000", 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021201089999999998 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171781+0000", 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152306 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171912+0000", 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013101200000000001 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4202 3.1d 3:b81b0e59:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:22.310129+0000", 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.7574185409999998, 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.034163187999999997, 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4202 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.310129+0000", 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.310129+0000", 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.310133+0000", 2024-09-10T05:58:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9639999999999997e-06 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.315508+0000", 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053754170000000004 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.315559+0000", 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0550000000000002e-05 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.315588+0000", 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8940000000000001e-05 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.315786+0000", 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000197758 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.316179+0000", 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039351000000000002 2024-09-10T05:58:25.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.316413+0000", 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000233611 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.334396+0000", 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017983296999999999 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.344092+0000", 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0096962290000000007 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.344203+0000", 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011086600000000001 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.344292+0000", 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9046000000000001e-05 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.200 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4203 3.1d 3:b99c87ff:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:22.319256+0000", 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.748291187, 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031169545, 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.201 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4203 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.319256+0000", 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.319256+0000", 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.319262+0000", 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3630000000000002e-06 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.323160+0000", 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003898459 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.323198+0000", 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7814000000000001e-05 2024-09-10T05:58:25.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.323216+0000", 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8369999999999999e-05 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.325053+0000", 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018369149999999999 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.325461+0000", 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040807700000000002 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.325857+0000", 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000395743 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.338960+0000", 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013103205 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.350252+0000", 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011292023999999999 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.350345+0000", 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3092999999999998e-05 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.350426+0000", 2024-09-10T05:58:25.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0482000000000006e-05 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4206 3.38 3:1eb403e8:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:22.346794+0000", 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 2.720753867, 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026342154, 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4206 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.346794+0000", 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.346794+0000", 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.346798+0000", 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9940000000000002e-06 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.352552+0000", 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057545410000000002 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.352584+0000", 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1727000000000003e-05 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.352601+0000", 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6816e-05 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.352726+0000", 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012512299999999999 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.352988+0000", 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026181099999999998 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.353244+0000", 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025650500000000003 2024-09-10T05:58:25.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.369482+0000", 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016237432 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.372923+0000", 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034415919999999998 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.373014+0000", 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1123000000000002e-05 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.373136+0000", 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012149 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.213 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:25.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:58:25.215 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:25.211+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:25.315 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:25.311+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:25.390 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:25.390 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:25.390 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-10T05:58:25.390 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:25.411 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:58:25.455 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:25.451+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:25.517 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:25.513+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:25.590 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:25.591 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:25.605 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:58:25.655 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:25.651+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:25.718 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:25.711+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:25.735 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T05:58:25.735 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 175.144014927, 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027348440000000002, 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 46 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.736 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588922+0000", 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588926+0000", 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7100000000000001e-06 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588947+0000", 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1529999999999999e-05 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.588988+0000", 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0708999999999999e-05 2024-09-10T05:58:25.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589035+0000", 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7500000000000003e-05 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589239+0000", 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020347200000000001 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.589259+0000", 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0230000000000001e-05 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604241+0000", 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014981593 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.604262+0000", 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1149e-05 2024-09-10T05:58:25.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610236+0000", 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059739299999999997 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610518+0000", 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028179000000000002 2024-09-10T05:58:25.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.610813+0000", 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029552400000000003 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.614046+0000", 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032333399999999999 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616039+0000", 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0019927500000000002 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616165+0000", 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125871 2024-09-10T05:58:25.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:30.616270+0000", 2024-09-10T05:58:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105342 2024-09-10T05:58:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.744 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3000 3.26 3:66b3ccfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:25.745 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 51.630901495000003, 2024-09-10T05:58:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026540508000000001, 2024-09-10T05:58:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.746 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3000 2024-09-10T05:58:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102035+0000", 2024-09-10T05:58:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.102039+0000", 2024-09-10T05:58:25.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.213e-06 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108021+0000", 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059826480000000001 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108061+0000", 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9382999999999999e-05 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108079+0000", 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8542999999999998e-05 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108260+0000", 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018121000000000001 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.108677+0000", 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041657899999999998 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.109094+0000", 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000416807 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.127165+0000", 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018071348000000001 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128257+0000", 2024-09-10T05:58:25.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001091741 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128485+0000", 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022827700000000001 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.128576+0000", 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0759000000000003e-05 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3002 3.36 3:6ef358c6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 51.598529364999997, 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026032893000000001, 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3002 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134408+0000", 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.134413+0000", 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5639999999999996e-06 2024-09-10T05:58:25.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140435+0000", 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060217939999999996 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140485+0000", 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0089000000000001e-05 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140505+0000", 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0186999999999998e-05 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140663+0000", 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000157744 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141102+0000", 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043870399999999999 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.141512+0000", 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041073500000000002 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.153730+0000", 2024-09-10T05:58:25.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012217608 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160105+0000", 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063753949999999998 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160301+0000", 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000195551 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.160440+0000", 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139522 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3009 3.33 3:cccb44a1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 51.509863082999999, 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71394179300000005, 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3009 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223074+0000", 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.223079+0000", 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8029999999999996e-06 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227044+0000", 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003965021 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227081+0000", 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7153000000000002e-05 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227106+0000", 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5522999999999999e-05 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227283+0000", 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017625099999999999 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.227305+0000", 2024-09-10T05:58:25.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2200000000000001e-05 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.911736+0000", 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.68443125800000004 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912098+0000", 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000361527 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:25.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.912509+0000", 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041186899999999998 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.930388+0000", 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017878817000000002 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936858+0000", 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064700369999999997 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.936908+0000", 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9792e-05 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.937016+0000", 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010754199999999999 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3046 3.1e 3:7a78e3c3:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:25.769 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.461779282000002, 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023372101999999999, 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3046 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271158+0000", 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.271160+0000", 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275046+0000", 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003885707 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275067+0000", 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1642e-05 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275083+0000", 2024-09-10T05:58:25.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5477000000000001e-05 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275168+0000", 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5079000000000003e-05 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275391+0000", 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022318699999999999 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.275563+0000", 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017160499999999999 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.284169+0000", 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086058950000000006 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294378+0000", 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010209885 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294463+0000", 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4661999999999997e-05 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.294530+0000", 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6688999999999998e-05 2024-09-10T05:58:25.775 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3062 3.a 3:510cfa22:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.273641519999998, 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023825417000000002, 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.776 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3062 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459295+0000", 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.459299+0000", 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0829999999999997e-06 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464231+0000", 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049315019999999999 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464266+0000", 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4904000000000003e-05 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464282+0000", 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6172999999999999e-05 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464381+0000", 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8698999999999998e-05 2024-09-10T05:58:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464599+0000", 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218533 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.464788+0000", 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000188247 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.475654+0000", 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010866549 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.482934+0000", 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072803160000000002 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483038+0000", 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010331 2024-09-10T05:58:25.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:35.483121+0000", 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3101000000000003e-05 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3419 3.1e 3:7bbb5ef4:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:25.782 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.024224338, 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024061241000000001, 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3419 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.783 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708713+0000", 2024-09-10T05:58:25.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.708717+0000", 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999997e-06 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717539+0000", 2024-09-10T05:58:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088221600000000008 2024-09-10T05:58:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717582+0000", 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3359999999999998e-05 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717607+0000", 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4532000000000002e-05 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.717749+0000", 2024-09-10T05:58:25.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014247500000000001 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718284+0000", 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053459199999999997 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.718669+0000", 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038528400000000001 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.729703+0000", 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011033687 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732433+0000", 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027304439999999998 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732615+0000", 2024-09-10T05:58:25.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018145800000000001 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:56.732774+0000", 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159149 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3464 3.26 3:670772ec:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:25.790 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.660014145000002, 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027033292, 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3464 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:25.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072923+0000", 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.072927+0000", 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7459999999999998e-06 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077023+0000", 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040969040000000002 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077070+0000", 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6876000000000003e-05 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077102+0000", 2024-09-10T05:58:25.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1766e-05 2024-09-10T05:58:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077220+0000", 2024-09-10T05:58:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011787599999999999 2024-09-10T05:58:25.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077448+0000", 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228175 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.077666+0000", 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000218216 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099266+0000", 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021599679 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099650+0000", 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000384096 2024-09-10T05:58:25.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099819+0000", 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000168746 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.099956+0000", 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000137212 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3853 3.2 e103/90 3:432d387a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_422:head v 103'11, mlcod=103'9)", 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.824106841999999, 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026052486999999999, 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:25.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908830+0000", 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.908833+0000", 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3050000000000001e-06 2024-09-10T05:58:25.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912185+0000", 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00335177 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912243+0000", 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7635e-05 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.912271+0000", 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7974e-05 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913259+0000", 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098803699999999999 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.913318+0000", 2024-09-10T05:58:25.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9422000000000001e-05 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934525+0000", 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021206610000000001 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.934883+0000", 2024-09-10T05:58:25.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035773400000000001 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3854 3.2 e103/90 3:43fe513c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_423:head v 103'12, mlcod=103'9)", 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.815287772000001, 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025998609999999998, 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.803 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917649+0000", 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.917653+0000", 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4000000000000001e-06 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922882+0000", 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052294120000000001 2024-09-10T05:58:25.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922916+0000", 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4425999999999999e-05 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.922939+0000", 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3050000000000001e-05 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923078+0000", 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013832800000000001 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923128+0000", 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0127000000000003e-05 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943488+0000", 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020360165999999999 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.943648+0000", 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015970099999999999 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3883 3.26 3:6770c43b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_452:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.526450000000001, 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024529107000000001, 2024-09-10T05:58:25.808 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3883 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206487+0000", 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.206504+0000", 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6835999999999999e-05 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210252+0000", 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037487179999999998 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210283+0000", 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0341999999999999e-05 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210299+0000", 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6663e-05 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210406+0000", 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106648 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210618+0000", 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021149600000000001 2024-09-10T05:58:25.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.210809+0000", 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000191418 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.229667+0000", 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018857604 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230689+0000", 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010224920000000001 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.230877+0000", 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018767799999999999 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.231016+0000", 2024-09-10T05:58:25.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013921199999999999 2024-09-10T05:58:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3886 3.34 e103/24 3:2fde1462:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_455:head v 103'21, mlcod=103'19)", 2024-09-10T05:58:25.815 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.487509395, 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029486221999999999, 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245428+0000", 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.245431+0000", 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7529999999999999e-06 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249357+0000", 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039260179999999999 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249399+0000", 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1536999999999999e-05 2024-09-10T05:58:25.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249419+0000", 2024-09-10T05:58:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9813000000000002e-05 2024-09-10T05:58:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249577+0000", 2024-09-10T05:58:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158021 2024-09-10T05:58:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.249722+0000", 2024-09-10T05:58:25.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014495900000000001 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274800+0000", 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025077941999999999 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.274914+0000", 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011417900000000001 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3887 3.36 3:6c9dd547:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_456:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.484766006000001, 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031800800999999997, 2024-09-10T05:58:25.822 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3887 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248171+0000", 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.248176+0000", 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6920000000000001e-06 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252399+0000", 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042231289999999999 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252445+0000", 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6678999999999998e-05 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252475+0000", 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9957000000000001e-05 2024-09-10T05:58:25.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252597+0000", 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012193699999999999 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.252960+0000", 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036250600000000002 2024-09-10T05:58:25.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.253367+0000", 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040692000000000001 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279695+0000", 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026328706 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279755+0000", 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9942999999999999e-05 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279861+0000", 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105116 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.279972+0000", 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111216 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3890 3.35 3:acfee5d7:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_459:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.455526309, 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027993634999999999, 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.830 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3890 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277411+0000", 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.277414+0000", 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3830000000000001e-06 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283323+0000", 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059094550000000001 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283358+0000", 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4260000000000001e-05 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283376+0000", 2024-09-10T05:58:25.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7957000000000001e-05 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283518+0000", 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000141884 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.283786+0000", 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026811800000000002 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.284076+0000", 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029020000000000001 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.296068+0000", 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011992523 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305096+0000", 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090274710000000005 2024-09-10T05:58:25.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305275+0000", 2024-09-10T05:58:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178982 2024-09-10T05:58:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.305404+0000", 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012940200000000001 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4119 3.20 3:05fbdfa0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.514659+0000", 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.218277821, 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023691383999999999, 2024-09-10T05:58:25.837 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4119 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.514659+0000", 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.514659+0000", 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.514663+0000", 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0430000000000001e-06 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.520118+0000", 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054545499999999998 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.520164+0000", 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6306e-05 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.520185+0000", 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.105e-05 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.520362+0000", 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017723200000000001 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.520627+0000", 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026455499999999998 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.520863+0000", 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000236581 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.536773+0000", 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015909402999999999 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.538135+0000", 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001362076 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.538231+0000", 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6478999999999996e-05 2024-09-10T05:58:25.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.538350+0000", 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119109 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4124 3.35 3:ad373bfe:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.572149+0000", 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.1607875889999999, 2024-09-10T05:58:25.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027772795999999999, 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4124 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.572149+0000", 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.572149+0000", 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.572181+0000", 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1819999999999997e-05 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.576887+0000", 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047057720000000004 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.576926+0000", 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8702999999999999e-05 2024-09-10T05:58:25.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.576953+0000", 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6917e-05 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.577104+0000", 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015141500000000001 2024-09-10T05:58:25.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.577429+0000", 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032467100000000001 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.577667+0000", 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023884399999999999 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.588928+0000", 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011260907000000001 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.599623+0000", 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010694909000000001 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.599797+0000", 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000173559 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.599922+0000", 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000125279 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4139 3.2c 3:36da21f0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.759217+0000", 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.9737202279999999, 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024781940999999998, 2024-09-10T05:58:25.851 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4139 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.759217+0000", 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.759217+0000", 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.759220+0000", 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0170000000000001e-06 2024-09-10T05:58:25.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.764066+0000", 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004846075 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.764103+0000", 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6968999999999998e-05 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.764121+0000", 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8732999999999998e-05 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.764324+0000", 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020273599999999999 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.764901+0000", 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000576412 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.765415+0000", 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00051472900000000001 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.781007+0000", 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015591288999999999 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.783641+0000", 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026339419999999998 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.783825+0000", 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184835 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.783999+0000", 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017320399999999999 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4164 3.2c 3:345fcc3d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.917184+0000", 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8157533900000002, 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031517322, 2024-09-10T05:58:25.858 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4164 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.917184+0000", 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.917184+0000", 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.917188+0000", 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3800000000000004e-06 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.921428+0000", 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042400320000000003 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.921488+0000", 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9963999999999997e-05 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.921517+0000", 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9436000000000001e-05 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.921841+0000", 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032410700000000002 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.921860+0000", 2024-09-10T05:58:25.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8819999999999999e-05 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.928593+0000", 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067328400000000004 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.928942+0000", 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034856699999999998 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:25.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.929293+0000", 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035149399999999999 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.940744+0000", 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01145038 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.948394+0000", 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076500639999999998 2024-09-10T05:58:25.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.948575+0000", 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018181600000000001 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.948701+0000", 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012542200000000001 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4210 3.36 3:6cff9ab2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:22.391196+0000", 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3417409170000001, 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024470905000000001, 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4210 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.866 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.391196+0000", 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.391196+0000", 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.391199+0000", 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6110000000000001e-06 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.395841+0000", 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046420039999999999 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.395874+0000", 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3210999999999998e-05 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.395891+0000", 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7025999999999999e-05 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.396080+0000", 2024-09-10T05:58:25.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018926899999999999 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.396502+0000", 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042156000000000002 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.396904+0000", 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040253400000000002 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.411172+0000", 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014268212000000001 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.415340+0000", 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004167937 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.415525+0000", 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018454800000000001 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.415667+0000", 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014199300000000001 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4223 3.20 3:061a2034:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:25.872 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:22.523535+0000", 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.2094014479999999, 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024558861000000001, 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4223 2024-09-10T05:58:25.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.874 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:25.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:25.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.523535+0000", 2024-09-10T05:58:25.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:25.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.523535+0000", 2024-09-10T05:58:25.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:25.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:25.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.523540+0000", 2024-09-10T05:58:25.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0729999999999998e-06 2024-09-10T05:58:25.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:25.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.529646+0000", 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061062010000000003 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.529686+0000", 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0643999999999999e-05 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.529707+0000", 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0676e-05 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.529855+0000", 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000147882 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.530129+0000", 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027439100000000002 2024-09-10T05:58:25.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.530375+0000", 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024578099999999998 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.545833+0000", 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015457901 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.547864+0000", 2024-09-10T05:58:25.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020313129999999999 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.547973+0000", 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010832600000000001 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.548094+0000", 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121673 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.881 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:25.881 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:25.881 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:25.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:58:25.883 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:25.875+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:25.983 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:25.979+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:26.059 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:26.059 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:26.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.060 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4521 3.7 3:e23bfe13:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_427:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-10T05:58:26.060 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:26.045872+0000", 2024-09-10T05:58:26.060 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.012650857999999999, 2024-09-10T05:58:26.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012701987, 2024-09-10T05:58:26.060 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.060 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-09-10T05:58:26.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.061 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.061 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4521 2024-09-10T05:58:26.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.062 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.045872+0000", 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.045872+0000", 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.045875+0000", 2024-09-10T05:58:26.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1099999999999999e-06 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.049660+0000", 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037845740000000002 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.049686+0000", 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5993999999999999e-05 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.049698+0000", 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2269999999999999e-05 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.049787+0000", 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8714999999999993e-05 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.049977+0000", 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018996099999999999 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.050149+0000", 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017203699999999999 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:26.056639+0000", 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064900690000000002 2024-09-10T05:58:26.066 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.067 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.067 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-10T05:58:26.067 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 1 2024-09-10T05:58:26.067 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:26.076 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:58:26.084 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:26.081+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:26.185 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:26.181+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:26.251 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:26.251 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-10T05:58:26.251 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-10T05:58:26.251 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-10T05:58:26.251 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:26.268 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:58:26.315 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:26.311+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:26.387 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:26.383+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:26.406 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 199.41921921700001, 2024-09-10T05:58:26.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8190466029999999, 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4207", 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.98:0/2529452739", 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982789+0000", 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982792+0000", 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.683e-06 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982805+0000", 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2969000000000001e-05 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982827+0000", 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2493999999999998e-05 2024-09-10T05:58:26.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.982851+0000", 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3751e-05 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983007+0000", 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015568099999999999 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-10T05:58:26.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.983017+0000", 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0488e-05 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985869+0000", 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028515179999999999 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:06.985884+0000", 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5464999999999998e-05 2024-09-10T05:58:26.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799117+0000", 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8132329039999999 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799533+0000", 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041563100000000002 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:26.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.799822+0000", 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028902499999999999 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.800945+0000", 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001122956 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801673+0000", 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072873499999999999 2024-09-10T05:58:26.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801774+0000", 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100337 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:55:08.801836+0000", 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1965999999999996e-05 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1667 3.3f 3:ff9f4566:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.2__shadow_.kKL6g7dBt1MtZCyntweqTv3IMQzzhyR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.844063051999996, 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028278181999999999, 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.416 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1667 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:26.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557945+0000", 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.557948+0000", 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6699999999999998e-06 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563668+0000", 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057202190000000003 2024-09-10T05:58:26.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563709+0000", 2024-09-10T05:58:26.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0593000000000003e-05 2024-09-10T05:58:26.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563728+0000", 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8896999999999999e-05 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.563897+0000", 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016951800000000001 2024-09-10T05:58:26.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564284+0000", 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038661499999999998 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.564657+0000", 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037327900000000002 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585115+0000", 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020457880000000001 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.585896+0000", 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078076800000000004 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586079+0000", 2024-09-10T05:58:26.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018296799999999999 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:46.586224+0000", 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014477500000000001 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:1816 3.f 3:f1a46054:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 98.947450794000005, 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02823732, 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 1816 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454558+0000", 2024-09-10T05:58:26.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.454560+0000", 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.864e-06 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459841+0000", 2024-09-10T05:58:26.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052803920000000001 2024-09-10T05:58:26.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459877+0000", 2024-09-10T05:58:26.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.459894+0000", 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822999999999999e-05 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460071+0000", 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017665500000000001 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.460329+0000", 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000258204 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.461186+0000", 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085720100000000003 2024-09-10T05:58:26.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.476935+0000", 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015748761999999999 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482565+0000", 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056299159999999996 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482676+0000", 2024-09-10T05:58:26.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011084199999999999 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:56:47.482795+0000", 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000118958 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:2755 3.11 3:8bfa9207:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:26.434 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.197263309999997, 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029780096999999998, 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2755 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204745+0000", 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.204750+0000", 2024-09-10T05:58:26.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2569999999999998e-06 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210782+0000", 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060315359999999997 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210827+0000", 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4864999999999998e-05 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.210854+0000", 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7236000000000001e-05 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211058+0000", 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000203811 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211504+0000", 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044570699999999999 2024-09-10T05:58:26.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.211803+0000", 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029950499999999999 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.224465+0000", 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012662193 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234255+0000", 2024-09-10T05:58:26.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097902030000000008 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234405+0000", 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000149498 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:01.234525+0000", 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012028600000000001 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3001 3.13 3:c96de66e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.278660680999998, 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033587631, 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3001 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123348+0000", 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.123352+0000", 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.98e-06 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130553+0000", 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072012509999999997 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130587+0000", 2024-09-10T05:58:26.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4353000000000001e-05 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130604+0000", 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.683e-05 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130729+0000", 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012522400000000001 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.130969+0000", 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023993699999999999 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.131198+0000", 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228934 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.140763+0000", 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095652370000000007 2024-09-10T05:58:26.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156656+0000", 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015892292999999998 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156816+0000", 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016013099999999999 2024-09-10T05:58:26.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.156935+0000", 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119461 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3010 3.7 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.167868056000003, 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.71061391500000004, 2024-09-10T05:58:26.447 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3010 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234140+0000", 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.234152+0000", 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1463e-05 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238146+0000", 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039945559999999998 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238187+0000", 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0930000000000003e-05 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238206+0000", 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8379000000000001e-05 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238363+0000", 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015778499999999999 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.238381+0000", 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7836999999999999e-05 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915494+0000", 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.67711229299999998 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.915792+0000", 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029809599999999997 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.916087+0000", 2024-09-10T05:58:26.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029488000000000002 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.942809+0000", 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026722612999999999 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944396+0000", 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015870750000000001 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944490+0000", 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3985000000000002e-05 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:34.944754+0000", 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000264023 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3458 3.d 3:b0baf69f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:26.454 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.389083613, 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029316732000000002, 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3458 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012925+0000", 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.012928+0000", 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3699999999999999e-06 2024-09-10T05:58:26.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019654+0000", 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067255250000000004 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019684+0000", 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0673999999999998e-05 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019705+0000", 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0196000000000001e-05 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.019854+0000", 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014964199999999999 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020099+0000", 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024499199999999997 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020326+0000", 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022693799999999999 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.039686+0000", 2024-09-10T05:58:26.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019360049000000001 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.041971+0000", 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022845980000000001 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042121+0000", 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015037899999999999 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.042242+0000", 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000120369 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3459 3.7 3:e377e840:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.381315642000001, 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.035558590000000001, 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3459 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020693+0000", 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.020695+0000", 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7159999999999999e-06 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025414+0000", 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004718112 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025455+0000", 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1343e-05 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025478+0000", 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3385999999999999e-05 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.025669+0000", 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019060600000000001 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026052+0000", 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038261000000000002 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 0", 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.026463+0000", 2024-09-10T05:58:26.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000411016 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.049026+0000", 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022563436999999999 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056038+0000", 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070124879999999999 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056178+0000", 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139462 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:57.056251+0000", 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3413999999999999e-05 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3557 3.11 3:882beea5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.927423989000001, 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.031410517999999998, 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.468 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3557 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474584+0000", 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.474588+0000", 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9829999999999998e-06 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480942+0000", 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006353605 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.480984+0000", 2024-09-10T05:58:26.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2092999999999998e-05 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481009+0000", 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5323000000000001e-05 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481184+0000", 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017464600000000001 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481422+0000", 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023791799999999999 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.481649+0000", 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000227111 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.502907+0000", 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021257547000000002 2024-09-10T05:58:26.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505706+0000", 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027996380000000001 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505859+0000", 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015259799999999999 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:57:58.505995+0000", 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013605600000000001 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3805 3.f 3:f30594f6:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.888206847999999, 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.032364751999999997, 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.474 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3805 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513802+0000", 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.513804+0000", 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7659999999999999e-06 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518449+0000", 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046447620000000002 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518479+0000", 2024-09-10T05:58:26.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9583000000000001e-05 2024-09-10T05:58:26.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518499+0000", 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0707999999999999e-05 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518612+0000", 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011232599999999999 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.518918+0000", 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030618099999999999 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.519295+0000", 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00037720100000000002 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545713+0000", 2024-09-10T05:58:26.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026418322000000001 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.545851+0000", 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013759899999999999 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546022+0000", 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017056800000000001 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.546166+0000", 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014473599999999999 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3850 3.3f 3:fda66161:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.530353400999999, 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028103604000000001, 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3850 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:26.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871655+0000", 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.871659+0000", 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.783e-06 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875788+0000", 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041287629999999997 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875838+0000", 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0120000000000001e-05 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.875864+0000", 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6285e-05 2024-09-10T05:58:26.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876003+0000", 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013910499999999999 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876243+0000", 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023953200000000001 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:26.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.876443+0000", 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020025899999999999 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899442+0000", 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022998779 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899506+0000", 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4497000000000003e-05 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899661+0000", 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155227 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.899759+0000", 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7254000000000001e-05 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.489 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3855 3.11 3:892729bc:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_424:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.478143327000002, 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028027435, 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.490 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3855 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923865+0000", 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.923868+0000", 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1379999999999999e-06 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927312+0000", 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034438659999999999 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927346+0000", 2024-09-10T05:58:26.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3569999999999999e-05 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927364+0000", 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8749999999999998e-05 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927537+0000", 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017227599999999999 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.927890+0000", 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00035353499999999998 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.928239+0000", 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000348434 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.947716+0000", 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019477305 2024-09-10T05:58:26.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951690+0000", 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039739709999999998 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951800+0000", 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011006900000000001 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:01.951893+0000", 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2521000000000004e-05 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3880 3.37 3:ec881012:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_449:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.228293122, 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029579850000000001, 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3880 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173715+0000", 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.173719+0000", 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4599999999999999e-06 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178656+0000", 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049375230000000001 2024-09-10T05:58:26.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178700+0000", 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.409e-05 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178726+0000", 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5503e-05 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.178895+0000", 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000169572 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179154+0000", 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025896399999999998 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.179410+0000", 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025568800000000001 2024-09-10T05:58:26.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.202784+0000", 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023373701 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203018+0000", 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000234064 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203148+0000", 2024-09-10T05:58:26.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013007900000000001 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.203295+0000", 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014720600000000001 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:3894 3.e 3:72a2f092:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:26.502 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.080095544999999, 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027366047000000001, 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3894 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321913+0000", 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.321917+0000", 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2189999999999998e-06 2024-09-10T05:58:26.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325869+0000", 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039515990000000001 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325900+0000", 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1745000000000002e-05 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.325916+0000", 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5934999999999999e-05 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326020+0000", 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000103359 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326241+0000", 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022122999999999999 2024-09-10T05:58:26.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.326541+0000", 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000299678 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.342668+0000", 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016127266000000001 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349093+0000", 2024-09-10T05:58:26.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064252349999999996 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349194+0000", 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100462 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.349279+0000", 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5319000000000001e-05 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.508 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:3910 3.14 e103/24 3:2904c331:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_479:head v 103'17, mlcod=103'15)", 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 23.849154457000001, 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027277861, 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552854+0000", 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.552855+0000", 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2929999999999999e-06 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555222+0000", 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023664390000000001 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555263+0000", 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1152000000000002e-05 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555277+0000", 2024-09-10T05:58:26.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4092e-05 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555414+0000", 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013695299999999999 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.555459+0000", 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5272999999999998e-05 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580075+0000", 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024615818000000001 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:02.580132+0000", 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6841e-05 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4091 3.13 3:c9e8f991:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.147562+0000", 2024-09-10T05:58:26.513 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2544460080000004, 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.049041548999999997, 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4091 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147562+0000", 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147562+0000", 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.147565+0000", 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4770000000000002e-06 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155639+0000", 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080740080000000006 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155685+0000", 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6242999999999998e-05 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155712+0000", 2024-09-10T05:58:26.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6735999999999999e-05 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.155851+0000", 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000138899 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.156097+0000", 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024613499999999997 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.156310+0000", 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021261899999999999 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.183527+0000", 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027217228999999999 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196355+0000", 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012828694999999999 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196491+0000", 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013567900000000001 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196604+0000", 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112829 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.519 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4092 3.15 3:a96a4c3b:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.158187+0000", 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2438216100000004, 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.041152655000000003, 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.520 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4092 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.158187+0000", 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.158187+0000", 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.158190+0000", 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7000000000000002e-06 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164392+0000", 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006201855 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164440+0000", 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7512999999999997e-05 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164466+0000", 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6035999999999999e-05 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164627+0000", 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016090200000000001 2024-09-10T05:58:26.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.164882+0000", 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025479799999999998 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.165202+0000", 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00032079400000000001 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.195633+0000", 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030430266000000001 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.199289+0000", 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036563089999999999 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.199319+0000", 2024-09-10T05:58:26.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0397999999999999e-05 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.199339+0000", 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0083999999999999e-05 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4093 3.3f 3:fcef226c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:21.167178+0000", 2024-09-10T05:58:26.526 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2348304810000004, 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029620480000000001, 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4093 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.167178+0000", 2024-09-10T05:58:26.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.167178+0000", 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.167182+0000", 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.687e-06 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171291+0000", 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041096400000000003 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171328+0000", 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6470000000000001e-05 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171355+0000", 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7682999999999999e-05 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171470+0000", 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011492799999999999 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.171736+0000", 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026610499999999999 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 6", 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.172117+0000", 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038067400000000001 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.193884+0000", 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.02176641 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196733+0000", 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028498260000000002 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196772+0000", 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8631000000000003e-05 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:21.196798+0000", 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6426000000000001e-05 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4542.0:4183 3.14 e110/24 3:2a13294c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_89:head v 110'19, mlcod=103'17)", 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:22.123285+0000", 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.278723297, 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030508598000000001, 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.123285+0000", 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.123285+0000", 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.123288+0000", 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.23e-06 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127117+0000", 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038283169999999999 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127154+0000", 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7592999999999997e-05 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127172+0000", 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7819e-05 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127330+0000", 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158202 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127392+0000", 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1792999999999996e-05 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.153620+0000", 2024-09-10T05:58:26.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.026228358 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.153794+0000", 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017328600000000001 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4542.0:4184 3.f 3:f1fa16da:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-10T05:58:22.127741+0000", 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2742673849999999, 2024-09-10T05:58:26.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.029405587, 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4542", 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 4184 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127741+0000", 2024-09-10T05:58:26.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127741+0000", 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.127744+0000", 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9629999999999998e-06 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-10T05:58:26.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.131664+0000", 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039200850000000002 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.131707+0000", 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2920000000000002e-05 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.131726+0000", 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9412999999999999e-05 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.131874+0000", 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014753600000000001 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.132131+0000", 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025729799999999999 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.132375+0000", 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024423799999999997 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.156056+0000", 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023680804999999999 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.156889+0000", 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083227500000000005 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.157017+0000", 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012826499999999999 2024-09-10T05:58:26.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-10T05:58:22.157147+0000", 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129789 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-10T05:58:26.543 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-10T05:58:26.545 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:26.539+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:26.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T05:58:26.645 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:26.641+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:4563 3.3a e111/24 3:5e0d47d5:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_469:head v 111'26, mlcod=110'24)", 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:26.700694+0000", 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.014583349000000001, 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014625572, 2024-09-10T05:58:26.715 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "started", 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.700694+0000", 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.700694+0000", 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:26.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.700696+0000", 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0020000000000001e-06 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706072+0000", 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0053760630000000004 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706112+0000", 2024-09-10T05:58:26.717 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9656000000000001e-05 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706133+0000", 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1617999999999999e-05 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706253+0000", 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000119782 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:26.718 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706315+0000", 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2082999999999995e-05 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4564 3.6 3:607de02e:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_470:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:26.706262+0000", 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0090152559999999993, 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0091972689999999992, 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "waiting for sub ops", 2024-09-10T05:58:26.719 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4564 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706262+0000", 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:26.720 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706262+0000", 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.706265+0000", 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6630000000000002e-06 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.707821+0000", 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001556394 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.721 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.707843+0000", 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1787e-05 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.707863+0000", 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0012000000000001e-05 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.707966+0000", 2024-09-10T05:58:26.722 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000103354 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.708137+0000", 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000170867 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.708327+0000", 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000189865 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:26.723 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-10T05:58:26.724 INFO:teuthology.orchestra.run.smithi070.stdout: "num_ops": 2 2024-09-10T05:58:26.724 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:26.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T05:58:26.776 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-09-10T05:58:26.773+0000 7f0b16fe9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-10T05:58:26.846 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:26.839+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:26.921 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:26.921 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [], 2024-09-10T05:58:26.921 INFO:teuthology.orchestra.run.smithi070.stdout: "complaint_time": 30, 2024-09-10T05:58:26.921 INFO:teuthology.orchestra.run.smithi070.stdout: "num_blocked_ops": 0 2024-09-10T05:58:26.921 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:26.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T05:58:26.947 INFO:tasks.ceph.osd.4.smithi098.stderr:2024-09-10T05:58:26.943+0000 7f8872c9f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26476) UID: 0 2024-09-10T05:58:26.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:58:27.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T05:58:27.077 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:58:27.077 INFO:teuthology.orchestra.run.smithi070.stdout: "size": 20, 2024-09-10T05:58:27.077 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 600, 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "ops": [ 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2719 3.1b 3:d84b06bf:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.232062278000001, 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022193477999999999, 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.078 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2719 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.079 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843248+0000", 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.843261+0000", 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2991e-05 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845227+0000", 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019659450000000002 2024-09-10T05:58:27.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845250+0000", 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3315999999999998e-05 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845260+0000", 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7929999999999992e-06 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.081 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845322+0000", 2024-09-10T05:58:27.082 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2347999999999993e-05 2024-09-10T05:58:27.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.082 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.082 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.082 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845470+0000", 2024-09-10T05:58:27.083 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014796500000000001 2024-09-10T05:58:27.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.845620+0000", 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015014 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.850432+0000", 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048114359999999997 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.084 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865310+0000", 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014877656 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865381+0000", 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.1829000000000006e-05 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.865441+0000", 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0059000000000002e-05 2024-09-10T05:58:27.085 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:2734 3.12 3:49071527:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.9__shadow_.juZoOCqriqdOotTD4FbHducXmmqZ0tm_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 86.079892580999996, 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021131595, 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.086 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 2734 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995418+0000", 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.995420+0000", 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.294e-06 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997268+0000", 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001848059 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997289+0000", 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.1262000000000001e-05 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997302+0000", 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2903e-05 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.089 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997382+0000", 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9560000000000004e-05 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997547+0000", 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016513199999999999 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:00.997723+0000", 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000176028 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.090 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.005059+0000", 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073357129999999998 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016423+0000", 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011363922 2024-09-10T05:58:27.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016496+0000", 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.3631e-05 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:01.016549+0000", 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.3090999999999997e-05 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3006 3.b 3:d167e876:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.886939802999997, 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.73997048700000001, 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3006 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188370+0000", 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.188374+0000", 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.4970000000000001e-06 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190071+0000", 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00169713 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.095 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190105+0000", 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.3581000000000003e-05 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190122+0000", 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7016000000000001e-05 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190223+0000", 2024-09-10T05:58:27.096 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00010094000000000001 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for peered", 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.190238+0000", 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5583e-05 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908275+0000", 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.71803706099999998 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.097 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908586+0000", 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00031096200000000002 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.908871+0000", 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028523900000000001 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.915859+0000", 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0069872830000000004 2024-09-10T05:58:27.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928177+0000", 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.012318513999999999 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928243+0000", 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.5297999999999997e-05 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.099 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.928341+0000", 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8382999999999996e-05 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:3010 3.7 e91/90 3:e276c825:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_14:head v 91'3, mlcod=0'0)", 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.158512504999997, 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023300923000000001, 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.101 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.916798+0000", 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8599999999999998e-07 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931447+0000", 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.014648899999999999 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931467+0000", 2024-09-10T05:58:27.102 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0061999999999999e-05 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931479+0000", 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1467e-05 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931547+0000", 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.8113000000000003e-05 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.103 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.931578+0000", 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0669000000000001e-05 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.936627+0000", 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050490830000000002 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.940099+0000", 2024-09-10T05:58:27.104 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034719429999999999 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3021 3.b 3:d0b3e067:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 52.098758486000001, 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029193581, 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3021 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.106 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976552+0000", 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.976554+0000", 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.3640000000000002e-06 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978476+0000", 2024-09-10T05:58:27.107 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019221830000000001 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978493+0000", 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6331e-05 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978503+0000", 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.0774000000000001e-05 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.108 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978582+0000", 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8651000000000003e-05 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.978858+0000", 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000276455 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.109 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.979018+0000", 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015947800000000001 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:34.984809+0000", 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057911280000000004 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.110 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005635+0000", 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.020826181999999999 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005679+0000", 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3417999999999997e-05 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.005745+0000", 2024-09-10T05:58:27.111 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6617000000000003e-05 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3035 3.b 3:d1267ce1:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.930424158000001, 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021701069, 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3035 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.113 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144886+0000", 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.144889+0000", 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6460000000000002e-06 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146859+0000", 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0019707790000000002 2024-09-10T05:58:27.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146897+0000", 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7713000000000003e-05 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.146914+0000", 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6558999999999998e-05 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.115 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147007+0000", 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.3190999999999996e-05 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147200+0000", 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000193084 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.147389+0000", 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000188543 2024-09-10T05:58:27.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.153536+0000", 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0061479179999999996 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166419+0000", 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.01288215 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.117 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166489+0000", 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0321000000000007e-05 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.166587+0000", 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.8165000000000006e-05 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3041 3.b 3:d26ad16f:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.10__shadow_.JEigrTm5HnPJlymyWvAgA3HCXE1748Q_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-10T05:58:27.118 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 51.864734572000003, 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030467424999999999, 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3041 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.119 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210576+0000", 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.210578+0000", 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.6240000000000002e-06 2024-09-10T05:58:27.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212335+0000", 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00175713 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212364+0000", 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8208000000000002e-05 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.121 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212378+0000", 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4255e-05 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212469+0000", 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.1051000000000006e-05 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212656+0000", 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018742699999999999 2024-09-10T05:58:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.212834+0000", 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000177298 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.219661+0000", 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068273070000000003 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.123 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240871+0000", 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021210184 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.240938+0000", 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6637999999999995e-05 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:35.241043+0000", 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000105303 2024-09-10T05:58:27.124 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3412 3.12 3:4a855f62:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.631704+0000", 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.4436061, 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.032427966000000003, 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.125 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3412 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.631704+0000", 2024-09-10T05:58:27.126 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.631704+0000", 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.631707+0000", 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.5289999999999998e-06 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.127 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633626+0000", 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001919502 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633644+0000", 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7435000000000002e-05 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633653+0000", 2024-09-10T05:58:27.128 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.6350000000000001e-06 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633718+0000", 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4621000000000004e-05 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.633884+0000", 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00016593200000000001 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.129 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.634040+0000", 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015649699999999999 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.640916+0000", 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0068753959999999998 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.664018+0000", 2024-09-10T05:58:27.130 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023102755999999999 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.664081+0000", 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.2583999999999996e-05 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.664132+0000", 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.1078999999999997e-05 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.131 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3416 3.1 3:808843e2:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.679338+0000", 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.395972611000001, 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030652705999999998, 2024-09-10T05:58:27.132 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3416 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.679338+0000", 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.679338+0000", 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.679341+0000", 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.241e-06 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.134 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.680965+0000", 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001624636 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.680998+0000", 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2592000000000002e-05 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681013+0000", 2024-09-10T05:58:27.135 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.5375000000000001e-05 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681099+0000", 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.5245000000000001e-05 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681228+0000", 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012934900000000001 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.136 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.681365+0000", 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013661899999999999 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.686245+0000", 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0048806559999999997 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.709846+0000", 2024-09-10T05:58:27.137 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023600493 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.709926+0000", 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9849000000000001e-05 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.709990+0000", 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.4651000000000002e-05 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.138 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3447 3.2b 3:d5c1d222:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:57:56.894548+0000", 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 30.180762317999999, 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.021425774000000002, 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.139 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3447 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.894548+0000", 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.894548+0000", 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.894552+0000", 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.9110000000000003e-06 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896394+0000", 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001842315 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.141 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896424+0000", 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9550999999999999e-05 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896438+0000", 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.4052e-05 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896518+0000", 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9942000000000001e-05 2024-09-10T05:58:27.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896658+0000", 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014000800000000001 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.896790+0000", 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00013240999999999999 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.143 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.901373+0000", 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0045825689999999999 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.915875+0000", 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0145027 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.915924+0000", 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8223000000000002e-05 2024-09-10T05:58:27.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:57:56.915974+0000", 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0093000000000003e-05 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3863 3.1b 3:dbe80a96:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_432:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:02.000761+0000", 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 25.074548813, 2024-09-10T05:58:27.145 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024381217, 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3863 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.000761+0000", 2024-09-10T05:58:27.146 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.000761+0000", 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.000765+0000", 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1039999999999998e-06 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.147 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002479+0000", 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0017143900000000001 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002498+0000", 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.8967999999999999e-05 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002509+0000", 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.1304000000000001e-05 2024-09-10T05:58:27.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002586+0000", 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7082999999999994e-05 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002762+0000", 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017532299999999999 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.149 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.002916+0000", 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015426799999999999 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.007982+0000", 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050661719999999999 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.025015+0000", 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017033258999999999 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.150 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.025085+0000", 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.0201000000000001e-05 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.025143+0000", 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7145000000000003e-05 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.151 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:3882 3.12 3:485fadb0:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.11__shadow_.AoRah2Q1oL3IXDRtKYazZt2_ecrfklU_451:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:02.194280+0000", 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 24.881029753, 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.023010781000000001, 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 3882 2024-09-10T05:58:27.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.194280+0000", 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.194280+0000", 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.153 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.194283+0000", 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9270000000000001e-06 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196142+0000", 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001858544 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196166+0000", 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4402000000000001e-05 2024-09-10T05:58:27.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196176+0000", 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9199999999999999e-06 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196253+0000", 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6304000000000007e-05 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.155 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196452+0000", 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000198965 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.196611+0000", 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015898099999999999 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.207344+0000", 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010733253 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.217152+0000", 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0098077489999999993 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.217231+0000", 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.9503000000000001e-05 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:02.217291+0000", 2024-09-10T05:58:27.157 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.0232999999999997e-05 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4165 3.12 3:4928836a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:21.929130+0000", 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 5.1461806860000001, 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.029035985, 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.158 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4165 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.929130+0000", 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.159 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.929130+0000", 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.929133+0000", 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.5200000000000002e-06 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931603+0000", 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0024700799999999999 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.160 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931631+0000", 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.8143000000000001e-05 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931644+0000", 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.2459e-05 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931773+0000", 2024-09-10T05:58:27.161 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000128942 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op must wait for map", 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.931778+0000", 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.4020000000000001e-06 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.939083+0000", 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0073044759999999999 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.162 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.939253+0000", 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017063700000000001 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 7", 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.939353+0000", 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.9648999999999994e-05 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.949140+0000", 2024-09-10T05:58:27.163 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0097868429999999999 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.958093+0000", 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0089535090000000001 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.958135+0000", 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.1888999999999998e-05 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.164 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:21.958166+0000", 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0436000000000001e-05 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4201 3.1 3:800b5d27:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_107:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110)", 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:22.298124+0000", 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 4.7771857620000002, 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024362788, 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4201 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.298124+0000", 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.166 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.298124+0000", 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.298128+0000", 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.534e-06 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.299745+0000", 2024-09-10T05:58:27.167 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.001617493 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.299778+0000", 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.2075e-05 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.299794+0000", 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6361000000000001e-05 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.168 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.299871+0000", 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7319999999999998e-05 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.299993+0000", 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012152 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.300090+0000", 2024-09-10T05:58:27.169 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7263999999999996e-05 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.305606+0000", 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0055163319999999997 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.322370+0000", 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016763469 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.170 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.322437+0000", 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 6.6686000000000005e-05 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:22.322487+0000", 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0733999999999999e-05 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.171 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4479 3.b 3:d06dac86:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_385:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:25.312501+0000", 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.7628094569999999, 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025287064000000001, 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4479 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.172 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.312501+0000", 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.312501+0000", 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.173 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.312504+0000", 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.7050000000000001e-06 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.314735+0000", 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0022307260000000001 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.314765+0000", 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.9431e-05 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.174 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.314781+0000", 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.6229999999999999e-05 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.314878+0000", 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7112000000000001e-05 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.315064+0000", 2024-09-10T05:58:27.175 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000186288 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.315220+0000", 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015566399999999999 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.320983+0000", 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0057632919999999997 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.176 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.337625+0000", 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.016641559 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.337701+0000", 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6482000000000004e-05 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.337788+0000", 2024-09-10T05:58:27.177 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 8.6575000000000004e-05 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4509 3.18 3:196ed5bd:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_415:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:25.808740+0000", 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 1.2665701249999999, 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022072338, 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.178 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4509 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.808740+0000", 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.179 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.808740+0000", 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.808744+0000", 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.3730000000000003e-06 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.812234+0000", 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0034898070000000002 2024-09-10T05:58:27.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.812310+0000", 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.5919000000000003e-05 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.812341+0000", 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.0568999999999998e-05 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.812530+0000", 2024-09-10T05:58:27.181 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00018874899999999999 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.812812+0000", 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00028273000000000003 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.813081+0000", 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00026850399999999998 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.182 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.824020+0000", 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010939528 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.828369+0000", 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0043490150000000003 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.830672+0000", 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0023023610000000002 2024-09-10T05:58:27.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:25.830812+0000", 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014078300000000001 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4532 3.17 3:e91c4434:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_438:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:26.230891+0000", 2024-09-10T05:58:27.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.84441956600000001, 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.027264350999999999, 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4532 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.185 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.230891+0000", 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.230891+0000", 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.230895+0000", 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.313e-06 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.186 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.233729+0000", 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0028344759999999998 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.233785+0000", 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.5775e-05 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.233816+0000", 2024-09-10T05:58:27.187 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.1192999999999998e-05 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.234009+0000", 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00019268900000000001 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.234417+0000", 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040812699999999999 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.188 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 5", 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.234836+0000", 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000418894 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.244903+0000", 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.010066435 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.257908+0000", 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.013005421 2024-09-10T05:58:27.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.258006+0000", 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 9.7578000000000007e-05 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.258155+0000", 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00014945 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_repop(client.4542.0:4533 3.3 e111/24 3:c1484d0a:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_439:head v 111'34, mlcod=111'32)", 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:26.261197+0000", 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.81411331399999998, 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.030372046, 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.191 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.261197+0000", 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.261197+0000", 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.261199+0000", 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.0600000000000002e-06 2024-09-10T05:58:27.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.267149+0000", 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0059503209999999997 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.267186+0000", 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6835999999999998e-05 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.193 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.267211+0000", 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 2.4606000000000001e-05 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.267382+0000", 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017169900000000001 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.267440+0000", 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7426000000000002e-05 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.194 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.291446+0000", 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.024005914999999999 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.291569+0000", 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00012318299999999999 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.195 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4540 3.18 3:1b322a3c:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:26.357480+0000", 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.717829932, 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.022348244, 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4540 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.196 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.357480+0000", 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.357480+0000", 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.197 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.357485+0000", 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 4.8130000000000003e-06 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.360574+0000", 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.003088693 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.360624+0000", 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.0373e-05 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.198 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.360644+0000", 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.9572000000000002e-05 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.360822+0000", 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00017804 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.361229+0000", 2024-09-10T05:58:27.199 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00040684 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 1", 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.361620+0000", 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000391102 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.373300+0000", 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.011680031 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.200 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.379694+0000", 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0063943430000000002 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.379771+0000", 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.6834000000000003e-05 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.379829+0000", 2024-09-10T05:58:27.201 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.7602999999999997e-05 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: "description": "osd_op(client.4542.0:4570 3.b 3:d14a9b7d:::53bcab35-2758-4257-9744-a5ce2efab0b3.4542.12__shadow_.UyRBuRUmaKOH7CK8cuJ6qLtjpof_M0O_476:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: "initiated_at": "2024-09-10T05:58:26.784870+0000", 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.29044035899999998, 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.025242127999999999, 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: "continuous": false, 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type_data": { 2024-09-10T05:58:27.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_info": { 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client": "client.4542", 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "client_addr": "172.21.15.70:0/494530792", 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tid": 4570 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "events": [ 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "initiated", 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.784870+0000", 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.203 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "header_read", 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.784870+0000", 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "throttled", 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.784874+0000", 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6440000000000002e-06 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "all_read", 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.786732+0000", 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0018581719999999999 2024-09-10T05:58:27.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "dispatched", 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.786768+0000", 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 3.6198000000000001e-05 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "queued_for_pg", 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.786785+0000", 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 1.7425999999999999e-05 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "reached_pg", 2024-09-10T05:58:27.205 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.786864+0000", 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.8636999999999999e-05 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "started", 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.787022+0000", 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.00015776599999999999 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "waiting for subops from 4", 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.787134+0000", 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.000112013 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.206 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "op_commit", 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.792196+0000", 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.0050623960000000003 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "sub_op_commit_rec", 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.809976+0000", 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 0.017779792999999999 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "commit_sent", 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.810054+0000", 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 7.7674000000000002e-05 2024-09-10T05:58:27.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: "event": "done", 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: "time": "2024-09-10T05:58:26.810112+0000", 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: "duration": 5.8409000000000003e-05 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-10T05:58:27.208 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:58:27.209 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-09-10T05:58:27.073+0000 7fdba531b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-10T05:58:27.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T05:58:27.210 INFO:tasks.workunit.client.0.smithi070.stdout:quota disabled for the bucket: buck_2024_08_10_05_58_16 2024-09-10T05:58:27.210 INFO:tasks.workunit.client.0.smithi070.stdout:adding file to bucket: 2Gb. 2024-09-10T05:58:27.210 INFO:tasks.workunit.client.0.smithi070.stdout:upload file successful 2024-09-10T05:58:27.211 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:58:27.211 INFO:tasks.workunit.client.0.smithi070.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-09-10T05:58:27.211 INFO:tasks.workunit.client.0.smithi070.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T05:58:27.211 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0: {} 2024-09-10T05:58:27.211 INFO:teuthology.orchestra.run.smithi070.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T05:58:27.212 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1: {} 2024-09-10T05:58:27.212 INFO:teuthology.orchestra.run.smithi070.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T05:58:27.226 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2: {} 2024-09-10T05:58:27.226 INFO:teuthology.orchestra.run.smithi070.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T05:58:27.227 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:27.221+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:27.247 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3: {} 2024-09-10T05:58:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T05:58:27.273 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4: {} 2024-09-10T05:58:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T05:58:27.295 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5: {} 2024-09-10T05:58:27.296 INFO:teuthology.orchestra.run.smithi070.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T05:58:27.314 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:27.307+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:27.316 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6: {} 2024-09-10T05:58:27.317 INFO:teuthology.orchestra.run.smithi070.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T05:58:27.342 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7: {} 2024-09-10T05:58:27.343 INFO:teuthology.orchestra.run.smithi070.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T05:58:27.354 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:27.354 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:27.372 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T05:58:27.420 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-09-10T05:58:27.417+0000 7efd57b75640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26384) UID: 0 2024-09-10T05:58:27.444 INFO:tasks.workunit.client.0.smithi070.stdout:user qa_user deleted 2024-09-10T05:58:27.445 INFO:tasks.workunit.client.0.smithi070.stdout:bucket delete succeeded 2024-09-10T05:58:27.449 INFO:tasks.workunit.client.0.smithi070.stdout:OK 2024-09-10T05:58:27.449 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T05:58:27.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T05:58:27.505 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-09-10T05:58:27.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T05:58:27.516 INFO:tasks.ceph.osd.6.smithi098.stderr:2024-09-10T05:58:27.511+0000 7f90b555e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26481) UID: 0 2024-09-10T05:58:27.536 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:27.536 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:27.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T05:58:27.617 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-10T05:58:27.611+0000 7f0a6e0c8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26478) UID: 0 2024-09-10T05:58:27.717 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-09-10T05:58:27.713+0000 7f7fd7325640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-10T05:58:27.723 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:27.723 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:27.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T05:58:27.819 INFO:tasks.ceph.osd.7.smithi098.stderr:2024-09-10T05:58:27.815+0000 7f6d46a41640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26483) UID: 0 2024-09-10T05:58:27.841 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:27.842 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T05:58:27.853 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T05:58:27.853 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T05:58:27.896 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:27.896 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:27.905 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T05:58:27.905 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-10T05:58:27.914 INFO:tasks.thrashosds:joining thrashosds 2024-09-10T05:58:27.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T05:58:27.957 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:58:28.081 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:28.081 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:28.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T05:58:28.216 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:28.217 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:28.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T05:58:28.349 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:28.349 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:28.362 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T05:58:28.482 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:28.483 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:28.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T05:58:28.621 INFO:teuthology.orchestra.run.smithi070.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:28.622 INFO:teuthology.orchestra.run.smithi070.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:28.637 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T05:58:28.768 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:28.768 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:28.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T05:58:28.907 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:28.907 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:28.921 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T05:58:29.043 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.043 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T05:58:29.177 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.177 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T05:58:29.309 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.309 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T05:58:29.439 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.439 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T05:58:29.560 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.561 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.573 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T05:58:29.681 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.681 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T05:58:29.813 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.813 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.827 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T05:58:29.944 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:29.945 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:29.959 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T05:58:30.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T05:58:30.136 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:30.137 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:30.151 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T05:58:30.272 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-10T05:58:30.273 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T05:58:30.980 INFO:teuthology.orchestra.run.smithi070.stderr:noscrub is unset 2024-09-10T05:58:31.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T05:58:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:nodeep-scrub is unset 2024-09-10T05:58:34.241 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-10T05:58:34.241 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-10T05:58:34.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-10T05:58:34.562 INFO:tasks.ceph.mon.a.smithi070.stderr:2024-09-10T05:58:34.557+0000 7fa00a078640 -1 mon.a@0(leader).osd e114 definitely_dead 0 2024-09-10T05:58:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:marked in osd.3. 2024-09-10T05:58:35.062 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-10T05:58:35.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-10T05:58:35.190 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a: {} 2024-09-10T05:58:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T05:58:35.202 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b: {} 2024-09-10T05:58:35.203 INFO:teuthology.orchestra.run.smithi070.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T05:58:35.211 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c: {} 2024-09-10T05:58:35.212 INFO:teuthology.orchestra.run.smithi070.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T05:58:35.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-10T05:58:36.056 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.0 to 1 (10000) 2024-09-10T05:58:36.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-10T05:58:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-10T05:58:37.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-10T05:58:38.025 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.1 to 1 (10000) 2024-09-10T05:58:38.063 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-10T05:58:39.044 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-10T05:58:39.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-10T05:58:40.063 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.2 to 1 (10000) 2024-09-10T05:58:40.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-10T05:58:41.072 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-10T05:58:41.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-10T05:58:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.3 to 1 (10000) 2024-09-10T05:58:42.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-10T05:58:43.091 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-10T05:58:43.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-10T05:58:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.4 to 1 (10000) 2024-09-10T05:58:44.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-10T05:58:45.116 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-10T05:58:45.142 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-10T05:58:46.113 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.5 to 1 (10000) 2024-09-10T05:58:46.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-10T05:58:47.130 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-10T05:58:47.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-10T05:58:48.133 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.6 to 1 (10000) 2024-09-10T05:58:48.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-10T05:58:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-10T05:58:49.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-10T05:58:50.165 INFO:teuthology.orchestra.run.smithi070.stderr:reweighted osd.7 to 1 (10000) 2024-09-10T05:58:50.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-10T05:58:51.178 INFO:teuthology.orchestra.run.smithi070.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-10T05:58:51.203 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-10T05:58:51.203 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-10T05:58:51.204 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-10T05:58:51.204 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-10T05:58:51.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T05:58:51.204 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:58:51.514 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:58:51.514 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":131,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:58:51.169767+0000","last_up_change":"2024-09-10T05:55:04.950402+0000","last_in_change":"2024-09-10T05:58:34.994738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:55:05.674567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:55:11.127613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T05:55:21.036897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T05:55:22.887571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T05:55:25.018914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T05:55:26.694534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T05:55:28.604339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T05:55:30.741862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6801","nonce":3378450542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6803","nonce":3378450542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6807","nonce":3378450542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6805","nonce":3378450542}]},"public_addr":"172.21.15.70:6801/3378450542","cluster_addr":"172.21.15.70:6803/3378450542","heartbeat_back_addr":"172.21.15.70:6807/3378450542","heartbeat_front_addr":"172.21.15.70:6805/3378450542","state":["exists","up"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6809","nonce":841653474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6811","nonce":841653474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6815","nonce":841653474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6813","nonce":841653474}]},"public_addr":"172.21.15.70:6809/841653474","cluster_addr":"172.21.15.70:6811/841653474","heartbeat_back_addr":"172.21.15.70:6815/841653474","heartbeat_front_addr":"172.21.15.70:6813/841653474","state":["exists","up"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6817","nonce":2429334233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6819","nonce":2429334233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6823","nonce":2429334233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6821","nonce":2429334233}]},"public_addr":"172.21.15.70:6817/2429334233","cluster_addr":"172.21.15.70:6819/2429334233","heartbeat_back_addr":"172.21.15.70:6823/2429334233","heartbeat_front_addr":"172.21.15.70:6821/2429334233","state":["exists","up"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6825","nonce":128774917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6827","nonce":128774917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6831","nonce":128774917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6829","nonce":128774917}]},"public_addr":"172.21.15.70:6825/128774917","cluster_addr":"172.21.15.70:6827/128774917","heartbeat_back_addr":"172.21.15.70:6831/128774917","heartbeat_front_addr":"172.21.15.70:6829/128774917","state":["exists","up"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6801","nonce":2565298170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6803","nonce":2565298170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6807","nonce":2565298170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6805","nonce":2565298170}]},"public_addr":"172.21.15.98:6801/2565298170","cluster_addr":"172.21.15.98:6803/2565298170","heartbeat_back_addr":"172.21.15.98:6807/2565298170","heartbeat_front_addr":"172.21.15.98:6805/2565298170","state":["exists","up"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6825","nonce":1681543764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6827","nonce":1681543764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6831","nonce":1681543764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6829","nonce":1681543764}]},"public_addr":"172.21.15.98:6825/1681543764","cluster_addr":"172.21.15.98:6827/1681543764","heartbeat_back_addr":"172.21.15.98:6831/1681543764","heartbeat_front_addr":"172.21.15.98:6829/1681543764","state":["exists","up"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6817","nonce":2743355861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6819","nonce":2743355861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6823","nonce":2743355861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6821","nonce":2743355861}]},"public_addr":"172.21.15.98:6817/2743355861","cluster_addr":"172.21.15.98:6819/2743355861","heartbeat_back_addr":"172.21.15.98:6823/2743355861","heartbeat_front_addr":"172.21.15.98:6821/2743355861","state":["exists","up"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6809","nonce":134608104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6811","nonce":134608104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6815","nonce":134608104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6813","nonce":134608104}]},"public_addr":"172.21.15.98:6809/134608104","cluster_addr":"172.21.15.98:6811/134608104","heartbeat_back_addr":"172.21.15.98:6815/134608104","heartbeat_front_addr":"172.21.15.98:6813/134608104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.657166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.779551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.757932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.247018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.648338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.605178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.839697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.929351+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.23","osds":[0,3]}],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.27","mappings":[{"from":4,"to":1}]},{"pgid":"3.2c","mappings":[{"from":4,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:58:51.534 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T05:58:51.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:58:51.847 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:58:51.847 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":131,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:58:51.169767+0000","last_up_change":"2024-09-10T05:55:04.950402+0000","last_in_change":"2024-09-10T05:58:34.994738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:55:05.674567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:55:11.127613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T05:55:21.036897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T05:55:22.887571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T05:55:25.018914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T05:55:26.694534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T05:55:28.604339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T05:55:30.741862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6801","nonce":3378450542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6803","nonce":3378450542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6807","nonce":3378450542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6805","nonce":3378450542}]},"public_addr":"172.21.15.70:6801/3378450542","cluster_addr":"172.21.15.70:6803/3378450542","heartbeat_back_addr":"172.21.15.70:6807/3378450542","heartbeat_front_addr":"172.21.15.70:6805/3378450542","state":["exists","up"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6809","nonce":841653474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6811","nonce":841653474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6815","nonce":841653474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6813","nonce":841653474}]},"public_addr":"172.21.15.70:6809/841653474","cluster_addr":"172.21.15.70:6811/841653474","heartbeat_back_addr":"172.21.15.70:6815/841653474","heartbeat_front_addr":"172.21.15.70:6813/841653474","state":["exists","up"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6817","nonce":2429334233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6819","nonce":2429334233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6823","nonce":2429334233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6821","nonce":2429334233}]},"public_addr":"172.21.15.70:6817/2429334233","cluster_addr":"172.21.15.70:6819/2429334233","heartbeat_back_addr":"172.21.15.70:6823/2429334233","heartbeat_front_addr":"172.21.15.70:6821/2429334233","state":["exists","up"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6825","nonce":128774917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6827","nonce":128774917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6831","nonce":128774917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6829","nonce":128774917}]},"public_addr":"172.21.15.70:6825/128774917","cluster_addr":"172.21.15.70:6827/128774917","heartbeat_back_addr":"172.21.15.70:6831/128774917","heartbeat_front_addr":"172.21.15.70:6829/128774917","state":["exists","up"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6801","nonce":2565298170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6803","nonce":2565298170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6807","nonce":2565298170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6805","nonce":2565298170}]},"public_addr":"172.21.15.98:6801/2565298170","cluster_addr":"172.21.15.98:6803/2565298170","heartbeat_back_addr":"172.21.15.98:6807/2565298170","heartbeat_front_addr":"172.21.15.98:6805/2565298170","state":["exists","up"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6825","nonce":1681543764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6827","nonce":1681543764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6831","nonce":1681543764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6829","nonce":1681543764}]},"public_addr":"172.21.15.98:6825/1681543764","cluster_addr":"172.21.15.98:6827/1681543764","heartbeat_back_addr":"172.21.15.98:6831/1681543764","heartbeat_front_addr":"172.21.15.98:6829/1681543764","state":["exists","up"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6817","nonce":2743355861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6819","nonce":2743355861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6823","nonce":2743355861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6821","nonce":2743355861}]},"public_addr":"172.21.15.98:6817/2743355861","cluster_addr":"172.21.15.98:6819/2743355861","heartbeat_back_addr":"172.21.15.98:6823/2743355861","heartbeat_front_addr":"172.21.15.98:6821/2743355861","state":["exists","up"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6809","nonce":134608104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6811","nonce":134608104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6815","nonce":134608104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6813","nonce":134608104}]},"public_addr":"172.21.15.98:6809/134608104","cluster_addr":"172.21.15.98:6811/134608104","heartbeat_back_addr":"172.21.15.98:6815/134608104","heartbeat_front_addr":"172.21.15.98:6813/134608104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.657166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.779551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.757932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.247018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.648338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.605178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.839697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.929351+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.23","osds":[0,3]}],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.27","mappings":[{"from":4,"to":1}]},{"pgid":"3.2c","mappings":[{"from":4,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:58:51.866 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T05:58:51.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T05:58:51.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T05:58:51.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T05:58:51.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T05:58:51.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T05:58:51.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T05:58:51.869 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T05:58:52.131 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:52.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T05:58:52.147 INFO:teuthology.orchestra.run.smithi070.stdout:64424509490 2024-09-10T05:58:52.147 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T05:58:52.148 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:52.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:58:52.153 INFO:teuthology.orchestra.run.smithi070.stdout:60129542194 2024-09-10T05:58:52.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:58:52.158 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:52.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:58:52.160 INFO:teuthology.orchestra.run.smithi070.stdout:64424509490 2024-09-10T05:58:52.161 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T05:58:52.164 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:52.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:58:52.165 INFO:teuthology.orchestra.run.smithi070.stdout:64424509488 2024-09-10T05:58:52.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T05:58:52.692 INFO:teuthology.orchestra.run.smithi070.stdout:64424509489 2024-09-10T05:58:52.699 INFO:teuthology.orchestra.run.smithi070.stdout:60129542192 2024-09-10T05:58:52.702 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:52.703 INFO:teuthology.orchestra.run.smithi070.stdout:64424509489 2024-09-10T05:58:52.717 INFO:teuthology.orchestra.run.smithi070.stdout:60129542192 2024-09-10T05:58:52.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509490 got 64424509489 for osd.6 2024-09-10T05:58:52.730 INFO:teuthology.orchestra.run.smithi070.stdout:60129542192 2024-09-10T05:58:52.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.4 2024-09-10T05:58:52.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509490 got 64424509489 for osd.7 2024-09-10T05:58:52.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542193 for osd.2 2024-09-10T05:58:52.742 INFO:teuthology.orchestra.run.smithi070.stdout:64424509487 2024-09-10T05:58:52.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.3 2024-09-10T05:58:52.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.1 2024-09-10T05:58:52.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509487 for osd.5 2024-09-10T05:58:52.762 INFO:teuthology.orchestra.run.smithi070.stdout:60129542192 2024-09-10T05:58:52.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.0 2024-09-10T05:58:53.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T05:58:53.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T05:58:53.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T05:58:53.739 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T05:58:53.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T05:58:53.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T05:58:53.762 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T05:58:53.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T05:58:54.296 INFO:teuthology.orchestra.run.smithi070.stdout:64424509490 2024-09-10T05:58:54.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509490 got 64424509490 for osd.6 2024-09-10T05:58:54.318 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.319 INFO:teuthology.orchestra.run.smithi070.stdout:60129542194 2024-09-10T05:58:54.329 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:54.331 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:54.331 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:54.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542194 for osd.2 2024-09-10T05:58:54.341 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.341 INFO:teuthology.orchestra.run.smithi070.stdout:60129542193 2024-09-10T05:58:54.352 INFO:teuthology.orchestra.run.smithi070.stdout:64424509488 2024-09-10T05:58:54.361 INFO:teuthology.orchestra.run.smithi070.stdout:64424509490 2024-09-10T05:58:54.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.4 2024-09-10T05:58:54.364 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.0 2024-09-10T05:58:54.367 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.3 2024-09-10T05:58:54.370 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.1 2024-09-10T05:58:54.370 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509488 for osd.5 2024-09-10T05:58:54.378 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509490 got 64424509490 for osd.7 2024-09-10T05:58:54.384 DEBUG:teuthology.parallel:result is None 2024-09-10T05:58:54.384 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-10T05:58:54.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:58:54.737 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:58:54.744 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:58:54.753 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-10T05:58:53.727707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819944,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3465,"num_read_kb":3124,"num_write":2963,"num_write_kb":6187124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":852,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4056,"ondisk_log_size":4056,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12605720,"kb_used_data":12318748,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":742369000,"statfs":{"total":773094113280,"available":760185856000,"internally_reserved":0,"allocated":12614397952,"data_stored":12608962794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.593133"},"pg_stats":[{"pgid":"3.3f","version":"111'22","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022416+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:58:52.022416+0000","last_peered":"2024-09-10T05:58:52.022416+0000","last_clean":"2024-09-10T05:58:52.022416+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:58:52.022416+0000","last_undegraded":"2024-09-10T05:58:52.022416+0000","last_fullsized":"2024-09-10T05:58:52.022416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235978+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:58:51.235978+0000","last_peered":"2024-09-10T05:58:51.235978+0000","last_clean":"2024-09-10T05:58:51.235978+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:58:51.235978+0000","last_undegraded":"2024-09-10T05:58:51.235978+0000","last_fullsized":"2024-09-10T05:58:51.235978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'27","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020975+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:58:52.020975+0000","last_peered":"2024-09-10T05:58:52.020975+0000","last_clean":"2024-09-10T05:58:52.020975+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:58:52.020975+0000","last_undegraded":"2024-09-10T05:58:52.020975+0000","last_fullsized":"2024-09-10T05:58:52.020975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":255,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020787+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:58:52.020787+0000","last_peered":"2024-09-10T05:58:52.020787+0000","last_clean":"2024-09-10T05:58:52.020787+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:58:52.020787+0000","last_undegraded":"2024-09-10T05:58:52.020787+0000","last_fullsized":"2024-09-10T05:58:52.020787+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'27","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180817+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:58:51.180817+0000","last_peered":"2024-09-10T05:58:51.180817+0000","last_clean":"2024-09-10T05:58:51.180817+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:58:51.180817+0000","last_undegraded":"2024-09-10T05:58:51.180817+0000","last_fullsized":"2024-09-10T05:58:51.180817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177855+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:58:51.177855+0000","last_peered":"2024-09-10T05:58:51.177855+0000","last_clean":"2024-09-10T05:58:51.177855+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:58:51.177855+0000","last_undegraded":"2024-09-10T05:58:51.177855+0000","last_fullsized":"2024-09-10T05:58:51.177855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'21","reported_seq":320,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237271+0000","last_change":"2024-09-10T05:58:40.694618+0000","last_active":"2024-09-10T05:58:51.237271+0000","last_peered":"2024-09-10T05:58:51.237271+0000","last_clean":"2024-09-10T05:58:51.237271+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:58:51.237271+0000","last_undegraded":"2024-09-10T05:58:51.237271+0000","last_fullsized":"2024-09-10T05:58:51.237271+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:55.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":306,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180466+0000","last_change":"2024-09-10T05:58:40.726727+0000","last_active":"2024-09-10T05:58:51.180466+0000","last_peered":"2024-09-10T05:58:51.180466+0000","last_clean":"2024-09-10T05:58:51.180466+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:58:51.180466+0000","last_undegraded":"2024-09-10T05:58:51.180466+0000","last_fullsized":"2024-09-10T05:58:51.180466+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:59.972041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'29","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022246+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:58:52.022246+0000","last_peered":"2024-09-10T05:58:52.022246+0000","last_clean":"2024-09-10T05:58:52.022246+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:58:52.022246+0000","last_undegraded":"2024-09-10T05:58:52.022246+0000","last_fullsized":"2024-09-10T05:58:52.022246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023310+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:58:52.023310+0000","last_peered":"2024-09-10T05:58:52.023310+0000","last_clean":"2024-09-10T05:58:52.023310+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:58:52.023310+0000","last_undegraded":"2024-09-10T05:58:52.023310+0000","last_fullsized":"2024-09-10T05:58:52.023310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'26","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236551+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:58:51.236551+0000","last_peered":"2024-09-10T05:58:51.236551+0000","last_clean":"2024-09-10T05:58:51.236551+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:58:51.236551+0000","last_undegraded":"2024-09-10T05:58:51.236551+0000","last_fullsized":"2024-09-10T05:58:51.236551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178955+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:58:51.178955+0000","last_peered":"2024-09-10T05:58:51.178955+0000","last_clean":"2024-09-10T05:58:51.178955+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:58:51.178955+0000","last_undegraded":"2024-09-10T05:58:51.178955+0000","last_fullsized":"2024-09-10T05:58:51.178955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'20","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021287+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:58:52.021287+0000","last_peered":"2024-09-10T05:58:52.021287+0000","last_clean":"2024-09-10T05:58:52.021287+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:58:52.021287+0000","last_undegraded":"2024-09-10T05:58:52.021287+0000","last_fullsized":"2024-09-10T05:58:52.021287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237498+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:58:51.237498+0000","last_peered":"2024-09-10T05:58:51.237498+0000","last_clean":"2024-09-10T05:58:51.237498+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:58:51.237498+0000","last_undegraded":"2024-09-10T05:58:51.237498+0000","last_fullsized":"2024-09-10T05:58:51.237498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'13","reported_seq":68,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019168+0000","last_change":"2024-09-10T05:58:42.015968+0000","last_active":"2024-09-10T05:58:52.019168+0000","last_peered":"2024-09-10T05:58:52.019168+0000","last_clean":"2024-09-10T05:58:52.019168+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:58:52.019168+0000","last_undegraded":"2024-09-10T05:58:52.019168+0000","last_fullsized":"2024-09-10T05:58:52.019168+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:22.893621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":260,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020150+0000","last_change":"2024-09-10T05:58:40.119708+0000","last_active":"2024-09-10T05:58:52.020150+0000","last_peered":"2024-09-10T05:58:52.020150+0000","last_clean":"2024-09-10T05:58:52.020150+0000","last_became_active":"2024-09-10T05:58:36.084726+0000","last_became_peered":"2024-09-10T05:58:36.084726+0000","last_unstale":"2024-09-10T05:58:52.020150+0000","last_undegraded":"2024-09-10T05:58:52.020150+0000","last_fullsized":"2024-09-10T05:58:52.020150+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:25.497531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":218,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177262+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:58:51.177262+0000","last_peered":"2024-09-10T05:58:51.177262+0000","last_clean":"2024-09-10T05:58:51.177262+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:58:51.177262+0000","last_undegraded":"2024-09-10T05:58:51.177262+0000","last_fullsized":"2024-09-10T05:58:51.177262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'19","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022699+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:58:52.022699+0000","last_peered":"2024-09-10T05:58:52.022699+0000","last_clean":"2024-09-10T05:58:52.022699+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:58:52.022699+0000","last_undegraded":"2024-09-10T05:58:52.022699+0000","last_fullsized":"2024-09-10T05:58:52.022699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":238,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021027+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:58:52.021027+0000","last_peered":"2024-09-10T05:58:52.021027+0000","last_clean":"2024-09-10T05:58:52.021027+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:58:52.021027+0000","last_undegraded":"2024-09-10T05:58:52.021027+0000","last_fullsized":"2024-09-10T05:58:52.021027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'25","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024235+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:58:52.024235+0000","last_peered":"2024-09-10T05:58:52.024235+0000","last_clean":"2024-09-10T05:58:52.024235+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:58:52.024235+0000","last_undegraded":"2024-09-10T05:58:52.024235+0000","last_fullsized":"2024-09-10T05:58:52.024235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236839+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:58:51.236839+0000","last_peered":"2024-09-10T05:58:51.236839+0000","last_clean":"2024-09-10T05:58:51.236839+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:58:51.236839+0000","last_undegraded":"2024-09-10T05:58:51.236839+0000","last_fullsized":"2024-09-10T05:58:51.236839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'18","reported_seq":242,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024516+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:58:52.024516+0000","last_peered":"2024-09-10T05:58:52.024516+0000","last_clean":"2024-09-10T05:58:52.024516+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:58:52.024516+0000","last_undegraded":"2024-09-10T05:58:52.024516+0000","last_fullsized":"2024-09-10T05:58:52.024516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":273,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019226+0000","last_change":"2024-09-10T05:58:39.367642+0000","last_active":"2024-09-10T05:58:52.019226+0000","last_peered":"2024-09-10T05:58:52.019226+0000","last_clean":"2024-09-10T05:58:52.019226+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:58:52.019226+0000","last_undegraded":"2024-09-10T05:58:52.019226+0000","last_fullsized":"2024-09-10T05:58:52.019226+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'28","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178595+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:58:51.178595+0000","last_peered":"2024-09-10T05:58:51.178595+0000","last_clean":"2024-09-10T05:58:51.178595+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:58:51.178595+0000","last_undegraded":"2024-09-10T05:58:51.178595+0000","last_fullsized":"2024-09-10T05:58:51.178595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019693+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:58:52.019693+0000","last_peered":"2024-09-10T05:58:52.019693+0000","last_clean":"2024-09-10T05:58:52.019693+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:58:52.019693+0000","last_undegraded":"2024-09-10T05:58:52.019693+0000","last_fullsized":"2024-09-10T05:58:52.019693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'22","reported_seq":86,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022181+0000","last_change":"2024-09-10T05:58:42.304778+0000","last_active":"2024-09-10T05:58:52.022181+0000","last_peered":"2024-09-10T05:58:52.022181+0000","last_clean":"2024-09-10T05:58:52.022181+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:58:52.022181+0000","last_undegraded":"2024-09-10T05:58:52.022181+0000","last_fullsized":"2024-09-10T05:58:52.022181+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:41.747059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179278+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:58:51.179278+0000","last_peered":"2024-09-10T05:58:51.179278+0000","last_clean":"2024-09-10T05:58:51.179278+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:58:51.179278+0000","last_undegraded":"2024-09-10T05:58:51.179278+0000","last_fullsized":"2024-09-10T05:58:51.179278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179541+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:58:51.179541+0000","last_peered":"2024-09-10T05:58:51.179541+0000","last_clean":"2024-09-10T05:58:51.179541+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:58:51.179541+0000","last_undegraded":"2024-09-10T05:58:51.179541+0000","last_fullsized":"2024-09-10T05:58:51.179541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.176803+0000","last_change":"2024-09-10T05:58:38.995573+0000","last_active":"2024-09-10T05:58:51.176803+0000","last_peered":"2024-09-10T05:58:51.176803+0000","last_clean":"2024-09-10T05:58:51.176803+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:58:51.176803+0000","last_undegraded":"2024-09-10T05:58:51.176803+0000","last_fullsized":"2024-09-10T05:58:51.176803+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":50,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022505+0000","last_change":"2024-09-10T05:58:37.289796+0000","last_active":"2024-09-10T05:58:52.022505+0000","last_peered":"2024-09-10T05:58:52.022505+0000","last_clean":"2024-09-10T05:58:52.022505+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:58:52.022505+0000","last_undegraded":"2024-09-10T05:58:52.022505+0000","last_fullsized":"2024-09-10T05:58:52.022505+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:13.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'19","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022651+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:58:52.022651+0000","last_peered":"2024-09-10T05:58:52.022651+0000","last_clean":"2024-09-10T05:58:52.022651+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:58:52.022651+0000","last_undegraded":"2024-09-10T05:58:52.022651+0000","last_fullsized":"2024-09-10T05:58:52.022651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237731+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:58:51.237731+0000","last_peered":"2024-09-10T05:58:51.237731+0000","last_clean":"2024-09-10T05:58:51.237731+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:58:51.237731+0000","last_undegraded":"2024-09-10T05:58:51.237731+0000","last_fullsized":"2024-09-10T05:58:51.237731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"111'30","reported_seq":260,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180715+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:58:51.180715+0000","last_peered":"2024-09-10T05:58:51.180715+0000","last_clean":"2024-09-10T05:58:51.180715+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:58:51.180715+0000","last_undegraded":"2024-09-10T05:58:51.180715+0000","last_fullsized":"2024-09-10T05:58:51.180715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022087+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:58:52.022087+0000","last_peered":"2024-09-10T05:58:52.022087+0000","last_clean":"2024-09-10T05:58:52.022087+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:58:52.022087+0000","last_undegraded":"2024-09-10T05:58:52.022087+0000","last_fullsized":"2024-09-10T05:58:52.022087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"111'48","reported_seq":270,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235804+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:58:51.235804+0000","last_peered":"2024-09-10T05:58:51.235804+0000","last_clean":"2024-09-10T05:58:51.235804+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:58:51.235804+0000","last_undegraded":"2024-09-10T05:58:51.235804+0000","last_fullsized":"2024-09-10T05:58:51.235804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":227,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238120+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:58:51.238120+0000","last_peered":"2024-09-10T05:58:51.238120+0000","last_clean":"2024-09-10T05:58:51.238120+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:58:51.238120+0000","last_undegraded":"2024-09-10T05:58:51.238120+0000","last_fullsized":"2024-09-10T05:58:51.238120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'26","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179392+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:58:51.179392+0000","last_peered":"2024-09-10T05:58:51.179392+0000","last_clean":"2024-09-10T05:58:51.179392+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:58:51.179392+0000","last_undegraded":"2024-09-10T05:58:51.179392+0000","last_fullsized":"2024-09-10T05:58:51.179392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022631+0000","last_change":"2024-09-10T05:58:36.074698+0000","last_active":"2024-09-10T05:58:52.022631+0000","last_peered":"2024-09-10T05:58:52.022631+0000","last_clean":"2024-09-10T05:58:52.022631+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:58:52.022631+0000","last_undegraded":"2024-09-10T05:58:52.022631+0000","last_fullsized":"2024-09-10T05:58:52.022631+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:37.044312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178903+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:58:51.178903+0000","last_peered":"2024-09-10T05:58:51.178903+0000","last_clean":"2024-09-10T05:58:51.178903+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:58:51.178903+0000","last_undegraded":"2024-09-10T05:58:51.178903+0000","last_fullsized":"2024-09-10T05:58:51.178903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178652+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:58:51.178652+0000","last_peered":"2024-09-10T05:58:51.178652+0000","last_clean":"2024-09-10T05:58:51.178652+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:58:51.178652+0000","last_undegraded":"2024-09-10T05:58:51.178652+0000","last_fullsized":"2024-09-10T05:58:51.178652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178657+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:58:51.178657+0000","last_peered":"2024-09-10T05:58:51.178657+0000","last_clean":"2024-09-10T05:58:51.178657+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:58:51.178657+0000","last_undegraded":"2024-09-10T05:58:51.178657+0000","last_fullsized":"2024-09-10T05:58:51.178657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":255,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.182114+0000","last_change":"2024-09-10T05:58:36.709426+0000","last_active":"2024-09-10T05:58:51.182114+0000","last_peered":"2024-09-10T05:58:51.182114+0000","last_clean":"2024-09-10T05:58:51.182114+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:58:51.182114+0000","last_undegraded":"2024-09-10T05:58:51.182114+0000","last_fullsized":"2024-09-10T05:58:51.182114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:16.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'28","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021486+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:58:52.021486+0000","last_peered":"2024-09-10T05:58:52.021486+0000","last_clean":"2024-09-10T05:58:52.021486+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:58:52.021486+0000","last_undegraded":"2024-09-10T05:58:52.021486+0000","last_fullsized":"2024-09-10T05:58:52.021486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023929+0000","last_change":"2024-09-10T05:58:36.086954+0000","last_active":"2024-09-10T05:58:52.023929+0000","last_peered":"2024-09-10T05:58:52.023929+0000","last_clean":"2024-09-10T05:58:52.023929+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:58:52.023929+0000","last_undegraded":"2024-09-10T05:58:52.023929+0000","last_fullsized":"2024-09-10T05:58:52.023929+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:57.423283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":251,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019597+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:58:52.019597+0000","last_peered":"2024-09-10T05:58:52.019597+0000","last_clean":"2024-09-10T05:58:52.019597+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:58:52.019597+0000","last_undegraded":"2024-09-10T05:58:52.019597+0000","last_fullsized":"2024-09-10T05:58:52.019597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"111'134","reported_seq":383,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022427+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:58:52.022427+0000","last_peered":"2024-09-10T05:58:52.022427+0000","last_clean":"2024-09-10T05:58:52.022427+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:58:52.022427+0000","last_undegraded":"2024-09-10T05:58:52.022427+0000","last_fullsized":"2024-09-10T05:58:52.022427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177578+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:58:51.177578+0000","last_peered":"2024-09-10T05:58:51.177578+0000","last_clean":"2024-09-10T05:58:51.177578+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:58:51.177578+0000","last_undegraded":"2024-09-10T05:58:51.177578+0000","last_fullsized":"2024-09-10T05:58:51.177578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023956+0000","last_change":"2024-09-10T05:58:39.658860+0000","last_active":"2024-09-10T05:58:52.023956+0000","last_peered":"2024-09-10T05:58:52.023956+0000","last_clean":"2024-09-10T05:58:52.023956+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:58:52.023956+0000","last_undegraded":"2024-09-10T05:58:52.023956+0000","last_fullsized":"2024-09-10T05:58:52.023956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:22.522890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'18","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021152+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:58:52.021152+0000","last_peered":"2024-09-10T05:58:52.021152+0000","last_clean":"2024-09-10T05:58:52.021152+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:58:52.021152+0000","last_undegraded":"2024-09-10T05:58:52.021152+0000","last_fullsized":"2024-09-10T05:58:52.021152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":239,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237733+0000","last_change":"2024-09-10T05:58:36.076514+0000","last_active":"2024-09-10T05:58:51.237733+0000","last_peered":"2024-09-10T05:58:51.237733+0000","last_clean":"2024-09-10T05:58:51.237733+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:58:51.237733+0000","last_undegraded":"2024-09-10T05:58:51.237733+0000","last_fullsized":"2024-09-10T05:58:51.237733+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:58.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"111'23","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022931+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:58:52.022931+0000","last_peered":"2024-09-10T05:58:52.022931+0000","last_clean":"2024-09-10T05:58:52.022931+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:58:52.022931+0000","last_undegraded":"2024-09-10T05:58:52.022931+0000","last_fullsized":"2024-09-10T05:58:52.022931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"122'141","reported_seq":343,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022439+0000","last_change":"2024-09-10T05:58:42.104842+0000","last_active":"2024-09-10T05:58:52.022439+0000","last_peered":"2024-09-10T05:58:52.022439+0000","last_clean":"2024-09-10T05:58:52.022439+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:58:52.022439+0000","last_undegraded":"2024-09-10T05:58:52.022439+0000","last_fullsized":"2024-09-10T05:58:52.022439+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:06.712578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236491+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:58:51.236491+0000","last_peered":"2024-09-10T05:58:51.236491+0000","last_clean":"2024-09-10T05:58:51.236491+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:58:51.236491+0000","last_undegraded":"2024-09-10T05:58:51.236491+0000","last_fullsized":"2024-09-10T05:58:51.236491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'28","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022976+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:58:52.022976+0000","last_peered":"2024-09-10T05:58:52.022976+0000","last_clean":"2024-09-10T05:58:52.022976+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:58:52.022976+0000","last_undegraded":"2024-09-10T05:58:52.022976+0000","last_fullsized":"2024-09-10T05:58:52.022976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020241+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:58:52.020241+0000","last_peered":"2024-09-10T05:58:52.020241+0000","last_clean":"2024-09-10T05:58:52.020241+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:58:52.020241+0000","last_undegraded":"2024-09-10T05:58:52.020241+0000","last_fullsized":"2024-09-10T05:58:52.020241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"111'35","reported_seq":264,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236013+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:58:51.236013+0000","last_peered":"2024-09-10T05:58:51.236013+0000","last_clean":"2024-09-10T05:58:51.236013+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:58:51.236013+0000","last_undegraded":"2024-09-10T05:58:51.236013+0000","last_fullsized":"2024-09-10T05:58:51.236013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019978+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:58:52.019978+0000","last_peered":"2024-09-10T05:58:52.019978+0000","last_clean":"2024-09-10T05:58:52.019978+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:58:52.019978+0000","last_undegraded":"2024-09-10T05:58:52.019978+0000","last_fullsized":"2024-09-10T05:58:52.019978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236574+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:58:51.236574+0000","last_peered":"2024-09-10T05:58:51.236574+0000","last_clean":"2024-09-10T05:58:51.236574+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:58:51.236574+0000","last_undegraded":"2024-09-10T05:58:51.236574+0000","last_fullsized":"2024-09-10T05:58:51.236574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177343+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:58:51.177343+0000","last_peered":"2024-09-10T05:58:51.177343+0000","last_clean":"2024-09-10T05:58:51.177343+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:58:51.177343+0000","last_undegraded":"2024-09-10T05:58:51.177343+0000","last_fullsized":"2024-09-10T05:58:51.177343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'21","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022894+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:58:52.022894+0000","last_peered":"2024-09-10T05:58:52.022894+0000","last_clean":"2024-09-10T05:58:52.022894+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:58:52.022894+0000","last_undegraded":"2024-09-10T05:58:52.022894+0000","last_fullsized":"2024-09-10T05:58:52.022894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018805+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:58:52.018805+0000","last_peered":"2024-09-10T05:58:52.018805+0000","last_clean":"2024-09-10T05:58:52.018805+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:58:52.018805+0000","last_undegraded":"2024-09-10T05:58:52.018805+0000","last_fullsized":"2024-09-10T05:58:52.018805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"111'23","reported_seq":52,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022289+0000","last_change":"2024-09-10T05:58:41.124218+0000","last_active":"2024-09-10T05:58:52.022289+0000","last_peered":"2024-09-10T05:58:52.022289+0000","last_clean":"2024-09-10T05:58:52.022289+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:58:52.022289+0000","last_undegraded":"2024-09-10T05:58:52.022289+0000","last_fullsized":"2024-09-10T05:58:52.022289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:13.232943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020810+0000","last_change":"2024-09-10T05:58:36.068634+0000","last_active":"2024-09-10T05:58:52.020810+0000","last_peered":"2024-09-10T05:58:52.020810+0000","last_clean":"2024-09-10T05:58:52.020810+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:58:52.020810+0000","last_undegraded":"2024-09-10T05:58:52.020810+0000","last_fullsized":"2024-09-10T05:58:52.020810+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:54.848895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022778+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:58:52.022778+0000","last_peered":"2024-09-10T05:58:52.022778+0000","last_clean":"2024-09-10T05:58:52.022778+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:58:52.022778+0000","last_undegraded":"2024-09-10T05:58:52.022778+0000","last_fullsized":"2024-09-10T05:58:52.022778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022697+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:58:52.022697+0000","last_peered":"2024-09-10T05:58:52.022697+0000","last_clean":"2024-09-10T05:58:52.022697+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:58:52.022697+0000","last_undegraded":"2024-09-10T05:58:52.022697+0000","last_fullsized":"2024-09-10T05:58:52.022697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'23","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023940+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:58:52.023940+0000","last_peered":"2024-09-10T05:58:52.023940+0000","last_clean":"2024-09-10T05:58:52.023940+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:58:52.023940+0000","last_undegraded":"2024-09-10T05:58:52.023940+0000","last_fullsized":"2024-09-10T05:58:52.023940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019437+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:58:52.019437+0000","last_peered":"2024-09-10T05:58:52.019437+0000","last_clean":"2024-09-10T05:58:52.019437+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:58:52.019437+0000","last_undegraded":"2024-09-10T05:58:52.019437+0000","last_fullsized":"2024-09-10T05:58:52.019437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"111'35","reported_seq":269,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020598+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:58:52.020598+0000","last_peered":"2024-09-10T05:58:52.020598+0000","last_clean":"2024-09-10T05:58:52.020598+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:58:52.020598+0000","last_undegraded":"2024-09-10T05:58:52.020598+0000","last_fullsized":"2024-09-10T05:58:52.020598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"111'134","reported_seq":460,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178027+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:58:51.178027+0000","last_peered":"2024-09-10T05:58:51.178027+0000","last_clean":"2024-09-10T05:58:51.178027+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:58:51.178027+0000","last_undegraded":"2024-09-10T05:58:51.178027+0000","last_fullsized":"2024-09-10T05:58:51.178027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181133+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:58:51.181133+0000","last_peered":"2024-09-10T05:58:51.181133+0000","last_clean":"2024-09-10T05:58:51.181133+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:58:51.181133+0000","last_undegraded":"2024-09-10T05:58:51.181133+0000","last_fullsized":"2024-09-10T05:58:51.181133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181643+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:58:51.181643+0000","last_peered":"2024-09-10T05:58:51.181643+0000","last_clean":"2024-09-10T05:58:51.181643+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:58:51.181643+0000","last_undegraded":"2024-09-10T05:58:51.181643+0000","last_fullsized":"2024-09-10T05:58:51.181643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'12","reported_seq":186,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018991+0000","last_change":"2024-09-10T05:58:38.085546+0000","last_active":"2024-09-10T05:58:52.018991+0000","last_peered":"2024-09-10T05:58:52.018991+0000","last_clean":"2024-09-10T05:58:52.018991+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:58:52.018991+0000","last_undegraded":"2024-09-10T05:58:52.018991+0000","last_fullsized":"2024-09-10T05:58:52.018991+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:10.893758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018905+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:58:52.018905+0000","last_peered":"2024-09-10T05:58:52.018905+0000","last_clean":"2024-09-10T05:58:52.018905+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:58:52.018905+0000","last_undegraded":"2024-09-10T05:58:52.018905+0000","last_fullsized":"2024-09-10T05:58:52.018905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'40","reported_seq":274,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178710+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:58:51.178710+0000","last_peered":"2024-09-10T05:58:51.178710+0000","last_clean":"2024-09-10T05:58:51.178710+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:58:51.178710+0000","last_undegraded":"2024-09-10T05:58:51.178710+0000","last_fullsized":"2024-09-10T05:58:51.178710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018668+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:58:52.018668+0000","last_peered":"2024-09-10T05:58:52.018668+0000","last_clean":"2024-09-10T05:58:52.018668+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:58:52.018668+0000","last_undegraded":"2024-09-10T05:58:52.018668+0000","last_fullsized":"2024-09-10T05:58:52.018668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":262,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020297+0000","last_change":"2024-09-10T05:58:39.385287+0000","last_active":"2024-09-10T05:58:52.020297+0000","last_peered":"2024-09-10T05:58:52.020297+0000","last_clean":"2024-09-10T05:58:52.020297+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:58:52.020297+0000","last_undegraded":"2024-09-10T05:58:52.020297+0000","last_fullsized":"2024-09-10T05:58:52.020297+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:27.225607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":272,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179010+0000","last_change":"2024-09-10T05:58:40.751831+0000","last_active":"2024-09-10T05:58:51.179010+0000","last_peered":"2024-09-10T05:58:51.179010+0000","last_clean":"2024-09-10T05:58:51.179010+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:58:51.179010+0000","last_undegraded":"2024-09-10T05:58:51.179010+0000","last_fullsized":"2024-09-10T05:58:51.179010+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:32.405571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'27","reported_seq":96,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022920+0000","last_change":"2024-09-10T05:58:38.720733+0000","last_active":"2024-09-10T05:58:52.022920+0000","last_peered":"2024-09-10T05:58:52.022920+0000","last_clean":"2024-09-10T05:58:52.022920+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:58:52.022920+0000","last_undegraded":"2024-09-10T05:58:52.022920+0000","last_fullsized":"2024-09-10T05:58:52.022920+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:07.402320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019338+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:58:52.019338+0000","last_peered":"2024-09-10T05:58:52.019338+0000","last_clean":"2024-09-10T05:58:52.019338+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:58:52.019338+0000","last_undegraded":"2024-09-10T05:58:52.019338+0000","last_fullsized":"2024-09-10T05:58:52.019338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"111'28","reported_seq":252,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178774+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:58:51.178774+0000","last_peered":"2024-09-10T05:58:51.178774+0000","last_clean":"2024-09-10T05:58:51.178774+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:58:51.178774+0000","last_undegraded":"2024-09-10T05:58:51.178774+0000","last_fullsized":"2024-09-10T05:58:51.178774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":23,"num_write":20,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181243+0000","last_change":"2024-09-10T05:58:36.081028+0000","last_active":"2024-09-10T05:58:51.181243+0000","last_peered":"2024-09-10T05:58:51.181243+0000","last_clean":"2024-09-10T05:58:51.181243+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:58:51.181243+0000","last_undegraded":"2024-09-10T05:58:51.181243+0000","last_fullsized":"2024-09-10T05:58:51.181243+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:17.752342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018983+0000","last_change":"2024-09-10T05:58:42.021549+0000","last_active":"2024-09-10T05:58:52.018983+0000","last_peered":"2024-09-10T05:58:52.018983+0000","last_clean":"2024-09-10T05:58:52.018983+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:58:52.018983+0000","last_undegraded":"2024-09-10T05:58:52.018983+0000","last_fullsized":"2024-09-10T05:58:52.018983+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:23.621053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179596+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:58:51.179596+0000","last_peered":"2024-09-10T05:58:51.179596+0000","last_clean":"2024-09-10T05:58:51.179596+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:58:51.179596+0000","last_undegraded":"2024-09-10T05:58:51.179596+0000","last_fullsized":"2024-09-10T05:58:51.179596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'25","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023119+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:58:52.023119+0000","last_peered":"2024-09-10T05:58:52.023119+0000","last_clean":"2024-09-10T05:58:52.023119+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:58:52.023119+0000","last_undegraded":"2024-09-10T05:58:52.023119+0000","last_fullsized":"2024-09-10T05:58:52.023119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019977+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:58:52.019977+0000","last_peered":"2024-09-10T05:58:52.019977+0000","last_clean":"2024-09-10T05:58:52.019977+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:58:52.019977+0000","last_undegraded":"2024-09-10T05:58:52.019977+0000","last_fullsized":"2024-09-10T05:58:52.019977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"111'23","reported_seq":332,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020059+0000","last_change":"2024-09-10T05:58:40.714764+0000","last_active":"2024-09-10T05:58:52.020059+0000","last_peered":"2024-09-10T05:58:52.020059+0000","last_clean":"2024-09-10T05:58:52.020059+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:58:52.020059+0000","last_undegraded":"2024-09-10T05:58:52.020059+0000","last_fullsized":"2024-09-10T05:58:52.020059+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:27.289268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"111'134","reported_seq":397,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019578+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:58:52.019578+0000","last_peered":"2024-09-10T05:58:52.019578+0000","last_clean":"2024-09-10T05:58:52.019578+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:58:52.019578+0000","last_undegraded":"2024-09-10T05:58:52.019578+0000","last_fullsized":"2024-09-10T05:58:52.019578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":202,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020800+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:58:52.020800+0000","last_peered":"2024-09-10T05:58:52.020800+0000","last_clean":"2024-09-10T05:58:52.020800+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:58:52.020800+0000","last_undegraded":"2024-09-10T05:58:52.020800+0000","last_fullsized":"2024-09-10T05:58:52.020800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179315+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:58:51.179315+0000","last_peered":"2024-09-10T05:58:51.179315+0000","last_clean":"2024-09-10T05:58:51.179315+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:58:51.179315+0000","last_undegraded":"2024-09-10T05:58:51.179315+0000","last_fullsized":"2024-09-10T05:58:51.179315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'23","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178231+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:58:51.178231+0000","last_peered":"2024-09-10T05:58:51.178231+0000","last_clean":"2024-09-10T05:58:51.178231+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:58:51.178231+0000","last_undegraded":"2024-09-10T05:58:51.178231+0000","last_fullsized":"2024-09-10T05:58:51.178231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":395,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237378+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:58:51.237378+0000","last_peered":"2024-09-10T05:58:51.237378+0000","last_clean":"2024-09-10T05:58:51.237378+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:58:51.237378+0000","last_undegraded":"2024-09-10T05:58:51.237378+0000","last_fullsized":"2024-09-10T05:58:51.237378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":52,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022407+0000","last_change":"2024-09-10T05:58:37.286390+0000","last_active":"2024-09-10T05:58:52.022407+0000","last_peered":"2024-09-10T05:58:52.022407+0000","last_clean":"2024-09-10T05:58:52.022407+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:58:52.022407+0000","last_undegraded":"2024-09-10T05:58:52.022407+0000","last_fullsized":"2024-09-10T05:58:52.022407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:08.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"111'134","reported_seq":430,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023706+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:58:52.023706+0000","last_peered":"2024-09-10T05:58:52.023706+0000","last_clean":"2024-09-10T05:58:52.023706+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:58:52.023706+0000","last_undegraded":"2024-09-10T05:58:52.023706+0000","last_fullsized":"2024-09-10T05:58:52.023706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177769+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:58:51.177769+0000","last_peered":"2024-09-10T05:58:51.177769+0000","last_clean":"2024-09-10T05:58:51.177769+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:58:51.177769+0000","last_undegraded":"2024-09-10T05:58:51.177769+0000","last_fullsized":"2024-09-10T05:58:51.177769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":85,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237041+0000","last_change":"2024-09-10T05:58:40.805304+0000","last_active":"2024-09-10T05:58:51.237041+0000","last_peered":"2024-09-10T05:58:51.237041+0000","last_clean":"2024-09-10T05:58:51.237041+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:58:51.237041+0000","last_undegraded":"2024-09-10T05:58:51.237041+0000","last_fullsized":"2024-09-10T05:58:51.237041+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:26.888956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":86,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019581+0000","last_change":"2024-09-10T05:58:41.608913+0000","last_active":"2024-09-10T05:58:52.019581+0000","last_peered":"2024-09-10T05:58:52.019581+0000","last_clean":"2024-09-10T05:58:52.019581+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:58:52.019581+0000","last_undegraded":"2024-09-10T05:58:52.019581+0000","last_fullsized":"2024-09-10T05:58:52.019581+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:15.544218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179043+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:58:51.179043+0000","last_peered":"2024-09-10T05:58:51.179043+0000","last_clean":"2024-09-10T05:58:51.179043+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:58:51.179043+0000","last_undegraded":"2024-09-10T05:58:51.179043+0000","last_fullsized":"2024-09-10T05:58:51.179043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"111'25","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237147+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:58:51.237147+0000","last_peered":"2024-09-10T05:58:51.237147+0000","last_clean":"2024-09-10T05:58:51.237147+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:58:51.237147+0000","last_undegraded":"2024-09-10T05:58:51.237147+0000","last_fullsized":"2024-09-10T05:58:51.237147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022761+0000","last_change":"2024-09-10T05:58:36.080814+0000","last_active":"2024-09-10T05:58:52.022761+0000","last_peered":"2024-09-10T05:58:52.022761+0000","last_clean":"2024-09-10T05:58:52.022761+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:58:52.022761+0000","last_undegraded":"2024-09-10T05:58:52.022761+0000","last_fullsized":"2024-09-10T05:58:52.022761+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:12.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":202,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019884+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:58:52.019884+0000","last_peered":"2024-09-10T05:58:52.019884+0000","last_clean":"2024-09-10T05:58:52.019884+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:58:52.019884+0000","last_undegraded":"2024-09-10T05:58:52.019884+0000","last_fullsized":"2024-09-10T05:58:52.019884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":255,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024116+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:58:52.024116+0000","last_peered":"2024-09-10T05:58:52.024116+0000","last_clean":"2024-09-10T05:58:52.024116+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:58:52.024116+0000","last_undegraded":"2024-09-10T05:58:52.024116+0000","last_fullsized":"2024-09-10T05:58:52.024116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":329,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020836+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:58:52.020836+0000","last_peered":"2024-09-10T05:58:52.020836+0000","last_clean":"2024-09-10T05:58:52.020836+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:58:52.020836+0000","last_undegraded":"2024-09-10T05:58:52.020836+0000","last_fullsized":"2024-09-10T05:58:52.020836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237016+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:58:51.237016+0000","last_peered":"2024-09-10T05:58:51.237016+0000","last_clean":"2024-09-10T05:58:51.237016+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:58:51.237016+0000","last_undegraded":"2024-09-10T05:58:51.237016+0000","last_fullsized":"2024-09-10T05:58:51.237016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"111'28","reported_seq":98,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020492+0000","last_change":"2024-09-10T05:58:38.110183+0000","last_active":"2024-09-10T05:58:52.020492+0000","last_peered":"2024-09-10T05:58:52.020492+0000","last_clean":"2024-09-10T05:58:52.020492+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:58:52.020492+0000","last_undegraded":"2024-09-10T05:58:52.020492+0000","last_fullsized":"2024-09-10T05:58:52.020492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.156258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021783+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:58:52.021783+0000","last_peered":"2024-09-10T05:58:52.021783+0000","last_clean":"2024-09-10T05:58:52.021783+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:58:52.021783+0000","last_undegraded":"2024-09-10T05:58:52.021783+0000","last_fullsized":"2024-09-10T05:58:52.021783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"111'43","reported_seq":354,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237535+0000","last_change":"2024-09-10T05:58:40.775802+0000","last_active":"2024-09-10T05:58:51.237535+0000","last_peered":"2024-09-10T05:58:51.237535+0000","last_clean":"2024-09-10T05:58:51.237535+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:58:51.237535+0000","last_undegraded":"2024-09-10T05:58:51.237535+0000","last_fullsized":"2024-09-10T05:58:51.237535+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.223922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181640+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:58:51.181640+0000","last_peered":"2024-09-10T05:58:51.181640+0000","last_clean":"2024-09-10T05:58:51.181640+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:58:51.181640+0000","last_undegraded":"2024-09-10T05:58:51.181640+0000","last_fullsized":"2024-09-10T05:58:51.181640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020621+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:58:52.020621+0000","last_peered":"2024-09-10T05:58:52.020621+0000","last_clean":"2024-09-10T05:58:52.020621+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:58:52.020621+0000","last_undegraded":"2024-09-10T05:58:52.020621+0000","last_fullsized":"2024-09-10T05:58:52.020621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181910+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:58:51.181910+0000","last_peered":"2024-09-10T05:58:51.181910+0000","last_clean":"2024-09-10T05:58:51.181910+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:58:51.181910+0000","last_undegraded":"2024-09-10T05:58:51.181910+0000","last_fullsized":"2024-09-10T05:58:51.181910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020354+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:58:52.020354+0000","last_peered":"2024-09-10T05:58:52.020354+0000","last_clean":"2024-09-10T05:58:52.020354+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:58:52.020354+0000","last_undegraded":"2024-09-10T05:58:52.020354+0000","last_fullsized":"2024-09-10T05:58:52.020354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'19","reported_seq":242,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178814+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:58:51.178814+0000","last_peered":"2024-09-10T05:58:51.178814+0000","last_clean":"2024-09-10T05:58:51.178814+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:58:51.178814+0000","last_undegraded":"2024-09-10T05:58:51.178814+0000","last_fullsized":"2024-09-10T05:58:51.178814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238245+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:58:51.238245+0000","last_peered":"2024-09-10T05:58:51.238245+0000","last_clean":"2024-09-10T05:58:51.238245+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:58:51.238245+0000","last_undegraded":"2024-09-10T05:58:51.238245+0000","last_fullsized":"2024-09-10T05:58:51.238245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"111'142","reported_seq":461,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019320+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:58:52.019320+0000","last_peered":"2024-09-10T05:58:52.019320+0000","last_clean":"2024-09-10T05:58:52.019320+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:58:52.019320+0000","last_undegraded":"2024-09-10T05:58:52.019320+0000","last_fullsized":"2024-09-10T05:58:52.019320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":185,"num_read_kb":169,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022690+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:58:52.022690+0000","last_peered":"2024-09-10T05:58:52.022690+0000","last_clean":"2024-09-10T05:58:52.022690+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:58:52.022690+0000","last_undegraded":"2024-09-10T05:58:52.022690+0000","last_fullsized":"2024-09-10T05:58:52.022690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":211,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019597+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:58:52.019597+0000","last_peered":"2024-09-10T05:58:52.019597+0000","last_clean":"2024-09-10T05:58:52.019597+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:58:52.019597+0000","last_undegraded":"2024-09-10T05:58:52.019597+0000","last_fullsized":"2024-09-10T05:58:52.019597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021260+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:58:52.021260+0000","last_peered":"2024-09-10T05:58:52.021260+0000","last_clean":"2024-09-10T05:58:52.021260+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:58:52.021260+0000","last_undegraded":"2024-09-10T05:58:52.021260+0000","last_fullsized":"2024-09-10T05:58:52.021260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":260,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018741+0000","last_change":"2024-09-10T05:58:36.063964+0000","last_active":"2024-09-10T05:58:52.018741+0000","last_peered":"2024-09-10T05:58:52.018741+0000","last_clean":"2024-09-10T05:58:52.018741+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:58:52.018741+0000","last_undegraded":"2024-09-10T05:58:52.018741+0000","last_fullsized":"2024-09-10T05:58:52.018741+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:53.613158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019432+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:58:52.019432+0000","last_peered":"2024-09-10T05:58:52.019432+0000","last_clean":"2024-09-10T05:58:52.019432+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:58:52.019432+0000","last_undegraded":"2024-09-10T05:58:52.019432+0000","last_fullsized":"2024-09-10T05:58:52.019432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019730+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:58:52.019730+0000","last_peered":"2024-09-10T05:58:52.019730+0000","last_clean":"2024-09-10T05:58:52.019730+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:58:52.019730+0000","last_undegraded":"2024-09-10T05:58:52.019730+0000","last_fullsized":"2024-09-10T05:58:52.019730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":274,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023435+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:58:52.023435+0000","last_peered":"2024-09-10T05:58:52.023435+0000","last_clean":"2024-09-10T05:58:52.023435+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:58:52.023435+0000","last_undegraded":"2024-09-10T05:58:52.023435+0000","last_fullsized":"2024-09-10T05:58:52.023435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180470+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:58:51.180470+0000","last_peered":"2024-09-10T05:58:51.180470+0000","last_clean":"2024-09-10T05:58:51.180470+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:58:51.180470+0000","last_undegraded":"2024-09-10T05:58:51.180470+0000","last_fullsized":"2024-09-10T05:58:51.180470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022662+0000","last_change":"2024-09-10T05:58:36.090394+0000","last_active":"2024-09-10T05:58:52.022662+0000","last_peered":"2024-09-10T05:58:52.022662+0000","last_clean":"2024-09-10T05:58:52.022662+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:58:52.022662+0000","last_undegraded":"2024-09-10T05:58:52.022662+0000","last_fullsized":"2024-09-10T05:58:52.022662+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:49.622437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020328+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:58:52.020328+0000","last_peered":"2024-09-10T05:58:52.020328+0000","last_clean":"2024-09-10T05:58:52.020328+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:58:52.020328+0000","last_undegraded":"2024-09-10T05:58:52.020328+0000","last_fullsized":"2024-09-10T05:58:52.020328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":238,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237863+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:58:51.237863+0000","last_peered":"2024-09-10T05:58:51.237863+0000","last_clean":"2024-09-10T05:58:51.237863+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:58:51.237863+0000","last_undegraded":"2024-09-10T05:58:51.237863+0000","last_fullsized":"2024-09-10T05:58:51.237863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'35","reported_seq":257,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178488+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:58:51.178488+0000","last_peered":"2024-09-10T05:58:51.178488+0000","last_clean":"2024-09-10T05:58:51.178488+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:58:51.178488+0000","last_undegraded":"2024-09-10T05:58:51.178488+0000","last_fullsized":"2024-09-10T05:58:51.178488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180459+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:58:51.180459+0000","last_peered":"2024-09-10T05:58:51.180459+0000","last_clean":"2024-09-10T05:58:51.180459+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:58:51.180459+0000","last_undegraded":"2024-09-10T05:58:51.180459+0000","last_fullsized":"2024-09-10T05:58:51.180459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":54,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022744+0000","last_change":"2024-09-10T05:58:37.301597+0000","last_active":"2024-09-10T05:58:52.022744+0000","last_peered":"2024-09-10T05:58:52.022744+0000","last_clean":"2024-09-10T05:58:52.022744+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:58:52.022744+0000","last_undegraded":"2024-09-10T05:58:52.022744+0000","last_fullsized":"2024-09-10T05:58:52.022744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:30.282821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024382+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:58:52.024382+0000","last_peered":"2024-09-10T05:58:52.024382+0000","last_clean":"2024-09-10T05:58:52.024382+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:58:52.024382+0000","last_undegraded":"2024-09-10T05:58:52.024382+0000","last_fullsized":"2024-09-10T05:58:52.024382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":239,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235594+0000","last_change":"2024-09-10T05:58:40.735106+0000","last_active":"2024-09-10T05:58:51.235594+0000","last_peered":"2024-09-10T05:58:51.235594+0000","last_clean":"2024-09-10T05:58:51.235594+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:58:51.235594+0000","last_undegraded":"2024-09-10T05:58:51.235594+0000","last_fullsized":"2024-09-10T05:58:51.235594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:08.686783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":193,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018517+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:58:52.018517+0000","last_peered":"2024-09-10T05:58:52.018517+0000","last_clean":"2024-09-10T05:58:52.018517+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:58:52.018517+0000","last_undegraded":"2024-09-10T05:58:52.018517+0000","last_fullsized":"2024-09-10T05:58:52.018517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"111'25","reported_seq":328,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238289+0000","last_change":"2024-09-10T05:58:39.363982+0000","last_active":"2024-09-10T05:58:51.238289+0000","last_peered":"2024-09-10T05:58:51.238289+0000","last_clean":"2024-09-10T05:58:51.238289+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:58:51.238289+0000","last_undegraded":"2024-09-10T05:58:51.238289+0000","last_fullsized":"2024-09-10T05:58:51.238289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:12.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021285+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:58:52.021285+0000","last_peered":"2024-09-10T05:58:52.021285+0000","last_clean":"2024-09-10T05:58:52.021285+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:58:52.021285+0000","last_undegraded":"2024-09-10T05:58:52.021285+0000","last_fullsized":"2024-09-10T05:58:52.021285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":305,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180720+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:58:51.180720+0000","last_peered":"2024-09-10T05:58:51.180720+0000","last_clean":"2024-09-10T05:58:51.180720+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:58:51.180720+0000","last_undegraded":"2024-09-10T05:58:51.180720+0000","last_fullsized":"2024-09-10T05:58:51.180720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"111'47","reported_seq":396,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179407+0000","last_change":"2024-09-10T05:58:39.382781+0000","last_active":"2024-09-10T05:58:51.179407+0000","last_peered":"2024-09-10T05:58:51.179407+0000","last_clean":"2024-09-10T05:58:51.179407+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:58:51.179407+0000","last_undegraded":"2024-09-10T05:58:51.179407+0000","last_fullsized":"2024-09-10T05:58:51.179407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:54.079756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":230,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.176962+0000","last_change":"2024-09-10T05:58:36.065033+0000","last_active":"2024-09-10T05:58:51.176962+0000","last_peered":"2024-09-10T05:58:51.176962+0000","last_clean":"2024-09-10T05:58:51.176962+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:58:51.176962+0000","last_undegraded":"2024-09-10T05:58:51.176962+0000","last_fullsized":"2024-09-10T05:58:51.176962+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.563276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180743+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:58:51.180743+0000","last_peered":"2024-09-10T05:58:51.180743+0000","last_clean":"2024-09-10T05:58:51.180743+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:58:51.180743+0000","last_undegraded":"2024-09-10T05:58:51.180743+0000","last_fullsized":"2024-09-10T05:58:51.180743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":228,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181513+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:58:51.181513+0000","last_peered":"2024-09-10T05:58:51.181513+0000","last_clean":"2024-09-10T05:58:51.181513+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:58:51.181513+0000","last_undegraded":"2024-09-10T05:58:51.181513+0000","last_fullsized":"2024-09-10T05:58:51.181513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'31","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020221+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:58:52.020221+0000","last_peered":"2024-09-10T05:58:52.020221+0000","last_clean":"2024-09-10T05:58:52.020221+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:58:52.020221+0000","last_undegraded":"2024-09-10T05:58:52.020221+0000","last_fullsized":"2024-09-10T05:58:52.020221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024294+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:58:52.024294+0000","last_peered":"2024-09-10T05:58:52.024294+0000","last_clean":"2024-09-10T05:58:52.024294+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:58:52.024294+0000","last_undegraded":"2024-09-10T05:58:52.024294+0000","last_fullsized":"2024-09-10T05:58:52.024294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022136+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:58:52.022136+0000","last_peered":"2024-09-10T05:58:52.022136+0000","last_clean":"2024-09-10T05:58:52.022136+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:58:52.022136+0000","last_undegraded":"2024-09-10T05:58:52.022136+0000","last_fullsized":"2024-09-10T05:58:52.022136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020427+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:58:52.020427+0000","last_peered":"2024-09-10T05:58:52.020427+0000","last_clean":"2024-09-10T05:58:52.020427+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:58:52.020427+0000","last_undegraded":"2024-09-10T05:58:52.020427+0000","last_fullsized":"2024-09-10T05:58:52.020427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"111'134","reported_seq":382,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236780+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:58:51.236780+0000","last_peered":"2024-09-10T05:58:51.236780+0000","last_clean":"2024-09-10T05:58:51.236780+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:58:51.236780+0000","last_undegraded":"2024-09-10T05:58:51.236780+0000","last_fullsized":"2024-09-10T05:58:51.236780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024022+0000","last_change":"2024-09-10T05:58:40.566181+0000","last_active":"2024-09-10T05:58:52.024022+0000","last_peered":"2024-09-10T05:58:52.024022+0000","last_clean":"2024-09-10T05:58:52.024022+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:58:52.024022+0000","last_undegraded":"2024-09-10T05:58:52.024022+0000","last_fullsized":"2024-09-10T05:58:52.024022+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.161299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019489+0000","last_change":"2024-09-10T05:58:38.725304+0000","last_active":"2024-09-10T05:58:52.019489+0000","last_peered":"2024-09-10T05:58:52.019489+0000","last_clean":"2024-09-10T05:58:52.019489+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:58:52.019489+0000","last_undegraded":"2024-09-10T05:58:52.019489+0000","last_fullsized":"2024-09-10T05:58:52.019489+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:37.191390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'22","reported_seq":86,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024135+0000","last_change":"2024-09-10T05:58:41.098579+0000","last_active":"2024-09-10T05:58:52.024135+0000","last_peered":"2024-09-10T05:58:52.024135+0000","last_clean":"2024-09-10T05:58:52.024135+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:58:52.024135+0000","last_undegraded":"2024-09-10T05:58:52.024135+0000","last_fullsized":"2024-09-10T05:58:52.024135+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:26.154411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021066+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:58:52.021066+0000","last_peered":"2024-09-10T05:58:52.021066+0000","last_clean":"2024-09-10T05:58:52.021066+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:58:52.021066+0000","last_undegraded":"2024-09-10T05:58:52.021066+0000","last_fullsized":"2024-09-10T05:58:52.021066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":238,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177207+0000","last_change":"2024-09-10T05:58:36.065339+0000","last_active":"2024-09-10T05:58:51.177207+0000","last_peered":"2024-09-10T05:58:51.177207+0000","last_clean":"2024-09-10T05:58:51.177207+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:58:51.177207+0000","last_undegraded":"2024-09-10T05:58:51.177207+0000","last_fullsized":"2024-09-10T05:58:51.177207+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:58.311550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":317,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178047+0000","last_change":"2024-09-10T05:58:39.400842+0000","last_active":"2024-09-10T05:58:51.178047+0000","last_peered":"2024-09-10T05:58:51.178047+0000","last_clean":"2024-09-10T05:58:51.178047+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:58:51.178047+0000","last_undegraded":"2024-09-10T05:58:51.178047+0000","last_fullsized":"2024-09-10T05:58:51.178047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:57.886787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"122'141","reported_seq":316,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022821+0000","last_change":"2024-09-10T05:58:42.102476+0000","last_active":"2024-09-10T05:58:52.022821+0000","last_peered":"2024-09-10T05:58:52.022821+0000","last_clean":"2024-09-10T05:58:52.022821+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:58:52.022821+0000","last_undegraded":"2024-09-10T05:58:52.022821+0000","last_fullsized":"2024-09-10T05:58:52.022821+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:33.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":227,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180768+0000","last_change":"2024-09-10T05:58:36.071317+0000","last_active":"2024-09-10T05:58:51.180768+0000","last_peered":"2024-09-10T05:58:51.180768+0000","last_clean":"2024-09-10T05:58:51.180768+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:58:51.180768+0000","last_undegraded":"2024-09-10T05:58:51.180768+0000","last_fullsized":"2024-09-10T05:58:51.180768+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:36.078639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177452+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:58:51.177452+0000","last_peered":"2024-09-10T05:58:51.177452+0000","last_clean":"2024-09-10T05:58:51.177452+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:58:51.177452+0000","last_undegraded":"2024-09-10T05:58:51.177452+0000","last_fullsized":"2024-09-10T05:58:51.177452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'21","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.182189+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:58:51.182189+0000","last_peered":"2024-09-10T05:58:51.182189+0000","last_clean":"2024-09-10T05:58:51.182189+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:58:51.182189+0000","last_undegraded":"2024-09-10T05:58:51.182189+0000","last_fullsized":"2024-09-10T05:58:51.182189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024970+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:58:52.024970+0000","last_peered":"2024-09-10T05:58:52.024970+0000","last_clean":"2024-09-10T05:58:52.024970+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:58:52.024970+0000","last_undegraded":"2024-09-10T05:58:52.024970+0000","last_fullsized":"2024-09-10T05:58:52.024970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019774+0000","last_change":"2024-09-10T05:58:36.083175+0000","last_active":"2024-09-10T05:58:52.019774+0000","last_peered":"2024-09-10T05:58:52.019774+0000","last_clean":"2024-09-10T05:58:52.019774+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:58:52.019774+0000","last_undegraded":"2024-09-10T05:58:52.019774+0000","last_fullsized":"2024-09-10T05:58:52.019774+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:50.357709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"111'50","reported_seq":285,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021486+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:58:52.021486+0000","last_peered":"2024-09-10T05:58:52.021486+0000","last_clean":"2024-09-10T05:58:52.021486+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:58:52.021486+0000","last_undegraded":"2024-09-10T05:58:52.021486+0000","last_fullsized":"2024-09-10T05:58:52.021486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020885+0000","last_change":"2024-09-10T05:58:36.068927+0000","last_active":"2024-09-10T05:58:52.020885+0000","last_peered":"2024-09-10T05:58:52.020885+0000","last_clean":"2024-09-10T05:58:52.020885+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:58:52.020885+0000","last_undegraded":"2024-09-10T05:58:52.020885+0000","last_fullsized":"2024-09-10T05:58:52.020885+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:34.118740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236794+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:58:51.236794+0000","last_peered":"2024-09-10T05:58:51.236794+0000","last_clean":"2024-09-10T05:58:51.236794+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:58:51.236794+0000","last_undegraded":"2024-09-10T05:58:51.236794+0000","last_fullsized":"2024-09-10T05:58:51.236794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181091+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:58:51.181091+0000","last_peered":"2024-09-10T05:58:51.181091+0000","last_clean":"2024-09-10T05:58:51.181091+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:58:51.181091+0000","last_undegraded":"2024-09-10T05:58:51.181091+0000","last_fullsized":"2024-09-10T05:58:51.181091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":240,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177962+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:58:51.177962+0000","last_peered":"2024-09-10T05:58:51.177962+0000","last_clean":"2024-09-10T05:58:51.177962+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:58:51.177962+0000","last_undegraded":"2024-09-10T05:58:51.177962+0000","last_fullsized":"2024-09-10T05:58:51.177962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'26","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178504+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:58:51.178504+0000","last_peered":"2024-09-10T05:58:51.178504+0000","last_clean":"2024-09-10T05:58:51.178504+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:58:51.178504+0000","last_undegraded":"2024-09-10T05:58:51.178504+0000","last_fullsized":"2024-09-10T05:58:51.178504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019957+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:58:52.019957+0000","last_peered":"2024-09-10T05:58:52.019957+0000","last_clean":"2024-09-10T05:58:52.019957+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:58:52.019957+0000","last_undegraded":"2024-09-10T05:58:52.019957+0000","last_fullsized":"2024-09-10T05:58:52.019957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"111'26","reported_seq":54,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020527+0000","last_change":"2024-09-10T05:58:36.101085+0000","last_active":"2024-09-10T05:58:52.020527+0000","last_peered":"2024-09-10T05:58:52.020527+0000","last_clean":"2024-09-10T05:58:52.020527+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:58:52.020527+0000","last_undegraded":"2024-09-10T05:58:52.020527+0000","last_fullsized":"2024-09-10T05:58:52.020527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:36.463324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019084+0000","last_change":"2024-09-10T05:58:36.083554+0000","last_active":"2024-09-10T05:58:52.019084+0000","last_peered":"2024-09-10T05:58:52.019084+0000","last_clean":"2024-09-10T05:58:52.019084+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:58:52.019084+0000","last_undegraded":"2024-09-10T05:58:52.019084+0000","last_fullsized":"2024-09-10T05:58:52.019084+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:47.211919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022829+0000","last_change":"2024-09-10T05:58:36.106761+0000","last_active":"2024-09-10T05:58:52.022829+0000","last_peered":"2024-09-10T05:58:52.022829+0000","last_clean":"2024-09-10T05:58:52.022829+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:58:52.022829+0000","last_undegraded":"2024-09-10T05:58:52.022829+0000","last_fullsized":"2024-09-10T05:58:52.022829+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:44.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":240,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019852+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:58:52.019852+0000","last_peered":"2024-09-10T05:58:52.019852+0000","last_clean":"2024-09-10T05:58:52.019852+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:58:52.019852+0000","last_undegraded":"2024-09-10T05:58:52.019852+0000","last_fullsized":"2024-09-10T05:58:52.019852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'25","reported_seq":337,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023868+0000","last_change":"2024-09-10T05:58:36.704691+0000","last_active":"2024-09-10T05:58:52.023868+0000","last_peered":"2024-09-10T05:58:52.023868+0000","last_clean":"2024-09-10T05:58:52.023868+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:58:52.023868+0000","last_undegraded":"2024-09-10T05:58:52.023868+0000","last_fullsized":"2024-09-10T05:58:52.023868+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:15.480906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022386+0000","last_change":"2024-09-10T05:58:36.087688+0000","last_active":"2024-09-10T05:58:52.022386+0000","last_peered":"2024-09-10T05:58:52.022386+0000","last_clean":"2024-09-10T05:58:52.022386+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:58:52.022386+0000","last_undegraded":"2024-09-10T05:58:52.022386+0000","last_fullsized":"2024-09-10T05:58:52.022386+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:11.802961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'10","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180035+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:58:51.180035+0000","last_peered":"2024-09-10T05:58:51.180035+0000","last_clean":"2024-09-10T05:58:51.180035+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:58:51.180035+0000","last_undegraded":"2024-09-10T05:58:51.180035+0000","last_fullsized":"2024-09-10T05:58:51.180035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020559+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:58:52.020559+0000","last_peered":"2024-09-10T05:58:52.020559+0000","last_clean":"2024-09-10T05:58:52.020559+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:58:52.020559+0000","last_undegraded":"2024-09-10T05:58:52.020559+0000","last_fullsized":"2024-09-10T05:58:52.020559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180457+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:58:51.180457+0000","last_peered":"2024-09-10T05:58:51.180457+0000","last_clean":"2024-09-10T05:58:51.180457+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:58:51.180457+0000","last_undegraded":"2024-09-10T05:58:51.180457+0000","last_fullsized":"2024-09-10T05:58:51.180457+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":48,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020434+0000","last_change":"2024-09-10T05:58:36.104832+0000","last_active":"2024-09-10T05:58:52.020434+0000","last_peered":"2024-09-10T05:58:52.020434+0000","last_clean":"2024-09-10T05:58:52.020434+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:58:52.020434+0000","last_undegraded":"2024-09-10T05:58:52.020434+0000","last_fullsized":"2024-09-10T05:58:52.020434+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:15.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'23","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238235+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:58:51.238235+0000","last_peered":"2024-09-10T05:58:51.238235+0000","last_clean":"2024-09-10T05:58:51.238235+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:58:51.238235+0000","last_undegraded":"2024-09-10T05:58:51.238235+0000","last_fullsized":"2024-09-10T05:58:51.238235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019710+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:58:52.019710+0000","last_peered":"2024-09-10T05:58:52.019710+0000","last_clean":"2024-09-10T05:58:52.019710+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:58:52.019710+0000","last_undegraded":"2024-09-10T05:58:52.019710+0000","last_fullsized":"2024-09-10T05:58:52.019710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"111'21","reported_seq":52,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022484+0000","last_change":"2024-09-10T05:58:41.135121+0000","last_active":"2024-09-10T05:58:52.022484+0000","last_peered":"2024-09-10T05:58:52.022484+0000","last_clean":"2024-09-10T05:58:52.022484+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:58:52.022484+0000","last_undegraded":"2024-09-10T05:58:52.022484+0000","last_fullsized":"2024-09-10T05:58:52.022484+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:59.259766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021225+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:58:52.021225+0000","last_peered":"2024-09-10T05:58:52.021225+0000","last_clean":"2024-09-10T05:58:52.021225+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:58:52.021225+0000","last_undegraded":"2024-09-10T05:58:52.021225+0000","last_fullsized":"2024-09-10T05:58:52.021225+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236308+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:58:51.236308+0000","last_peered":"2024-09-10T05:58:51.236308+0000","last_clean":"2024-09-10T05:58:51.236308+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:58:51.236308+0000","last_undegraded":"2024-09-10T05:58:51.236308+0000","last_fullsized":"2024-09-10T05:58:51.236308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019262+0000","last_change":"2024-09-10T05:58:41.614433+0000","last_active":"2024-09-10T05:58:52.019262+0000","last_peered":"2024-09-10T05:58:52.019262+0000","last_clean":"2024-09-10T05:58:52.019262+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:58:52.019262+0000","last_undegraded":"2024-09-10T05:58:52.019262+0000","last_fullsized":"2024-09-10T05:58:52.019262+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:59.859364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'30","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181683+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:58:51.181683+0000","last_peered":"2024-09-10T05:58:51.181683+0000","last_clean":"2024-09-10T05:58:51.181683+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:58:51.181683+0000","last_undegraded":"2024-09-10T05:58:51.181683+0000","last_fullsized":"2024-09-10T05:58:51.181683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021240+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:58:52.021240+0000","last_peered":"2024-09-10T05:58:52.021240+0000","last_clean":"2024-09-10T05:58:52.021240+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:58:52.021240+0000","last_undegraded":"2024-09-10T05:58:52.021240+0000","last_fullsized":"2024-09-10T05:58:52.021240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"111'17","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020563+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:58:52.020563+0000","last_peered":"2024-09-10T05:58:52.020563+0000","last_clean":"2024-09-10T05:58:52.020563+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:58:52.020563+0000","last_undegraded":"2024-09-10T05:58:52.020563+0000","last_fullsized":"2024-09-10T05:58:52.020563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180107+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:58:51.180107+0000","last_peered":"2024-09-10T05:58:51.180107+0000","last_clean":"2024-09-10T05:58:51.180107+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:58:51.180107+0000","last_undegraded":"2024-09-10T05:58:51.180107+0000","last_fullsized":"2024-09-10T05:58:51.180107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024846+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:58:52.024846+0000","last_peered":"2024-09-10T05:58:52.024846+0000","last_clean":"2024-09-10T05:58:52.024846+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:58:52.024846+0000","last_undegraded":"2024-09-10T05:58:52.024846+0000","last_fullsized":"2024-09-10T05:58:52.024846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":92,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019349+0000","last_change":"2024-09-10T05:58:39.178040+0000","last_active":"2024-09-10T05:58:52.019349+0000","last_peered":"2024-09-10T05:58:52.019349+0000","last_clean":"2024-09-10T05:58:52.019349+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:58:52.019349+0000","last_undegraded":"2024-09-10T05:58:52.019349+0000","last_fullsized":"2024-09-10T05:58:52.019349+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:03.677156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181404+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:58:51.181404+0000","last_peered":"2024-09-10T05:58:51.181404+0000","last_clean":"2024-09-10T05:58:51.181404+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:58:51.181404+0000","last_undegraded":"2024-09-10T05:58:51.181404+0000","last_fullsized":"2024-09-10T05:58:51.181404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"111'38","reported_seq":265,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020365+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:58:52.020365+0000","last_peered":"2024-09-10T05:58:52.020365+0000","last_clean":"2024-09-10T05:58:52.020365+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:58:52.020365+0000","last_undegraded":"2024-09-10T05:58:52.020365+0000","last_fullsized":"2024-09-10T05:58:52.020365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236696+0000","last_change":"2024-09-10T05:58:36.082148+0000","last_active":"2024-09-10T05:58:51.236696+0000","last_peered":"2024-09-10T05:58:51.236696+0000","last_clean":"2024-09-10T05:58:51.236696+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:58:51.236696+0000","last_undegraded":"2024-09-10T05:58:51.236696+0000","last_fullsized":"2024-09-10T05:58:51.236696+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:32.319630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022296+0000","last_change":"2024-09-10T05:58:36.090193+0000","last_active":"2024-09-10T05:58:52.022296+0000","last_peered":"2024-09-10T05:58:52.022296+0000","last_clean":"2024-09-10T05:58:52.022296+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:58:52.022296+0000","last_undegraded":"2024-09-10T05:58:52.022296+0000","last_fullsized":"2024-09-10T05:58:52.022296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:35.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":227,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181739+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:58:51.181739+0000","last_peered":"2024-09-10T05:58:51.181739+0000","last_clean":"2024-09-10T05:58:51.181739+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:58:51.181739+0000","last_undegraded":"2024-09-10T05:58:51.181739+0000","last_fullsized":"2024-09-10T05:58:51.181739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'25","reported_seq":341,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021132+0000","last_change":"2024-09-10T05:58:38.989267+0000","last_active":"2024-09-10T05:58:52.021132+0000","last_peered":"2024-09-10T05:58:52.021132+0000","last_clean":"2024-09-10T05:58:52.021132+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:58:52.021132+0000","last_undegraded":"2024-09-10T05:58:52.021132+0000","last_fullsized":"2024-09-10T05:58:52.021132+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:54.603097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024628+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:58:52.024628+0000","last_peered":"2024-09-10T05:58:52.024628+0000","last_clean":"2024-09-10T05:58:52.024628+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:58:52.024628+0000","last_undegraded":"2024-09-10T05:58:52.024628+0000","last_fullsized":"2024-09-10T05:58:52.024628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"111'23","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021623+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:58:52.021623+0000","last_peered":"2024-09-10T05:58:52.021623+0000","last_clean":"2024-09-10T05:58:52.021623+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:58:52.021623+0000","last_undegraded":"2024-09-10T05:58:52.021623+0000","last_fullsized":"2024-09-10T05:58:52.021623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020566+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:58:52.020566+0000","last_peered":"2024-09-10T05:58:52.020566+0000","last_clean":"2024-09-10T05:58:52.020566+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:58:52.020566+0000","last_undegraded":"2024-09-10T05:58:52.020566+0000","last_fullsized":"2024-09-10T05:58:52.020566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020836+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:58:52.020836+0000","last_peered":"2024-09-10T05:58:52.020836+0000","last_clean":"2024-09-10T05:58:52.020836+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:58:52.020836+0000","last_undegraded":"2024-09-10T05:58:52.020836+0000","last_fullsized":"2024-09-10T05:58:52.020836+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022424+0000","last_change":"2024-09-10T05:58:36.755598+0000","last_active":"2024-09-10T05:58:52.022424+0000","last_peered":"2024-09-10T05:58:52.022424+0000","last_clean":"2024-09-10T05:58:52.022424+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:58:52.022424+0000","last_undegraded":"2024-09-10T05:58:52.022424+0000","last_fullsized":"2024-09-10T05:58:52.022424+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:58.858812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'19","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178487+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:58:51.178487+0000","last_peered":"2024-09-10T05:58:51.178487+0000","last_clean":"2024-09-10T05:58:51.178487+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:58:51.178487+0000","last_undegraded":"2024-09-10T05:58:51.178487+0000","last_fullsized":"2024-09-10T05:58:51.178487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":344,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179886+0000","last_change":"2024-09-10T05:58:40.731017+0000","last_active":"2024-09-10T05:58:51.179886+0000","last_peered":"2024-09-10T05:58:51.179886+0000","last_clean":"2024-09-10T05:58:51.179886+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:58:51.179886+0000","last_undegraded":"2024-09-10T05:58:51.179886+0000","last_fullsized":"2024-09-10T05:58:51.179886+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:36.888425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"111'28","reported_seq":54,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023828+0000","last_change":"2024-09-10T05:58:41.114451+0000","last_active":"2024-09-10T05:58:52.023828+0000","last_peered":"2024-09-10T05:58:52.023828+0000","last_clean":"2024-09-10T05:58:52.023828+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:58:52.023828+0000","last_undegraded":"2024-09-10T05:58:52.023828+0000","last_fullsized":"2024-09-10T05:58:52.023828+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:53.586626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62802,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":230,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020254+0000","last_change":"2024-09-10T05:58:36.073669+0000","last_active":"2024-09-10T05:58:52.020254+0000","last_peered":"2024-09-10T05:58:52.020254+0000","last_clean":"2024-09-10T05:58:52.020254+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:58:52.020254+0000","last_undegraded":"2024-09-10T05:58:52.020254+0000","last_fullsized":"2024-09-10T05:58:52.020254+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.770687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235996+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:58:51.235996+0000","last_peered":"2024-09-10T05:58:51.235996+0000","last_clean":"2024-09-10T05:58:51.235996+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:58:51.235996+0000","last_undegraded":"2024-09-10T05:58:51.235996+0000","last_fullsized":"2024-09-10T05:58:51.235996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019788+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:58:52.019788+0000","last_peered":"2024-09-10T05:58:52.019788+0000","last_clean":"2024-09-10T05:58:52.019788+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:58:52.019788+0000","last_undegraded":"2024-09-10T05:58:52.019788+0000","last_fullsized":"2024-09-10T05:58:52.019788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'26","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180125+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:58:51.180125+0000","last_peered":"2024-09-10T05:58:51.180125+0000","last_clean":"2024-09-10T05:58:51.180125+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:58:51.180125+0000","last_undegraded":"2024-09-10T05:58:51.180125+0000","last_fullsized":"2024-09-10T05:58:51.180125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021577+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:58:52.021577+0000","last_peered":"2024-09-10T05:58:52.021577+0000","last_clean":"2024-09-10T05:58:52.021577+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:58:52.021577+0000","last_undegraded":"2024-09-10T05:58:52.021577+0000","last_fullsized":"2024-09-10T05:58:52.021577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178939+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:58:51.178939+0000","last_peered":"2024-09-10T05:58:51.178939+0000","last_clean":"2024-09-10T05:58:51.178939+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:58:51.178939+0000","last_undegraded":"2024-09-10T05:58:51.178939+0000","last_fullsized":"2024-09-10T05:58:51.178939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"111'134","reported_seq":382,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024122+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:58:52.024122+0000","last_peered":"2024-09-10T05:58:52.024122+0000","last_clean":"2024-09-10T05:58:52.024122+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:58:52.024122+0000","last_undegraded":"2024-09-10T05:58:52.024122+0000","last_fullsized":"2024-09-10T05:58:52.024122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":212,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019718+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:58:52.019718+0000","last_peered":"2024-09-10T05:58:52.019718+0000","last_clean":"2024-09-10T05:58:52.019718+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:58:52.019718+0000","last_undegraded":"2024-09-10T05:58:52.019718+0000","last_fullsized":"2024-09-10T05:58:52.019718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":270,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177680+0000","last_change":"2024-09-10T05:58:40.129243+0000","last_active":"2024-09-10T05:58:51.177680+0000","last_peered":"2024-09-10T05:58:51.177680+0000","last_clean":"2024-09-10T05:58:51.177680+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:58:51.177680+0000","last_undegraded":"2024-09-10T05:58:51.177680+0000","last_fullsized":"2024-09-10T05:58:51.177680+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:22.831721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'17","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237316+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:58:51.237316+0000","last_peered":"2024-09-10T05:58:51.237316+0000","last_clean":"2024-09-10T05:58:51.237316+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:58:51.237316+0000","last_undegraded":"2024-09-10T05:58:51.237316+0000","last_fullsized":"2024-09-10T05:58:51.237316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020828+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:58:52.020828+0000","last_peered":"2024-09-10T05:58:52.020828+0000","last_clean":"2024-09-10T05:58:52.020828+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:58:52.020828+0000","last_undegraded":"2024-09-10T05:58:52.020828+0000","last_fullsized":"2024-09-10T05:58:52.020828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"111'48","reported_seq":293,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236290+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:58:51.236290+0000","last_peered":"2024-09-10T05:58:51.236290+0000","last_clean":"2024-09-10T05:58:51.236290+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:58:51.236290+0000","last_undegraded":"2024-09-10T05:58:51.236290+0000","last_fullsized":"2024-09-10T05:58:51.236290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":64,"num_read_kb":51,"num_write":42,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177538+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:58:51.177538+0000","last_peered":"2024-09-10T05:58:51.177538+0000","last_clean":"2024-09-10T05:58:51.177538+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:58:51.177538+0000","last_undegraded":"2024-09-10T05:58:51.177538+0000","last_fullsized":"2024-09-10T05:58:51.177538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":204,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023234+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:58:52.023234+0000","last_peered":"2024-09-10T05:58:52.023234+0000","last_clean":"2024-09-10T05:58:52.023234+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:58:52.023234+0000","last_undegraded":"2024-09-10T05:58:52.023234+0000","last_fullsized":"2024-09-10T05:58:52.023234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":289,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178127+0000","last_change":"2024-09-10T05:58:37.200455+0000","last_active":"2024-09-10T05:58:51.178127+0000","last_peered":"2024-09-10T05:58:51.178127+0000","last_clean":"2024-09-10T05:58:51.178127+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:58:51.178127+0000","last_undegraded":"2024-09-10T05:58:51.178127+0000","last_fullsized":"2024-09-10T05:58:51.178127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.815795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'23","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238244+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:58:51.238244+0000","last_peered":"2024-09-10T05:58:51.238244+0000","last_clean":"2024-09-10T05:58:51.238244+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:58:51.238244+0000","last_undegraded":"2024-09-10T05:58:51.238244+0000","last_fullsized":"2024-09-10T05:58:51.238244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236546+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:58:51.236546+0000","last_peered":"2024-09-10T05:58:51.236546+0000","last_clean":"2024-09-10T05:58:51.236546+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:58:51.236546+0000","last_undegraded":"2024-09-10T05:58:51.236546+0000","last_fullsized":"2024-09-10T05:58:51.236546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"111'23","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177550+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:58:51.177550+0000","last_peered":"2024-09-10T05:58:51.177550+0000","last_clean":"2024-09-10T05:58:51.177550+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:58:51.177550+0000","last_undegraded":"2024-09-10T05:58:51.177550+0000","last_fullsized":"2024-09-10T05:58:51.177550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020725+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:58:52.020725+0000","last_peered":"2024-09-10T05:58:52.020725+0000","last_clean":"2024-09-10T05:58:52.020725+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:58:52.020725+0000","last_undegraded":"2024-09-10T05:58:52.020725+0000","last_fullsized":"2024-09-10T05:58:52.020725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022711+0000","last_change":"2024-09-10T05:58:36.751943+0000","last_active":"2024-09-10T05:58:52.022711+0000","last_peered":"2024-09-10T05:58:52.022711+0000","last_clean":"2024-09-10T05:58:52.022711+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:58:52.022711+0000","last_undegraded":"2024-09-10T05:58:52.022711+0000","last_fullsized":"2024-09-10T05:58:52.022711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:52.279125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020845+0000","last_change":"2024-09-10T05:58:36.760284+0000","last_active":"2024-09-10T05:58:52.020845+0000","last_peered":"2024-09-10T05:58:52.020845+0000","last_clean":"2024-09-10T05:58:52.020845+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:58:52.020845+0000","last_undegraded":"2024-09-10T05:58:52.020845+0000","last_fullsized":"2024-09-10T05:58:52.020845+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:27.695656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'30","reported_seq":102,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022587+0000","last_change":"2024-09-10T05:58:36.748201+0000","last_active":"2024-09-10T05:58:52.022587+0000","last_peered":"2024-09-10T05:58:52.022587+0000","last_clean":"2024-09-10T05:58:52.022587+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:58:52.022587+0000","last_undegraded":"2024-09-10T05:58:52.022587+0000","last_fullsized":"2024-09-10T05:58:52.022587+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.304252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.176836+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:58:51.176836+0000","last_peered":"2024-09-10T05:58:51.176836+0000","last_clean":"2024-09-10T05:58:51.176836+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:58:51.176836+0000","last_undegraded":"2024-09-10T05:58:51.176836+0000","last_fullsized":"2024-09-10T05:58:51.176836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"111'19","reported_seq":48,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022173+0000","last_change":"2024-09-10T05:58:42.032681+0000","last_active":"2024-09-10T05:58:52.022173+0000","last_peered":"2024-09-10T05:58:52.022173+0000","last_clean":"2024-09-10T05:58:52.022173+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:58:52.022173+0000","last_undegraded":"2024-09-10T05:58:52.022173+0000","last_fullsized":"2024-09-10T05:58:52.022173+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:11.388502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177156+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:58:51.177156+0000","last_peered":"2024-09-10T05:58:51.177156+0000","last_clean":"2024-09-10T05:58:51.177156+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:58:51.177156+0000","last_undegraded":"2024-09-10T05:58:51.177156+0000","last_fullsized":"2024-09-10T05:58:51.177156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023184+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:58:52.023184+0000","last_peered":"2024-09-10T05:58:52.023184+0000","last_clean":"2024-09-10T05:58:52.023184+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:58:52.023184+0000","last_undegraded":"2024-09-10T05:58:52.023184+0000","last_fullsized":"2024-09-10T05:58:52.023184+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177337+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:58:51.177337+0000","last_peered":"2024-09-10T05:58:51.177337+0000","last_clean":"2024-09-10T05:58:51.177337+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:58:51.177337+0000","last_undegraded":"2024-09-10T05:58:51.177337+0000","last_fullsized":"2024-09-10T05:58:51.177337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'25","reported_seq":210,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019341+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:58:52.019341+0000","last_peered":"2024-09-10T05:58:52.019341+0000","last_clean":"2024-09-10T05:58:52.019341+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:58:52.019341+0000","last_undegraded":"2024-09-10T05:58:52.019341+0000","last_fullsized":"2024-09-10T05:58:52.019341+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020591+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:58:52.020591+0000","last_peered":"2024-09-10T05:58:52.020591+0000","last_clean":"2024-09-10T05:58:52.020591+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:58:52.020591+0000","last_undegraded":"2024-09-10T05:58:52.020591+0000","last_fullsized":"2024-09-10T05:58:52.020591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"111'30","reported_seq":259,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177568+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:58:51.177568+0000","last_peered":"2024-09-10T05:58:51.177568+0000","last_clean":"2024-09-10T05:58:51.177568+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:58:51.177568+0000","last_undegraded":"2024-09-10T05:58:51.177568+0000","last_fullsized":"2024-09-10T05:58:51.177568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179764+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:58:51.179764+0000","last_peered":"2024-09-10T05:58:51.179764+0000","last_clean":"2024-09-10T05:58:51.179764+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:58:51.179764+0000","last_undegraded":"2024-09-10T05:58:51.179764+0000","last_fullsized":"2024-09-10T05:58:51.179764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179999+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:58:51.179999+0000","last_peered":"2024-09-10T05:58:51.179999+0000","last_clean":"2024-09-10T05:58:51.179999+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:58:51.179999+0000","last_undegraded":"2024-09-10T05:58:51.179999+0000","last_fullsized":"2024-09-10T05:58:51.179999+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020418+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:58:52.020418+0000","last_peered":"2024-09-10T05:58:52.020418+0000","last_clean":"2024-09-10T05:58:52.020418+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:58:52.020418+0000","last_undegraded":"2024-09-10T05:58:52.020418+0000","last_fullsized":"2024-09-10T05:58:52.020418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'30","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020899+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:58:52.020899+0000","last_peered":"2024-09-10T05:58:52.020899+0000","last_clean":"2024-09-10T05:58:52.020899+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:58:52.020899+0000","last_undegraded":"2024-09-10T05:58:52.020899+0000","last_fullsized":"2024-09-10T05:58:52.020899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020829+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:58:52.020829+0000","last_peered":"2024-09-10T05:58:52.020829+0000","last_clean":"2024-09-10T05:58:52.020829+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:58:52.020829+0000","last_undegraded":"2024-09-10T05:58:52.020829+0000","last_fullsized":"2024-09-10T05:58:52.020829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018586+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:58:52.018586+0000","last_peered":"2024-09-10T05:58:52.018586+0000","last_clean":"2024-09-10T05:58:52.018586+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:58:52.018586+0000","last_undegraded":"2024-09-10T05:58:52.018586+0000","last_fullsized":"2024-09-10T05:58:52.018586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237561+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:58:51.237561+0000","last_peered":"2024-09-10T05:58:51.237561+0000","last_clean":"2024-09-10T05:58:51.237561+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:58:51.237561+0000","last_undegraded":"2024-09-10T05:58:51.237561+0000","last_fullsized":"2024-09-10T05:58:51.237561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":317,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237541+0000","last_change":"2024-09-10T05:58:37.753575+0000","last_active":"2024-09-10T05:58:51.237541+0000","last_peered":"2024-09-10T05:58:51.237541+0000","last_clean":"2024-09-10T05:58:51.237541+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:58:51.237541+0000","last_undegraded":"2024-09-10T05:58:51.237541+0000","last_fullsized":"2024-09-10T05:58:51.237541+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:21.191915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021181+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:58:52.021181+0000","last_peered":"2024-09-10T05:58:52.021181+0000","last_clean":"2024-09-10T05:58:52.021181+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:58:52.021181+0000","last_undegraded":"2024-09-10T05:58:52.021181+0000","last_fullsized":"2024-09-10T05:58:52.021181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'22","reported_seq":325,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180472+0000","last_change":"2024-09-10T05:58:38.431996+0000","last_active":"2024-09-10T05:58:51.180472+0000","last_peered":"2024-09-10T05:58:51.180472+0000","last_clean":"2024-09-10T05:58:51.180472+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:58:51.180472+0000","last_undegraded":"2024-09-10T05:58:51.180472+0000","last_fullsized":"2024-09-10T05:58:51.180472+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.662612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179378+0000","last_change":"2024-09-10T05:58:40.123148+0000","last_active":"2024-09-10T05:58:51.179378+0000","last_peered":"2024-09-10T05:58:51.179378+0000","last_clean":"2024-09-10T05:58:51.179378+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:58:51.179378+0000","last_undegraded":"2024-09-10T05:58:51.179378+0000","last_fullsized":"2024-09-10T05:58:51.179378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:28.445530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"111'30","reported_seq":102,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022628+0000","last_change":"2024-09-10T05:58:37.278065+0000","last_active":"2024-09-10T05:58:52.022628+0000","last_peered":"2024-09-10T05:58:52.022628+0000","last_clean":"2024-09-10T05:58:52.022628+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:58:52.022628+0000","last_undegraded":"2024-09-10T05:58:52.022628+0000","last_fullsized":"2024-09-10T05:58:52.022628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:23.616575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":256,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178428+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:58:51.178428+0000","last_peered":"2024-09-10T05:58:51.178428+0000","last_clean":"2024-09-10T05:58:51.178428+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:58:51.178428+0000","last_undegraded":"2024-09-10T05:58:51.178428+0000","last_fullsized":"2024-09-10T05:58:51.178428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'28","reported_seq":348,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021693+0000","last_change":"2024-09-10T05:58:37.192873+0000","last_active":"2024-09-10T05:58:52.021693+0000","last_peered":"2024-09-10T05:58:52.021693+0000","last_clean":"2024-09-10T05:58:52.021693+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:58:52.021693+0000","last_undegraded":"2024-09-10T05:58:52.021693+0000","last_fullsized":"2024-09-10T05:58:52.021693+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.993383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020610+0000","last_change":"2024-09-10T05:58:36.076255+0000","last_active":"2024-09-10T05:58:52.020610+0000","last_peered":"2024-09-10T05:58:52.020610+0000","last_clean":"2024-09-10T05:58:52.020610+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:58:52.020610+0000","last_undegraded":"2024-09-10T05:58:52.020610+0000","last_fullsized":"2024-09-10T05:58:52.020610+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:20.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'19","reported_seq":242,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024498+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:58:52.024498+0000","last_peered":"2024-09-10T05:58:52.024498+0000","last_clean":"2024-09-10T05:58:52.024498+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:58:52.024498+0000","last_undegraded":"2024-09-10T05:58:52.024498+0000","last_fullsized":"2024-09-10T05:58:52.024498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020628+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:58:52.020628+0000","last_peered":"2024-09-10T05:58:52.020628+0000","last_clean":"2024-09-10T05:58:52.020628+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:58:52.020628+0000","last_undegraded":"2024-09-10T05:58:52.020628+0000","last_fullsized":"2024-09-10T05:58:52.020628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":84,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024047+0000","last_change":"2024-09-10T05:58:40.562955+0000","last_active":"2024-09-10T05:58:52.024047+0000","last_peered":"2024-09-10T05:58:52.024047+0000","last_clean":"2024-09-10T05:58:52.024047+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:58:52.024047+0000","last_undegraded":"2024-09-10T05:58:52.024047+0000","last_fullsized":"2024-09-10T05:58:52.024047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:55.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":259,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181598+0000","last_change":"2024-09-10T05:58:40.787117+0000","last_active":"2024-09-10T05:58:51.181598+0000","last_peered":"2024-09-10T05:58:51.181598+0000","last_clean":"2024-09-10T05:58:51.181598+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:58:51.181598+0000","last_undegraded":"2024-09-10T05:58:51.181598+0000","last_fullsized":"2024-09-10T05:58:51.181598+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:06.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'28","reported_seq":340,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236785+0000","last_change":"2024-09-10T05:58:40.117727+0000","last_active":"2024-09-10T05:58:51.236785+0000","last_peered":"2024-09-10T05:58:51.236785+0000","last_clean":"2024-09-10T05:58:51.236785+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:58:51.236785+0000","last_undegraded":"2024-09-10T05:58:51.236785+0000","last_fullsized":"2024-09-10T05:58:51.236785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:28.251854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":256,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179219+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:58:51.179219+0000","last_peered":"2024-09-10T05:58:51.179219+0000","last_clean":"2024-09-10T05:58:51.179219+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:58:51.179219+0000","last_undegraded":"2024-09-10T05:58:51.179219+0000","last_fullsized":"2024-09-10T05:58:51.179219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'21","reported_seq":84,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020759+0000","last_change":"2024-09-10T05:58:40.171208+0000","last_active":"2024-09-10T05:58:52.020759+0000","last_peered":"2024-09-10T05:58:52.020759+0000","last_clean":"2024-09-10T05:58:52.020759+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:58:52.020759+0000","last_undegraded":"2024-09-10T05:58:52.020759+0000","last_fullsized":"2024-09-10T05:58:52.020759+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:43.370109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":219,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019605+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:58:52.019605+0000","last_peered":"2024-09-10T05:58:52.019605+0000","last_clean":"2024-09-10T05:58:52.019605+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:58:52.019605+0000","last_undegraded":"2024-09-10T05:58:52.019605+0000","last_fullsized":"2024-09-10T05:58:52.019605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'33","reported_seq":256,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236910+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:58:51.236910+0000","last_peered":"2024-09-10T05:58:51.236910+0000","last_clean":"2024-09-10T05:58:51.236910+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:58:51.236910+0000","last_undegraded":"2024-09-10T05:58:51.236910+0000","last_fullsized":"2024-09-10T05:58:51.236910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179678+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:58:51.179678+0000","last_peered":"2024-09-10T05:58:51.179678+0000","last_clean":"2024-09-10T05:58:51.179678+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:58:51.179678+0000","last_undegraded":"2024-09-10T05:58:51.179678+0000","last_fullsized":"2024-09-10T05:58:51.179678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'18","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181119+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:58:51.181119+0000","last_peered":"2024-09-10T05:58:51.181119+0000","last_clean":"2024-09-10T05:58:51.181119+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:58:51.181119+0000","last_undegraded":"2024-09-10T05:58:51.181119+0000","last_fullsized":"2024-09-10T05:58:51.181119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":271,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021812+0000","last_change":"2024-09-10T05:58:38.090502+0000","last_active":"2024-09-10T05:58:52.021812+0000","last_peered":"2024-09-10T05:58:52.021812+0000","last_clean":"2024-09-10T05:58:52.021812+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:58:52.021812+0000","last_undegraded":"2024-09-10T05:58:52.021812+0000","last_fullsized":"2024-09-10T05:58:52.021812+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:56.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'21","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023463+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:58:52.023463+0000","last_peered":"2024-09-10T05:58:52.023463+0000","last_clean":"2024-09-10T05:58:52.023463+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:58:52.023463+0000","last_undegraded":"2024-09-10T05:58:52.023463+0000","last_fullsized":"2024-09-10T05:58:52.023463+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178395+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:58:51.178395+0000","last_peered":"2024-09-10T05:58:51.178395+0000","last_clean":"2024-09-10T05:58:51.178395+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:58:51.178395+0000","last_undegraded":"2024-09-10T05:58:51.178395+0000","last_fullsized":"2024-09-10T05:58:51.178395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'24","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024196+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:58:52.024196+0000","last_peered":"2024-09-10T05:58:52.024196+0000","last_clean":"2024-09-10T05:58:52.024196+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:58:52.024196+0000","last_undegraded":"2024-09-10T05:58:52.024196+0000","last_fullsized":"2024-09-10T05:58:52.024196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020972+0000","last_change":"2024-09-10T05:58:36.090342+0000","last_active":"2024-09-10T05:58:52.020972+0000","last_peered":"2024-09-10T05:58:52.020972+0000","last_clean":"2024-09-10T05:58:52.020972+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:58:52.020972+0000","last_undegraded":"2024-09-10T05:58:52.020972+0000","last_fullsized":"2024-09-10T05:58:52.020972+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:15.019257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"111'20","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019935+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:58:52.019935+0000","last_peered":"2024-09-10T05:58:52.019935+0000","last_clean":"2024-09-10T05:58:52.019935+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:58:52.019935+0000","last_undegraded":"2024-09-10T05:58:52.019935+0000","last_fullsized":"2024-09-10T05:58:52.019935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020118+0000","last_change":"2024-09-10T05:58:36.079403+0000","last_active":"2024-09-10T05:58:52.020118+0000","last_peered":"2024-09-10T05:58:52.020118+0000","last_clean":"2024-09-10T05:58:52.020118+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:58:52.020118+0000","last_undegraded":"2024-09-10T05:58:52.020118+0000","last_fullsized":"2024-09-10T05:58:52.020118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.025854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'25","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238469+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:58:51.238469+0000","last_peered":"2024-09-10T05:58:51.238469+0000","last_clean":"2024-09-10T05:58:51.238469+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:58:51.238469+0000","last_undegraded":"2024-09-10T05:58:51.238469+0000","last_fullsized":"2024-09-10T05:58:51.238469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"111'24","reported_seq":155,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018534+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:58:52.018534+0000","last_peered":"2024-09-10T05:58:52.018534+0000","last_clean":"2024-09-10T05:58:52.018534+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:58:52.018534+0000","last_undegraded":"2024-09-10T05:58:52.018534+0000","last_fullsized":"2024-09-10T05:58:52.018534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":275,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181443+0000","last_change":"2024-09-10T05:58:40.744836+0000","last_active":"2024-09-10T05:58:51.181443+0000","last_peered":"2024-09-10T05:58:51.181443+0000","last_clean":"2024-09-10T05:58:51.181443+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:58:51.181443+0000","last_undegraded":"2024-09-10T05:58:51.181443+0000","last_fullsized":"2024-09-10T05:58:51.181443+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'23","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020993+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:58:52.020993+0000","last_peered":"2024-09-10T05:58:52.020993+0000","last_clean":"2024-09-10T05:58:52.020993+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:58:52.020993+0000","last_undegraded":"2024-09-10T05:58:52.020993+0000","last_fullsized":"2024-09-10T05:58:52.020993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237966+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:58:51.237966+0000","last_peered":"2024-09-10T05:58:51.237966+0000","last_clean":"2024-09-10T05:58:51.237966+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:58:51.237966+0000","last_undegraded":"2024-09-10T05:58:51.237966+0000","last_fullsized":"2024-09-10T05:58:51.237966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1086,"ondisk_log_size":1086,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382933,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1132,"num_read_kb":862,"num_write":655,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":951,"ondisk_log_size":951,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1856104,"kb_used_data":1820756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92515736,"statfs":{"total":96636764160,"available":94736113664,"internally_reserved":0,"allocated":1864454144,"data_stored":1863774286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163296,"kb_used_data":1132104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93208544,"statfs":{"total":96636764160,"available":95445549056,"internally_reserved":0,"allocated":1159274496,"data_stored":1158607791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1816860,"kb_used_data":1781504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92554980,"statfs":{"total":96636764160,"available":94776299520,"internally_reserved":0,"allocated":1824260096,"data_stored":1823530013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542193,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693836,"kb_used_data":1658484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92678004,"statfs":{"total":96636764160,"available":94902276096,"internally_reserved":0,"allocated":1698287616,"data_stored":1697633854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542193,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1931324,"kb_used_data":1900136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92440516,"statfs":{"total":96636764160,"available":94659088384,"internally_reserved":0,"allocated":1945739264,"data_stored":1945048496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099864,"kb_used_data":1060356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93271976,"statfs":{"total":96636764160,"available":95510503424,"internally_reserved":0,"allocated":1085804544,"data_stored":1085155240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202588,"kb_used_data":1163076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93169252,"statfs":{"total":96636764160,"available":95405314048,"internally_reserved":0,"allocated":1190989824,"data_stored":1190297542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1841848,"kb_used_data":1802332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92529992,"statfs":{"total":96636764160,"available":94750711808,"internally_reserved":0,"allocated":1845587968,"data_stored":1844915572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1843396608,"data_stored":1843396608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1189085184,"data_stored":1189085184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1084227584,"data_stored":1084227584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1944059904,"data_stored":1944059904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1822425088,"data_stored":1822425088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1157627904,"data_stored":1157627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1862270976,"data_stored":1862270976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":59916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":117427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":177431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:58:54.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:58:55.111 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:58:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:58:55.126 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-10T05:58:53.727707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819944,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3465,"num_read_kb":3124,"num_write":2963,"num_write_kb":6187124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":852,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4056,"ondisk_log_size":4056,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12605720,"kb_used_data":12318748,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":742369000,"statfs":{"total":773094113280,"available":760185856000,"internally_reserved":0,"allocated":12614397952,"data_stored":12608962794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.593133"},"pg_stats":[{"pgid":"3.3f","version":"111'22","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022416+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:58:52.022416+0000","last_peered":"2024-09-10T05:58:52.022416+0000","last_clean":"2024-09-10T05:58:52.022416+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:58:52.022416+0000","last_undegraded":"2024-09-10T05:58:52.022416+0000","last_fullsized":"2024-09-10T05:58:52.022416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235978+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:58:51.235978+0000","last_peered":"2024-09-10T05:58:51.235978+0000","last_clean":"2024-09-10T05:58:51.235978+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:58:51.235978+0000","last_undegraded":"2024-09-10T05:58:51.235978+0000","last_fullsized":"2024-09-10T05:58:51.235978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'27","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020975+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:58:52.020975+0000","last_peered":"2024-09-10T05:58:52.020975+0000","last_clean":"2024-09-10T05:58:52.020975+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:58:52.020975+0000","last_undegraded":"2024-09-10T05:58:52.020975+0000","last_fullsized":"2024-09-10T05:58:52.020975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":255,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020787+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:58:52.020787+0000","last_peered":"2024-09-10T05:58:52.020787+0000","last_clean":"2024-09-10T05:58:52.020787+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:58:52.020787+0000","last_undegraded":"2024-09-10T05:58:52.020787+0000","last_fullsized":"2024-09-10T05:58:52.020787+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'27","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180817+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:58:51.180817+0000","last_peered":"2024-09-10T05:58:51.180817+0000","last_clean":"2024-09-10T05:58:51.180817+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:58:51.180817+0000","last_undegraded":"2024-09-10T05:58:51.180817+0000","last_fullsized":"2024-09-10T05:58:51.180817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177855+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:58:51.177855+0000","last_peered":"2024-09-10T05:58:51.177855+0000","last_clean":"2024-09-10T05:58:51.177855+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:58:51.177855+0000","last_undegraded":"2024-09-10T05:58:51.177855+0000","last_fullsized":"2024-09-10T05:58:51.177855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'21","reported_seq":320,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237271+0000","last_change":"2024-09-10T05:58:40.694618+0000","last_active":"2024-09-10T05:58:51.237271+0000","last_peered":"2024-09-10T05:58:51.237271+0000","last_clean":"2024-09-10T05:58:51.237271+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:58:51.237271+0000","last_undegraded":"2024-09-10T05:58:51.237271+0000","last_fullsized":"2024-09-10T05:58:51.237271+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:55.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":306,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180466+0000","last_change":"2024-09-10T05:58:40.726727+0000","last_active":"2024-09-10T05:58:51.180466+0000","last_peered":"2024-09-10T05:58:51.180466+0000","last_clean":"2024-09-10T05:58:51.180466+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:58:51.180466+0000","last_undegraded":"2024-09-10T05:58:51.180466+0000","last_fullsized":"2024-09-10T05:58:51.180466+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:59.972041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'29","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022246+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:58:52.022246+0000","last_peered":"2024-09-10T05:58:52.022246+0000","last_clean":"2024-09-10T05:58:52.022246+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:58:52.022246+0000","last_undegraded":"2024-09-10T05:58:52.022246+0000","last_fullsized":"2024-09-10T05:58:52.022246+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023310+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:58:52.023310+0000","last_peered":"2024-09-10T05:58:52.023310+0000","last_clean":"2024-09-10T05:58:52.023310+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:58:52.023310+0000","last_undegraded":"2024-09-10T05:58:52.023310+0000","last_fullsized":"2024-09-10T05:58:52.023310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'26","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236551+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:58:51.236551+0000","last_peered":"2024-09-10T05:58:51.236551+0000","last_clean":"2024-09-10T05:58:51.236551+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:58:51.236551+0000","last_undegraded":"2024-09-10T05:58:51.236551+0000","last_fullsized":"2024-09-10T05:58:51.236551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178955+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:58:51.178955+0000","last_peered":"2024-09-10T05:58:51.178955+0000","last_clean":"2024-09-10T05:58:51.178955+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:58:51.178955+0000","last_undegraded":"2024-09-10T05:58:51.178955+0000","last_fullsized":"2024-09-10T05:58:51.178955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'20","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021287+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:58:52.021287+0000","last_peered":"2024-09-10T05:58:52.021287+0000","last_clean":"2024-09-10T05:58:52.021287+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:58:52.021287+0000","last_undegraded":"2024-09-10T05:58:52.021287+0000","last_fullsized":"2024-09-10T05:58:52.021287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237498+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:58:51.237498+0000","last_peered":"2024-09-10T05:58:51.237498+0000","last_clean":"2024-09-10T05:58:51.237498+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:58:51.237498+0000","last_undegraded":"2024-09-10T05:58:51.237498+0000","last_fullsized":"2024-09-10T05:58:51.237498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'13","reported_seq":68,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019168+0000","last_change":"2024-09-10T05:58:42.015968+0000","last_active":"2024-09-10T05:58:52.019168+0000","last_peered":"2024-09-10T05:58:52.019168+0000","last_clean":"2024-09-10T05:58:52.019168+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:58:52.019168+0000","last_undegraded":"2024-09-10T05:58:52.019168+0000","last_fullsized":"2024-09-10T05:58:52.019168+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:22.893621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":260,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020150+0000","last_change":"2024-09-10T05:58:40.119708+0000","last_active":"2024-09-10T05:58:52.020150+0000","last_peered":"2024-09-10T05:58:52.020150+0000","last_clean":"2024-09-10T05:58:52.020150+0000","last_became_active":"2024-09-10T05:58:36.084726+0000","last_became_peered":"2024-09-10T05:58:36.084726+0000","last_unstale":"2024-09-10T05:58:52.020150+0000","last_undegraded":"2024-09-10T05:58:52.020150+0000","last_fullsized":"2024-09-10T05:58:52.020150+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:25:25.497531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":218,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177262+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:58:51.177262+0000","last_peered":"2024-09-10T05:58:51.177262+0000","last_clean":"2024-09-10T05:58:51.177262+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:58:51.177262+0000","last_undegraded":"2024-09-10T05:58:51.177262+0000","last_fullsized":"2024-09-10T05:58:51.177262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'19","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022699+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:58:52.022699+0000","last_peered":"2024-09-10T05:58:52.022699+0000","last_clean":"2024-09-10T05:58:52.022699+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:58:52.022699+0000","last_undegraded":"2024-09-10T05:58:52.022699+0000","last_fullsized":"2024-09-10T05:58:52.022699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":238,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021027+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:58:52.021027+0000","last_peered":"2024-09-10T05:58:52.021027+0000","last_clean":"2024-09-10T05:58:52.021027+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:58:52.021027+0000","last_undegraded":"2024-09-10T05:58:52.021027+0000","last_fullsized":"2024-09-10T05:58:52.021027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'25","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024235+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:58:52.024235+0000","last_peered":"2024-09-10T05:58:52.024235+0000","last_clean":"2024-09-10T05:58:52.024235+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:58:52.024235+0000","last_undegraded":"2024-09-10T05:58:52.024235+0000","last_fullsized":"2024-09-10T05:58:52.024235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236839+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:58:51.236839+0000","last_peered":"2024-09-10T05:58:51.236839+0000","last_clean":"2024-09-10T05:58:51.236839+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:58:51.236839+0000","last_undegraded":"2024-09-10T05:58:51.236839+0000","last_fullsized":"2024-09-10T05:58:51.236839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'18","reported_seq":242,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024516+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:58:52.024516+0000","last_peered":"2024-09-10T05:58:52.024516+0000","last_clean":"2024-09-10T05:58:52.024516+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:58:52.024516+0000","last_undegraded":"2024-09-10T05:58:52.024516+0000","last_fullsized":"2024-09-10T05:58:52.024516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":273,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019226+0000","last_change":"2024-09-10T05:58:39.367642+0000","last_active":"2024-09-10T05:58:52.019226+0000","last_peered":"2024-09-10T05:58:52.019226+0000","last_clean":"2024-09-10T05:58:52.019226+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:58:52.019226+0000","last_undegraded":"2024-09-10T05:58:52.019226+0000","last_fullsized":"2024-09-10T05:58:52.019226+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'28","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178595+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:58:51.178595+0000","last_peered":"2024-09-10T05:58:51.178595+0000","last_clean":"2024-09-10T05:58:51.178595+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:58:51.178595+0000","last_undegraded":"2024-09-10T05:58:51.178595+0000","last_fullsized":"2024-09-10T05:58:51.178595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019693+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:58:52.019693+0000","last_peered":"2024-09-10T05:58:52.019693+0000","last_clean":"2024-09-10T05:58:52.019693+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:58:52.019693+0000","last_undegraded":"2024-09-10T05:58:52.019693+0000","last_fullsized":"2024-09-10T05:58:52.019693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'22","reported_seq":86,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022181+0000","last_change":"2024-09-10T05:58:42.304778+0000","last_active":"2024-09-10T05:58:52.022181+0000","last_peered":"2024-09-10T05:58:52.022181+0000","last_clean":"2024-09-10T05:58:52.022181+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:58:52.022181+0000","last_undegraded":"2024-09-10T05:58:52.022181+0000","last_fullsized":"2024-09-10T05:58:52.022181+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:41.747059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179278+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:58:51.179278+0000","last_peered":"2024-09-10T05:58:51.179278+0000","last_clean":"2024-09-10T05:58:51.179278+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:58:51.179278+0000","last_undegraded":"2024-09-10T05:58:51.179278+0000","last_fullsized":"2024-09-10T05:58:51.179278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179541+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:58:51.179541+0000","last_peered":"2024-09-10T05:58:51.179541+0000","last_clean":"2024-09-10T05:58:51.179541+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:58:51.179541+0000","last_undegraded":"2024-09-10T05:58:51.179541+0000","last_fullsized":"2024-09-10T05:58:51.179541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.176803+0000","last_change":"2024-09-10T05:58:38.995573+0000","last_active":"2024-09-10T05:58:51.176803+0000","last_peered":"2024-09-10T05:58:51.176803+0000","last_clean":"2024-09-10T05:58:51.176803+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:58:51.176803+0000","last_undegraded":"2024-09-10T05:58:51.176803+0000","last_fullsized":"2024-09-10T05:58:51.176803+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":50,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022505+0000","last_change":"2024-09-10T05:58:37.289796+0000","last_active":"2024-09-10T05:58:52.022505+0000","last_peered":"2024-09-10T05:58:52.022505+0000","last_clean":"2024-09-10T05:58:52.022505+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:58:52.022505+0000","last_undegraded":"2024-09-10T05:58:52.022505+0000","last_fullsized":"2024-09-10T05:58:52.022505+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:13.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'19","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022651+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:58:52.022651+0000","last_peered":"2024-09-10T05:58:52.022651+0000","last_clean":"2024-09-10T05:58:52.022651+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:58:52.022651+0000","last_undegraded":"2024-09-10T05:58:52.022651+0000","last_fullsized":"2024-09-10T05:58:52.022651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237731+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:58:51.237731+0000","last_peered":"2024-09-10T05:58:51.237731+0000","last_clean":"2024-09-10T05:58:51.237731+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:58:51.237731+0000","last_undegraded":"2024-09-10T05:58:51.237731+0000","last_fullsized":"2024-09-10T05:58:51.237731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"111'30","reported_seq":260,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180715+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:58:51.180715+0000","last_peered":"2024-09-10T05:58:51.180715+0000","last_clean":"2024-09-10T05:58:51.180715+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:58:51.180715+0000","last_undegraded":"2024-09-10T05:58:51.180715+0000","last_fullsized":"2024-09-10T05:58:51.180715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022087+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:58:52.022087+0000","last_peered":"2024-09-10T05:58:52.022087+0000","last_clean":"2024-09-10T05:58:52.022087+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:58:52.022087+0000","last_undegraded":"2024-09-10T05:58:52.022087+0000","last_fullsized":"2024-09-10T05:58:52.022087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"111'48","reported_seq":270,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235804+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:58:51.235804+0000","last_peered":"2024-09-10T05:58:51.235804+0000","last_clean":"2024-09-10T05:58:51.235804+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:58:51.235804+0000","last_undegraded":"2024-09-10T05:58:51.235804+0000","last_fullsized":"2024-09-10T05:58:51.235804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":227,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238120+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:58:51.238120+0000","last_peered":"2024-09-10T05:58:51.238120+0000","last_clean":"2024-09-10T05:58:51.238120+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:58:51.238120+0000","last_undegraded":"2024-09-10T05:58:51.238120+0000","last_fullsized":"2024-09-10T05:58:51.238120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'26","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179392+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:58:51.179392+0000","last_peered":"2024-09-10T05:58:51.179392+0000","last_clean":"2024-09-10T05:58:51.179392+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:58:51.179392+0000","last_undegraded":"2024-09-10T05:58:51.179392+0000","last_fullsized":"2024-09-10T05:58:51.179392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022631+0000","last_change":"2024-09-10T05:58:36.074698+0000","last_active":"2024-09-10T05:58:52.022631+0000","last_peered":"2024-09-10T05:58:52.022631+0000","last_clean":"2024-09-10T05:58:52.022631+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:58:52.022631+0000","last_undegraded":"2024-09-10T05:58:52.022631+0000","last_fullsized":"2024-09-10T05:58:52.022631+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:37.044312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178903+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:58:51.178903+0000","last_peered":"2024-09-10T05:58:51.178903+0000","last_clean":"2024-09-10T05:58:51.178903+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:58:51.178903+0000","last_undegraded":"2024-09-10T05:58:51.178903+0000","last_fullsized":"2024-09-10T05:58:51.178903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178652+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:58:51.178652+0000","last_peered":"2024-09-10T05:58:51.178652+0000","last_clean":"2024-09-10T05:58:51.178652+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:58:51.178652+0000","last_undegraded":"2024-09-10T05:58:51.178652+0000","last_fullsized":"2024-09-10T05:58:51.178652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178657+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:58:51.178657+0000","last_peered":"2024-09-10T05:58:51.178657+0000","last_clean":"2024-09-10T05:58:51.178657+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:58:51.178657+0000","last_undegraded":"2024-09-10T05:58:51.178657+0000","last_fullsized":"2024-09-10T05:58:51.178657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":255,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.182114+0000","last_change":"2024-09-10T05:58:36.709426+0000","last_active":"2024-09-10T05:58:51.182114+0000","last_peered":"2024-09-10T05:58:51.182114+0000","last_clean":"2024-09-10T05:58:51.182114+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:58:51.182114+0000","last_undegraded":"2024-09-10T05:58:51.182114+0000","last_fullsized":"2024-09-10T05:58:51.182114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:16.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'28","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021486+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:58:52.021486+0000","last_peered":"2024-09-10T05:58:52.021486+0000","last_clean":"2024-09-10T05:58:52.021486+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:58:52.021486+0000","last_undegraded":"2024-09-10T05:58:52.021486+0000","last_fullsized":"2024-09-10T05:58:52.021486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023929+0000","last_change":"2024-09-10T05:58:36.086954+0000","last_active":"2024-09-10T05:58:52.023929+0000","last_peered":"2024-09-10T05:58:52.023929+0000","last_clean":"2024-09-10T05:58:52.023929+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:58:52.023929+0000","last_undegraded":"2024-09-10T05:58:52.023929+0000","last_fullsized":"2024-09-10T05:58:52.023929+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:57.423283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":251,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019597+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:58:52.019597+0000","last_peered":"2024-09-10T05:58:52.019597+0000","last_clean":"2024-09-10T05:58:52.019597+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:58:52.019597+0000","last_undegraded":"2024-09-10T05:58:52.019597+0000","last_fullsized":"2024-09-10T05:58:52.019597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"111'134","reported_seq":383,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022427+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:58:52.022427+0000","last_peered":"2024-09-10T05:58:52.022427+0000","last_clean":"2024-09-10T05:58:52.022427+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:58:52.022427+0000","last_undegraded":"2024-09-10T05:58:52.022427+0000","last_fullsized":"2024-09-10T05:58:52.022427+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177578+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:58:51.177578+0000","last_peered":"2024-09-10T05:58:51.177578+0000","last_clean":"2024-09-10T05:58:51.177578+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:58:51.177578+0000","last_undegraded":"2024-09-10T05:58:51.177578+0000","last_fullsized":"2024-09-10T05:58:51.177578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023956+0000","last_change":"2024-09-10T05:58:39.658860+0000","last_active":"2024-09-10T05:58:52.023956+0000","last_peered":"2024-09-10T05:58:52.023956+0000","last_clean":"2024-09-10T05:58:52.023956+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:58:52.023956+0000","last_undegraded":"2024-09-10T05:58:52.023956+0000","last_fullsized":"2024-09-10T05:58:52.023956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:22.522890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'18","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021152+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:58:52.021152+0000","last_peered":"2024-09-10T05:58:52.021152+0000","last_clean":"2024-09-10T05:58:52.021152+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:58:52.021152+0000","last_undegraded":"2024-09-10T05:58:52.021152+0000","last_fullsized":"2024-09-10T05:58:52.021152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":239,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237733+0000","last_change":"2024-09-10T05:58:36.076514+0000","last_active":"2024-09-10T05:58:51.237733+0000","last_peered":"2024-09-10T05:58:51.237733+0000","last_clean":"2024-09-10T05:58:51.237733+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:58:51.237733+0000","last_undegraded":"2024-09-10T05:58:51.237733+0000","last_fullsized":"2024-09-10T05:58:51.237733+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:58.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"111'23","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022931+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:58:52.022931+0000","last_peered":"2024-09-10T05:58:52.022931+0000","last_clean":"2024-09-10T05:58:52.022931+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:58:52.022931+0000","last_undegraded":"2024-09-10T05:58:52.022931+0000","last_fullsized":"2024-09-10T05:58:52.022931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"122'141","reported_seq":343,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022439+0000","last_change":"2024-09-10T05:58:42.104842+0000","last_active":"2024-09-10T05:58:52.022439+0000","last_peered":"2024-09-10T05:58:52.022439+0000","last_clean":"2024-09-10T05:58:52.022439+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:58:52.022439+0000","last_undegraded":"2024-09-10T05:58:52.022439+0000","last_fullsized":"2024-09-10T05:58:52.022439+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:06.712578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236491+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:58:51.236491+0000","last_peered":"2024-09-10T05:58:51.236491+0000","last_clean":"2024-09-10T05:58:51.236491+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:58:51.236491+0000","last_undegraded":"2024-09-10T05:58:51.236491+0000","last_fullsized":"2024-09-10T05:58:51.236491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'28","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022976+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:58:52.022976+0000","last_peered":"2024-09-10T05:58:52.022976+0000","last_clean":"2024-09-10T05:58:52.022976+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:58:52.022976+0000","last_undegraded":"2024-09-10T05:58:52.022976+0000","last_fullsized":"2024-09-10T05:58:52.022976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020241+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:58:52.020241+0000","last_peered":"2024-09-10T05:58:52.020241+0000","last_clean":"2024-09-10T05:58:52.020241+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:58:52.020241+0000","last_undegraded":"2024-09-10T05:58:52.020241+0000","last_fullsized":"2024-09-10T05:58:52.020241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"111'35","reported_seq":264,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236013+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:58:51.236013+0000","last_peered":"2024-09-10T05:58:51.236013+0000","last_clean":"2024-09-10T05:58:51.236013+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:58:51.236013+0000","last_undegraded":"2024-09-10T05:58:51.236013+0000","last_fullsized":"2024-09-10T05:58:51.236013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019978+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:58:52.019978+0000","last_peered":"2024-09-10T05:58:52.019978+0000","last_clean":"2024-09-10T05:58:52.019978+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:58:52.019978+0000","last_undegraded":"2024-09-10T05:58:52.019978+0000","last_fullsized":"2024-09-10T05:58:52.019978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236574+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:58:51.236574+0000","last_peered":"2024-09-10T05:58:51.236574+0000","last_clean":"2024-09-10T05:58:51.236574+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:58:51.236574+0000","last_undegraded":"2024-09-10T05:58:51.236574+0000","last_fullsized":"2024-09-10T05:58:51.236574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177343+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:58:51.177343+0000","last_peered":"2024-09-10T05:58:51.177343+0000","last_clean":"2024-09-10T05:58:51.177343+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:58:51.177343+0000","last_undegraded":"2024-09-10T05:58:51.177343+0000","last_fullsized":"2024-09-10T05:58:51.177343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'21","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022894+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:58:52.022894+0000","last_peered":"2024-09-10T05:58:52.022894+0000","last_clean":"2024-09-10T05:58:52.022894+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:58:52.022894+0000","last_undegraded":"2024-09-10T05:58:52.022894+0000","last_fullsized":"2024-09-10T05:58:52.022894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018805+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:58:52.018805+0000","last_peered":"2024-09-10T05:58:52.018805+0000","last_clean":"2024-09-10T05:58:52.018805+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:58:52.018805+0000","last_undegraded":"2024-09-10T05:58:52.018805+0000","last_fullsized":"2024-09-10T05:58:52.018805+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"111'23","reported_seq":52,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022289+0000","last_change":"2024-09-10T05:58:41.124218+0000","last_active":"2024-09-10T05:58:52.022289+0000","last_peered":"2024-09-10T05:58:52.022289+0000","last_clean":"2024-09-10T05:58:52.022289+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:58:52.022289+0000","last_undegraded":"2024-09-10T05:58:52.022289+0000","last_fullsized":"2024-09-10T05:58:52.022289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:13.232943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020810+0000","last_change":"2024-09-10T05:58:36.068634+0000","last_active":"2024-09-10T05:58:52.020810+0000","last_peered":"2024-09-10T05:58:52.020810+0000","last_clean":"2024-09-10T05:58:52.020810+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:58:52.020810+0000","last_undegraded":"2024-09-10T05:58:52.020810+0000","last_fullsized":"2024-09-10T05:58:52.020810+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:54.848895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022778+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:58:52.022778+0000","last_peered":"2024-09-10T05:58:52.022778+0000","last_clean":"2024-09-10T05:58:52.022778+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:58:52.022778+0000","last_undegraded":"2024-09-10T05:58:52.022778+0000","last_fullsized":"2024-09-10T05:58:52.022778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022697+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:58:52.022697+0000","last_peered":"2024-09-10T05:58:52.022697+0000","last_clean":"2024-09-10T05:58:52.022697+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:58:52.022697+0000","last_undegraded":"2024-09-10T05:58:52.022697+0000","last_fullsized":"2024-09-10T05:58:52.022697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'23","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023940+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:58:52.023940+0000","last_peered":"2024-09-10T05:58:52.023940+0000","last_clean":"2024-09-10T05:58:52.023940+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:58:52.023940+0000","last_undegraded":"2024-09-10T05:58:52.023940+0000","last_fullsized":"2024-09-10T05:58:52.023940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019437+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:58:52.019437+0000","last_peered":"2024-09-10T05:58:52.019437+0000","last_clean":"2024-09-10T05:58:52.019437+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:58:52.019437+0000","last_undegraded":"2024-09-10T05:58:52.019437+0000","last_fullsized":"2024-09-10T05:58:52.019437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"111'35","reported_seq":269,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020598+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:58:52.020598+0000","last_peered":"2024-09-10T05:58:52.020598+0000","last_clean":"2024-09-10T05:58:52.020598+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:58:52.020598+0000","last_undegraded":"2024-09-10T05:58:52.020598+0000","last_fullsized":"2024-09-10T05:58:52.020598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"111'134","reported_seq":460,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178027+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:58:51.178027+0000","last_peered":"2024-09-10T05:58:51.178027+0000","last_clean":"2024-09-10T05:58:51.178027+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:58:51.178027+0000","last_undegraded":"2024-09-10T05:58:51.178027+0000","last_fullsized":"2024-09-10T05:58:51.178027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181133+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:58:51.181133+0000","last_peered":"2024-09-10T05:58:51.181133+0000","last_clean":"2024-09-10T05:58:51.181133+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:58:51.181133+0000","last_undegraded":"2024-09-10T05:58:51.181133+0000","last_fullsized":"2024-09-10T05:58:51.181133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181643+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:58:51.181643+0000","last_peered":"2024-09-10T05:58:51.181643+0000","last_clean":"2024-09-10T05:58:51.181643+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:58:51.181643+0000","last_undegraded":"2024-09-10T05:58:51.181643+0000","last_fullsized":"2024-09-10T05:58:51.181643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'12","reported_seq":186,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018991+0000","last_change":"2024-09-10T05:58:38.085546+0000","last_active":"2024-09-10T05:58:52.018991+0000","last_peered":"2024-09-10T05:58:52.018991+0000","last_clean":"2024-09-10T05:58:52.018991+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:58:52.018991+0000","last_undegraded":"2024-09-10T05:58:52.018991+0000","last_fullsized":"2024-09-10T05:58:52.018991+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:10.893758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018905+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:58:52.018905+0000","last_peered":"2024-09-10T05:58:52.018905+0000","last_clean":"2024-09-10T05:58:52.018905+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:58:52.018905+0000","last_undegraded":"2024-09-10T05:58:52.018905+0000","last_fullsized":"2024-09-10T05:58:52.018905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'40","reported_seq":274,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178710+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:58:51.178710+0000","last_peered":"2024-09-10T05:58:51.178710+0000","last_clean":"2024-09-10T05:58:51.178710+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:58:51.178710+0000","last_undegraded":"2024-09-10T05:58:51.178710+0000","last_fullsized":"2024-09-10T05:58:51.178710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018668+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:58:52.018668+0000","last_peered":"2024-09-10T05:58:52.018668+0000","last_clean":"2024-09-10T05:58:52.018668+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:58:52.018668+0000","last_undegraded":"2024-09-10T05:58:52.018668+0000","last_fullsized":"2024-09-10T05:58:52.018668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":262,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020297+0000","last_change":"2024-09-10T05:58:39.385287+0000","last_active":"2024-09-10T05:58:52.020297+0000","last_peered":"2024-09-10T05:58:52.020297+0000","last_clean":"2024-09-10T05:58:52.020297+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:58:52.020297+0000","last_undegraded":"2024-09-10T05:58:52.020297+0000","last_fullsized":"2024-09-10T05:58:52.020297+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:27.225607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":272,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179010+0000","last_change":"2024-09-10T05:58:40.751831+0000","last_active":"2024-09-10T05:58:51.179010+0000","last_peered":"2024-09-10T05:58:51.179010+0000","last_clean":"2024-09-10T05:58:51.179010+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:58:51.179010+0000","last_undegraded":"2024-09-10T05:58:51.179010+0000","last_fullsized":"2024-09-10T05:58:51.179010+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:32.405571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'27","reported_seq":96,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022920+0000","last_change":"2024-09-10T05:58:38.720733+0000","last_active":"2024-09-10T05:58:52.022920+0000","last_peered":"2024-09-10T05:58:52.022920+0000","last_clean":"2024-09-10T05:58:52.022920+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:58:52.022920+0000","last_undegraded":"2024-09-10T05:58:52.022920+0000","last_fullsized":"2024-09-10T05:58:52.022920+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:07.402320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019338+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:58:52.019338+0000","last_peered":"2024-09-10T05:58:52.019338+0000","last_clean":"2024-09-10T05:58:52.019338+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:58:52.019338+0000","last_undegraded":"2024-09-10T05:58:52.019338+0000","last_fullsized":"2024-09-10T05:58:52.019338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"111'28","reported_seq":252,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178774+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:58:51.178774+0000","last_peered":"2024-09-10T05:58:51.178774+0000","last_clean":"2024-09-10T05:58:51.178774+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:58:51.178774+0000","last_undegraded":"2024-09-10T05:58:51.178774+0000","last_fullsized":"2024-09-10T05:58:51.178774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":23,"num_write":20,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181243+0000","last_change":"2024-09-10T05:58:36.081028+0000","last_active":"2024-09-10T05:58:51.181243+0000","last_peered":"2024-09-10T05:58:51.181243+0000","last_clean":"2024-09-10T05:58:51.181243+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:58:51.181243+0000","last_undegraded":"2024-09-10T05:58:51.181243+0000","last_fullsized":"2024-09-10T05:58:51.181243+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:17.752342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018983+0000","last_change":"2024-09-10T05:58:42.021549+0000","last_active":"2024-09-10T05:58:52.018983+0000","last_peered":"2024-09-10T05:58:52.018983+0000","last_clean":"2024-09-10T05:58:52.018983+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:58:52.018983+0000","last_undegraded":"2024-09-10T05:58:52.018983+0000","last_fullsized":"2024-09-10T05:58:52.018983+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:23.621053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179596+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:58:51.179596+0000","last_peered":"2024-09-10T05:58:51.179596+0000","last_clean":"2024-09-10T05:58:51.179596+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:58:51.179596+0000","last_undegraded":"2024-09-10T05:58:51.179596+0000","last_fullsized":"2024-09-10T05:58:51.179596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'25","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023119+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:58:52.023119+0000","last_peered":"2024-09-10T05:58:52.023119+0000","last_clean":"2024-09-10T05:58:52.023119+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:58:52.023119+0000","last_undegraded":"2024-09-10T05:58:52.023119+0000","last_fullsized":"2024-09-10T05:58:52.023119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019977+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:58:52.019977+0000","last_peered":"2024-09-10T05:58:52.019977+0000","last_clean":"2024-09-10T05:58:52.019977+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:58:52.019977+0000","last_undegraded":"2024-09-10T05:58:52.019977+0000","last_fullsized":"2024-09-10T05:58:52.019977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"111'23","reported_seq":332,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020059+0000","last_change":"2024-09-10T05:58:40.714764+0000","last_active":"2024-09-10T05:58:52.020059+0000","last_peered":"2024-09-10T05:58:52.020059+0000","last_clean":"2024-09-10T05:58:52.020059+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:58:52.020059+0000","last_undegraded":"2024-09-10T05:58:52.020059+0000","last_fullsized":"2024-09-10T05:58:52.020059+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:27.289268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"111'134","reported_seq":397,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019578+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:58:52.019578+0000","last_peered":"2024-09-10T05:58:52.019578+0000","last_clean":"2024-09-10T05:58:52.019578+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:58:52.019578+0000","last_undegraded":"2024-09-10T05:58:52.019578+0000","last_fullsized":"2024-09-10T05:58:52.019578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":202,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020800+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:58:52.020800+0000","last_peered":"2024-09-10T05:58:52.020800+0000","last_clean":"2024-09-10T05:58:52.020800+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:58:52.020800+0000","last_undegraded":"2024-09-10T05:58:52.020800+0000","last_fullsized":"2024-09-10T05:58:52.020800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179315+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:58:51.179315+0000","last_peered":"2024-09-10T05:58:51.179315+0000","last_clean":"2024-09-10T05:58:51.179315+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:58:51.179315+0000","last_undegraded":"2024-09-10T05:58:51.179315+0000","last_fullsized":"2024-09-10T05:58:51.179315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'23","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178231+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:58:51.178231+0000","last_peered":"2024-09-10T05:58:51.178231+0000","last_clean":"2024-09-10T05:58:51.178231+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:58:51.178231+0000","last_undegraded":"2024-09-10T05:58:51.178231+0000","last_fullsized":"2024-09-10T05:58:51.178231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":395,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237378+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:58:51.237378+0000","last_peered":"2024-09-10T05:58:51.237378+0000","last_clean":"2024-09-10T05:58:51.237378+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:58:51.237378+0000","last_undegraded":"2024-09-10T05:58:51.237378+0000","last_fullsized":"2024-09-10T05:58:51.237378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":52,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022407+0000","last_change":"2024-09-10T05:58:37.286390+0000","last_active":"2024-09-10T05:58:52.022407+0000","last_peered":"2024-09-10T05:58:52.022407+0000","last_clean":"2024-09-10T05:58:52.022407+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:58:52.022407+0000","last_undegraded":"2024-09-10T05:58:52.022407+0000","last_fullsized":"2024-09-10T05:58:52.022407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:08.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"111'134","reported_seq":430,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023706+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:58:52.023706+0000","last_peered":"2024-09-10T05:58:52.023706+0000","last_clean":"2024-09-10T05:58:52.023706+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:58:52.023706+0000","last_undegraded":"2024-09-10T05:58:52.023706+0000","last_fullsized":"2024-09-10T05:58:52.023706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177769+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:58:51.177769+0000","last_peered":"2024-09-10T05:58:51.177769+0000","last_clean":"2024-09-10T05:58:51.177769+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:58:51.177769+0000","last_undegraded":"2024-09-10T05:58:51.177769+0000","last_fullsized":"2024-09-10T05:58:51.177769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":85,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237041+0000","last_change":"2024-09-10T05:58:40.805304+0000","last_active":"2024-09-10T05:58:51.237041+0000","last_peered":"2024-09-10T05:58:51.237041+0000","last_clean":"2024-09-10T05:58:51.237041+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:58:51.237041+0000","last_undegraded":"2024-09-10T05:58:51.237041+0000","last_fullsized":"2024-09-10T05:58:51.237041+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:26.888956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":86,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019581+0000","last_change":"2024-09-10T05:58:41.608913+0000","last_active":"2024-09-10T05:58:52.019581+0000","last_peered":"2024-09-10T05:58:52.019581+0000","last_clean":"2024-09-10T05:58:52.019581+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:58:52.019581+0000","last_undegraded":"2024-09-10T05:58:52.019581+0000","last_fullsized":"2024-09-10T05:58:52.019581+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:15.544218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179043+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:58:51.179043+0000","last_peered":"2024-09-10T05:58:51.179043+0000","last_clean":"2024-09-10T05:58:51.179043+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:58:51.179043+0000","last_undegraded":"2024-09-10T05:58:51.179043+0000","last_fullsized":"2024-09-10T05:58:51.179043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"111'25","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237147+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:58:51.237147+0000","last_peered":"2024-09-10T05:58:51.237147+0000","last_clean":"2024-09-10T05:58:51.237147+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:58:51.237147+0000","last_undegraded":"2024-09-10T05:58:51.237147+0000","last_fullsized":"2024-09-10T05:58:51.237147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022761+0000","last_change":"2024-09-10T05:58:36.080814+0000","last_active":"2024-09-10T05:58:52.022761+0000","last_peered":"2024-09-10T05:58:52.022761+0000","last_clean":"2024-09-10T05:58:52.022761+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:58:52.022761+0000","last_undegraded":"2024-09-10T05:58:52.022761+0000","last_fullsized":"2024-09-10T05:58:52.022761+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:12.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":202,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019884+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:58:52.019884+0000","last_peered":"2024-09-10T05:58:52.019884+0000","last_clean":"2024-09-10T05:58:52.019884+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:58:52.019884+0000","last_undegraded":"2024-09-10T05:58:52.019884+0000","last_fullsized":"2024-09-10T05:58:52.019884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":255,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024116+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:58:52.024116+0000","last_peered":"2024-09-10T05:58:52.024116+0000","last_clean":"2024-09-10T05:58:52.024116+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:58:52.024116+0000","last_undegraded":"2024-09-10T05:58:52.024116+0000","last_fullsized":"2024-09-10T05:58:52.024116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":329,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020836+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:58:52.020836+0000","last_peered":"2024-09-10T05:58:52.020836+0000","last_clean":"2024-09-10T05:58:52.020836+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:58:52.020836+0000","last_undegraded":"2024-09-10T05:58:52.020836+0000","last_fullsized":"2024-09-10T05:58:52.020836+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237016+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:58:51.237016+0000","last_peered":"2024-09-10T05:58:51.237016+0000","last_clean":"2024-09-10T05:58:51.237016+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:58:51.237016+0000","last_undegraded":"2024-09-10T05:58:51.237016+0000","last_fullsized":"2024-09-10T05:58:51.237016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"111'28","reported_seq":98,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020492+0000","last_change":"2024-09-10T05:58:38.110183+0000","last_active":"2024-09-10T05:58:52.020492+0000","last_peered":"2024-09-10T05:58:52.020492+0000","last_clean":"2024-09-10T05:58:52.020492+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:58:52.020492+0000","last_undegraded":"2024-09-10T05:58:52.020492+0000","last_fullsized":"2024-09-10T05:58:52.020492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.156258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021783+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:58:52.021783+0000","last_peered":"2024-09-10T05:58:52.021783+0000","last_clean":"2024-09-10T05:58:52.021783+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:58:52.021783+0000","last_undegraded":"2024-09-10T05:58:52.021783+0000","last_fullsized":"2024-09-10T05:58:52.021783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"111'43","reported_seq":354,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237535+0000","last_change":"2024-09-10T05:58:40.775802+0000","last_active":"2024-09-10T05:58:51.237535+0000","last_peered":"2024-09-10T05:58:51.237535+0000","last_clean":"2024-09-10T05:58:51.237535+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:58:51.237535+0000","last_undegraded":"2024-09-10T05:58:51.237535+0000","last_fullsized":"2024-09-10T05:58:51.237535+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.223922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181640+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:58:51.181640+0000","last_peered":"2024-09-10T05:58:51.181640+0000","last_clean":"2024-09-10T05:58:51.181640+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:58:51.181640+0000","last_undegraded":"2024-09-10T05:58:51.181640+0000","last_fullsized":"2024-09-10T05:58:51.181640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020621+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:58:52.020621+0000","last_peered":"2024-09-10T05:58:52.020621+0000","last_clean":"2024-09-10T05:58:52.020621+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:58:52.020621+0000","last_undegraded":"2024-09-10T05:58:52.020621+0000","last_fullsized":"2024-09-10T05:58:52.020621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181910+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:58:51.181910+0000","last_peered":"2024-09-10T05:58:51.181910+0000","last_clean":"2024-09-10T05:58:51.181910+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:58:51.181910+0000","last_undegraded":"2024-09-10T05:58:51.181910+0000","last_fullsized":"2024-09-10T05:58:51.181910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020354+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:58:52.020354+0000","last_peered":"2024-09-10T05:58:52.020354+0000","last_clean":"2024-09-10T05:58:52.020354+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:58:52.020354+0000","last_undegraded":"2024-09-10T05:58:52.020354+0000","last_fullsized":"2024-09-10T05:58:52.020354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'19","reported_seq":242,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178814+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:58:51.178814+0000","last_peered":"2024-09-10T05:58:51.178814+0000","last_clean":"2024-09-10T05:58:51.178814+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:58:51.178814+0000","last_undegraded":"2024-09-10T05:58:51.178814+0000","last_fullsized":"2024-09-10T05:58:51.178814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238245+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:58:51.238245+0000","last_peered":"2024-09-10T05:58:51.238245+0000","last_clean":"2024-09-10T05:58:51.238245+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:58:51.238245+0000","last_undegraded":"2024-09-10T05:58:51.238245+0000","last_fullsized":"2024-09-10T05:58:51.238245+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"111'142","reported_seq":461,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019320+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:58:52.019320+0000","last_peered":"2024-09-10T05:58:52.019320+0000","last_clean":"2024-09-10T05:58:52.019320+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:58:52.019320+0000","last_undegraded":"2024-09-10T05:58:52.019320+0000","last_fullsized":"2024-09-10T05:58:52.019320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":185,"num_read_kb":169,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022690+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:58:52.022690+0000","last_peered":"2024-09-10T05:58:52.022690+0000","last_clean":"2024-09-10T05:58:52.022690+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:58:52.022690+0000","last_undegraded":"2024-09-10T05:58:52.022690+0000","last_fullsized":"2024-09-10T05:58:52.022690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":211,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019597+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:58:52.019597+0000","last_peered":"2024-09-10T05:58:52.019597+0000","last_clean":"2024-09-10T05:58:52.019597+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:58:52.019597+0000","last_undegraded":"2024-09-10T05:58:52.019597+0000","last_fullsized":"2024-09-10T05:58:52.019597+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021260+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:58:52.021260+0000","last_peered":"2024-09-10T05:58:52.021260+0000","last_clean":"2024-09-10T05:58:52.021260+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:58:52.021260+0000","last_undegraded":"2024-09-10T05:58:52.021260+0000","last_fullsized":"2024-09-10T05:58:52.021260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":260,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018741+0000","last_change":"2024-09-10T05:58:36.063964+0000","last_active":"2024-09-10T05:58:52.018741+0000","last_peered":"2024-09-10T05:58:52.018741+0000","last_clean":"2024-09-10T05:58:52.018741+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:58:52.018741+0000","last_undegraded":"2024-09-10T05:58:52.018741+0000","last_fullsized":"2024-09-10T05:58:52.018741+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:53.613158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019432+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:58:52.019432+0000","last_peered":"2024-09-10T05:58:52.019432+0000","last_clean":"2024-09-10T05:58:52.019432+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:58:52.019432+0000","last_undegraded":"2024-09-10T05:58:52.019432+0000","last_fullsized":"2024-09-10T05:58:52.019432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019730+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:58:52.019730+0000","last_peered":"2024-09-10T05:58:52.019730+0000","last_clean":"2024-09-10T05:58:52.019730+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:58:52.019730+0000","last_undegraded":"2024-09-10T05:58:52.019730+0000","last_fullsized":"2024-09-10T05:58:52.019730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":274,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023435+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:58:52.023435+0000","last_peered":"2024-09-10T05:58:52.023435+0000","last_clean":"2024-09-10T05:58:52.023435+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:58:52.023435+0000","last_undegraded":"2024-09-10T05:58:52.023435+0000","last_fullsized":"2024-09-10T05:58:52.023435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180470+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:58:51.180470+0000","last_peered":"2024-09-10T05:58:51.180470+0000","last_clean":"2024-09-10T05:58:51.180470+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:58:51.180470+0000","last_undegraded":"2024-09-10T05:58:51.180470+0000","last_fullsized":"2024-09-10T05:58:51.180470+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022662+0000","last_change":"2024-09-10T05:58:36.090394+0000","last_active":"2024-09-10T05:58:52.022662+0000","last_peered":"2024-09-10T05:58:52.022662+0000","last_clean":"2024-09-10T05:58:52.022662+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:58:52.022662+0000","last_undegraded":"2024-09-10T05:58:52.022662+0000","last_fullsized":"2024-09-10T05:58:52.022662+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:49.622437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020328+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:58:52.020328+0000","last_peered":"2024-09-10T05:58:52.020328+0000","last_clean":"2024-09-10T05:58:52.020328+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:58:52.020328+0000","last_undegraded":"2024-09-10T05:58:52.020328+0000","last_fullsized":"2024-09-10T05:58:52.020328+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":238,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237863+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:58:51.237863+0000","last_peered":"2024-09-10T05:58:51.237863+0000","last_clean":"2024-09-10T05:58:51.237863+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:58:51.237863+0000","last_undegraded":"2024-09-10T05:58:51.237863+0000","last_fullsized":"2024-09-10T05:58:51.237863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'35","reported_seq":257,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178488+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:58:51.178488+0000","last_peered":"2024-09-10T05:58:51.178488+0000","last_clean":"2024-09-10T05:58:51.178488+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:58:51.178488+0000","last_undegraded":"2024-09-10T05:58:51.178488+0000","last_fullsized":"2024-09-10T05:58:51.178488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180459+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:58:51.180459+0000","last_peered":"2024-09-10T05:58:51.180459+0000","last_clean":"2024-09-10T05:58:51.180459+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:58:51.180459+0000","last_undegraded":"2024-09-10T05:58:51.180459+0000","last_fullsized":"2024-09-10T05:58:51.180459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":54,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022744+0000","last_change":"2024-09-10T05:58:37.301597+0000","last_active":"2024-09-10T05:58:52.022744+0000","last_peered":"2024-09-10T05:58:52.022744+0000","last_clean":"2024-09-10T05:58:52.022744+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:58:52.022744+0000","last_undegraded":"2024-09-10T05:58:52.022744+0000","last_fullsized":"2024-09-10T05:58:52.022744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:30.282821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024382+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:58:52.024382+0000","last_peered":"2024-09-10T05:58:52.024382+0000","last_clean":"2024-09-10T05:58:52.024382+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:58:52.024382+0000","last_undegraded":"2024-09-10T05:58:52.024382+0000","last_fullsized":"2024-09-10T05:58:52.024382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":239,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235594+0000","last_change":"2024-09-10T05:58:40.735106+0000","last_active":"2024-09-10T05:58:51.235594+0000","last_peered":"2024-09-10T05:58:51.235594+0000","last_clean":"2024-09-10T05:58:51.235594+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:58:51.235594+0000","last_undegraded":"2024-09-10T05:58:51.235594+0000","last_fullsized":"2024-09-10T05:58:51.235594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:08.686783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":193,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018517+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:58:52.018517+0000","last_peered":"2024-09-10T05:58:52.018517+0000","last_clean":"2024-09-10T05:58:52.018517+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:58:52.018517+0000","last_undegraded":"2024-09-10T05:58:52.018517+0000","last_fullsized":"2024-09-10T05:58:52.018517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"111'25","reported_seq":328,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238289+0000","last_change":"2024-09-10T05:58:39.363982+0000","last_active":"2024-09-10T05:58:51.238289+0000","last_peered":"2024-09-10T05:58:51.238289+0000","last_clean":"2024-09-10T05:58:51.238289+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:58:51.238289+0000","last_undegraded":"2024-09-10T05:58:51.238289+0000","last_fullsized":"2024-09-10T05:58:51.238289+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:12.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021285+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:58:52.021285+0000","last_peered":"2024-09-10T05:58:52.021285+0000","last_clean":"2024-09-10T05:58:52.021285+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:58:52.021285+0000","last_undegraded":"2024-09-10T05:58:52.021285+0000","last_fullsized":"2024-09-10T05:58:52.021285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":305,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180720+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:58:51.180720+0000","last_peered":"2024-09-10T05:58:51.180720+0000","last_clean":"2024-09-10T05:58:51.180720+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:58:51.180720+0000","last_undegraded":"2024-09-10T05:58:51.180720+0000","last_fullsized":"2024-09-10T05:58:51.180720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"111'47","reported_seq":396,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179407+0000","last_change":"2024-09-10T05:58:39.382781+0000","last_active":"2024-09-10T05:58:51.179407+0000","last_peered":"2024-09-10T05:58:51.179407+0000","last_clean":"2024-09-10T05:58:51.179407+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:58:51.179407+0000","last_undegraded":"2024-09-10T05:58:51.179407+0000","last_fullsized":"2024-09-10T05:58:51.179407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:54.079756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":230,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.176962+0000","last_change":"2024-09-10T05:58:36.065033+0000","last_active":"2024-09-10T05:58:51.176962+0000","last_peered":"2024-09-10T05:58:51.176962+0000","last_clean":"2024-09-10T05:58:51.176962+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:58:51.176962+0000","last_undegraded":"2024-09-10T05:58:51.176962+0000","last_fullsized":"2024-09-10T05:58:51.176962+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.563276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180743+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:58:51.180743+0000","last_peered":"2024-09-10T05:58:51.180743+0000","last_clean":"2024-09-10T05:58:51.180743+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:58:51.180743+0000","last_undegraded":"2024-09-10T05:58:51.180743+0000","last_fullsized":"2024-09-10T05:58:51.180743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":228,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181513+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:58:51.181513+0000","last_peered":"2024-09-10T05:58:51.181513+0000","last_clean":"2024-09-10T05:58:51.181513+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:58:51.181513+0000","last_undegraded":"2024-09-10T05:58:51.181513+0000","last_fullsized":"2024-09-10T05:58:51.181513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'31","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020221+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:58:52.020221+0000","last_peered":"2024-09-10T05:58:52.020221+0000","last_clean":"2024-09-10T05:58:52.020221+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:58:52.020221+0000","last_undegraded":"2024-09-10T05:58:52.020221+0000","last_fullsized":"2024-09-10T05:58:52.020221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024294+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:58:52.024294+0000","last_peered":"2024-09-10T05:58:52.024294+0000","last_clean":"2024-09-10T05:58:52.024294+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:58:52.024294+0000","last_undegraded":"2024-09-10T05:58:52.024294+0000","last_fullsized":"2024-09-10T05:58:52.024294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022136+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:58:52.022136+0000","last_peered":"2024-09-10T05:58:52.022136+0000","last_clean":"2024-09-10T05:58:52.022136+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:58:52.022136+0000","last_undegraded":"2024-09-10T05:58:52.022136+0000","last_fullsized":"2024-09-10T05:58:52.022136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020427+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:58:52.020427+0000","last_peered":"2024-09-10T05:58:52.020427+0000","last_clean":"2024-09-10T05:58:52.020427+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:58:52.020427+0000","last_undegraded":"2024-09-10T05:58:52.020427+0000","last_fullsized":"2024-09-10T05:58:52.020427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"111'134","reported_seq":382,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236780+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:58:51.236780+0000","last_peered":"2024-09-10T05:58:51.236780+0000","last_clean":"2024-09-10T05:58:51.236780+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:58:51.236780+0000","last_undegraded":"2024-09-10T05:58:51.236780+0000","last_fullsized":"2024-09-10T05:58:51.236780+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024022+0000","last_change":"2024-09-10T05:58:40.566181+0000","last_active":"2024-09-10T05:58:52.024022+0000","last_peered":"2024-09-10T05:58:52.024022+0000","last_clean":"2024-09-10T05:58:52.024022+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:58:52.024022+0000","last_undegraded":"2024-09-10T05:58:52.024022+0000","last_fullsized":"2024-09-10T05:58:52.024022+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.161299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019489+0000","last_change":"2024-09-10T05:58:38.725304+0000","last_active":"2024-09-10T05:58:52.019489+0000","last_peered":"2024-09-10T05:58:52.019489+0000","last_clean":"2024-09-10T05:58:52.019489+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:58:52.019489+0000","last_undegraded":"2024-09-10T05:58:52.019489+0000","last_fullsized":"2024-09-10T05:58:52.019489+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:37.191390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'22","reported_seq":86,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024135+0000","last_change":"2024-09-10T05:58:41.098579+0000","last_active":"2024-09-10T05:58:52.024135+0000","last_peered":"2024-09-10T05:58:52.024135+0000","last_clean":"2024-09-10T05:58:52.024135+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:58:52.024135+0000","last_undegraded":"2024-09-10T05:58:52.024135+0000","last_fullsized":"2024-09-10T05:58:52.024135+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:26.154411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021066+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:58:52.021066+0000","last_peered":"2024-09-10T05:58:52.021066+0000","last_clean":"2024-09-10T05:58:52.021066+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:58:52.021066+0000","last_undegraded":"2024-09-10T05:58:52.021066+0000","last_fullsized":"2024-09-10T05:58:52.021066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":238,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177207+0000","last_change":"2024-09-10T05:58:36.065339+0000","last_active":"2024-09-10T05:58:51.177207+0000","last_peered":"2024-09-10T05:58:51.177207+0000","last_clean":"2024-09-10T05:58:51.177207+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:58:51.177207+0000","last_undegraded":"2024-09-10T05:58:51.177207+0000","last_fullsized":"2024-09-10T05:58:51.177207+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:58.311550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":317,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178047+0000","last_change":"2024-09-10T05:58:39.400842+0000","last_active":"2024-09-10T05:58:51.178047+0000","last_peered":"2024-09-10T05:58:51.178047+0000","last_clean":"2024-09-10T05:58:51.178047+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:58:51.178047+0000","last_undegraded":"2024-09-10T05:58:51.178047+0000","last_fullsized":"2024-09-10T05:58:51.178047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:57.886787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"122'141","reported_seq":316,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022821+0000","last_change":"2024-09-10T05:58:42.102476+0000","last_active":"2024-09-10T05:58:52.022821+0000","last_peered":"2024-09-10T05:58:52.022821+0000","last_clean":"2024-09-10T05:58:52.022821+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:58:52.022821+0000","last_undegraded":"2024-09-10T05:58:52.022821+0000","last_fullsized":"2024-09-10T05:58:52.022821+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:33.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":227,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180768+0000","last_change":"2024-09-10T05:58:36.071317+0000","last_active":"2024-09-10T05:58:51.180768+0000","last_peered":"2024-09-10T05:58:51.180768+0000","last_clean":"2024-09-10T05:58:51.180768+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:58:51.180768+0000","last_undegraded":"2024-09-10T05:58:51.180768+0000","last_fullsized":"2024-09-10T05:58:51.180768+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:36.078639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177452+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:58:51.177452+0000","last_peered":"2024-09-10T05:58:51.177452+0000","last_clean":"2024-09-10T05:58:51.177452+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:58:51.177452+0000","last_undegraded":"2024-09-10T05:58:51.177452+0000","last_fullsized":"2024-09-10T05:58:51.177452+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'21","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.182189+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:58:51.182189+0000","last_peered":"2024-09-10T05:58:51.182189+0000","last_clean":"2024-09-10T05:58:51.182189+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:58:51.182189+0000","last_undegraded":"2024-09-10T05:58:51.182189+0000","last_fullsized":"2024-09-10T05:58:51.182189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024970+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:58:52.024970+0000","last_peered":"2024-09-10T05:58:52.024970+0000","last_clean":"2024-09-10T05:58:52.024970+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:58:52.024970+0000","last_undegraded":"2024-09-10T05:58:52.024970+0000","last_fullsized":"2024-09-10T05:58:52.024970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019774+0000","last_change":"2024-09-10T05:58:36.083175+0000","last_active":"2024-09-10T05:58:52.019774+0000","last_peered":"2024-09-10T05:58:52.019774+0000","last_clean":"2024-09-10T05:58:52.019774+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:58:52.019774+0000","last_undegraded":"2024-09-10T05:58:52.019774+0000","last_fullsized":"2024-09-10T05:58:52.019774+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:50.357709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"111'50","reported_seq":285,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021486+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:58:52.021486+0000","last_peered":"2024-09-10T05:58:52.021486+0000","last_clean":"2024-09-10T05:58:52.021486+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:58:52.021486+0000","last_undegraded":"2024-09-10T05:58:52.021486+0000","last_fullsized":"2024-09-10T05:58:52.021486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020885+0000","last_change":"2024-09-10T05:58:36.068927+0000","last_active":"2024-09-10T05:58:52.020885+0000","last_peered":"2024-09-10T05:58:52.020885+0000","last_clean":"2024-09-10T05:58:52.020885+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:58:52.020885+0000","last_undegraded":"2024-09-10T05:58:52.020885+0000","last_fullsized":"2024-09-10T05:58:52.020885+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:34.118740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236794+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:58:51.236794+0000","last_peered":"2024-09-10T05:58:51.236794+0000","last_clean":"2024-09-10T05:58:51.236794+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:58:51.236794+0000","last_undegraded":"2024-09-10T05:58:51.236794+0000","last_fullsized":"2024-09-10T05:58:51.236794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181091+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:58:51.181091+0000","last_peered":"2024-09-10T05:58:51.181091+0000","last_clean":"2024-09-10T05:58:51.181091+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:58:51.181091+0000","last_undegraded":"2024-09-10T05:58:51.181091+0000","last_fullsized":"2024-09-10T05:58:51.181091+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":240,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177962+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:58:51.177962+0000","last_peered":"2024-09-10T05:58:51.177962+0000","last_clean":"2024-09-10T05:58:51.177962+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:58:51.177962+0000","last_undegraded":"2024-09-10T05:58:51.177962+0000","last_fullsized":"2024-09-10T05:58:51.177962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'26","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178504+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:58:51.178504+0000","last_peered":"2024-09-10T05:58:51.178504+0000","last_clean":"2024-09-10T05:58:51.178504+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:58:51.178504+0000","last_undegraded":"2024-09-10T05:58:51.178504+0000","last_fullsized":"2024-09-10T05:58:51.178504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019957+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:58:52.019957+0000","last_peered":"2024-09-10T05:58:52.019957+0000","last_clean":"2024-09-10T05:58:52.019957+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:58:52.019957+0000","last_undegraded":"2024-09-10T05:58:52.019957+0000","last_fullsized":"2024-09-10T05:58:52.019957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"111'26","reported_seq":54,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020527+0000","last_change":"2024-09-10T05:58:36.101085+0000","last_active":"2024-09-10T05:58:52.020527+0000","last_peered":"2024-09-10T05:58:52.020527+0000","last_clean":"2024-09-10T05:58:52.020527+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:58:52.020527+0000","last_undegraded":"2024-09-10T05:58:52.020527+0000","last_fullsized":"2024-09-10T05:58:52.020527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:36.463324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019084+0000","last_change":"2024-09-10T05:58:36.083554+0000","last_active":"2024-09-10T05:58:52.019084+0000","last_peered":"2024-09-10T05:58:52.019084+0000","last_clean":"2024-09-10T05:58:52.019084+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:58:52.019084+0000","last_undegraded":"2024-09-10T05:58:52.019084+0000","last_fullsized":"2024-09-10T05:58:52.019084+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:47.211919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022829+0000","last_change":"2024-09-10T05:58:36.106761+0000","last_active":"2024-09-10T05:58:52.022829+0000","last_peered":"2024-09-10T05:58:52.022829+0000","last_clean":"2024-09-10T05:58:52.022829+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:58:52.022829+0000","last_undegraded":"2024-09-10T05:58:52.022829+0000","last_fullsized":"2024-09-10T05:58:52.022829+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:44.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":240,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019852+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:58:52.019852+0000","last_peered":"2024-09-10T05:58:52.019852+0000","last_clean":"2024-09-10T05:58:52.019852+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:58:52.019852+0000","last_undegraded":"2024-09-10T05:58:52.019852+0000","last_fullsized":"2024-09-10T05:58:52.019852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'25","reported_seq":337,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023868+0000","last_change":"2024-09-10T05:58:36.704691+0000","last_active":"2024-09-10T05:58:52.023868+0000","last_peered":"2024-09-10T05:58:52.023868+0000","last_clean":"2024-09-10T05:58:52.023868+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:58:52.023868+0000","last_undegraded":"2024-09-10T05:58:52.023868+0000","last_fullsized":"2024-09-10T05:58:52.023868+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:15.480906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022386+0000","last_change":"2024-09-10T05:58:36.087688+0000","last_active":"2024-09-10T05:58:52.022386+0000","last_peered":"2024-09-10T05:58:52.022386+0000","last_clean":"2024-09-10T05:58:52.022386+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:58:52.022386+0000","last_undegraded":"2024-09-10T05:58:52.022386+0000","last_fullsized":"2024-09-10T05:58:52.022386+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:11.802961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'10","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180035+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:58:51.180035+0000","last_peered":"2024-09-10T05:58:51.180035+0000","last_clean":"2024-09-10T05:58:51.180035+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:58:51.180035+0000","last_undegraded":"2024-09-10T05:58:51.180035+0000","last_fullsized":"2024-09-10T05:58:51.180035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020559+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:58:52.020559+0000","last_peered":"2024-09-10T05:58:52.020559+0000","last_clean":"2024-09-10T05:58:52.020559+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:58:52.020559+0000","last_undegraded":"2024-09-10T05:58:52.020559+0000","last_fullsized":"2024-09-10T05:58:52.020559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180457+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:58:51.180457+0000","last_peered":"2024-09-10T05:58:51.180457+0000","last_clean":"2024-09-10T05:58:51.180457+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:58:51.180457+0000","last_undegraded":"2024-09-10T05:58:51.180457+0000","last_fullsized":"2024-09-10T05:58:51.180457+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":48,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020434+0000","last_change":"2024-09-10T05:58:36.104832+0000","last_active":"2024-09-10T05:58:52.020434+0000","last_peered":"2024-09-10T05:58:52.020434+0000","last_clean":"2024-09-10T05:58:52.020434+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:58:52.020434+0000","last_undegraded":"2024-09-10T05:58:52.020434+0000","last_fullsized":"2024-09-10T05:58:52.020434+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:15.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'23","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238235+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:58:51.238235+0000","last_peered":"2024-09-10T05:58:51.238235+0000","last_clean":"2024-09-10T05:58:51.238235+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:58:51.238235+0000","last_undegraded":"2024-09-10T05:58:51.238235+0000","last_fullsized":"2024-09-10T05:58:51.238235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019710+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:58:52.019710+0000","last_peered":"2024-09-10T05:58:52.019710+0000","last_clean":"2024-09-10T05:58:52.019710+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:58:52.019710+0000","last_undegraded":"2024-09-10T05:58:52.019710+0000","last_fullsized":"2024-09-10T05:58:52.019710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"111'21","reported_seq":52,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022484+0000","last_change":"2024-09-10T05:58:41.135121+0000","last_active":"2024-09-10T05:58:52.022484+0000","last_peered":"2024-09-10T05:58:52.022484+0000","last_clean":"2024-09-10T05:58:52.022484+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:58:52.022484+0000","last_undegraded":"2024-09-10T05:58:52.022484+0000","last_fullsized":"2024-09-10T05:58:52.022484+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:59.259766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021225+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:58:52.021225+0000","last_peered":"2024-09-10T05:58:52.021225+0000","last_clean":"2024-09-10T05:58:52.021225+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:58:52.021225+0000","last_undegraded":"2024-09-10T05:58:52.021225+0000","last_fullsized":"2024-09-10T05:58:52.021225+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236308+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:58:51.236308+0000","last_peered":"2024-09-10T05:58:51.236308+0000","last_clean":"2024-09-10T05:58:51.236308+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:58:51.236308+0000","last_undegraded":"2024-09-10T05:58:51.236308+0000","last_fullsized":"2024-09-10T05:58:51.236308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019262+0000","last_change":"2024-09-10T05:58:41.614433+0000","last_active":"2024-09-10T05:58:52.019262+0000","last_peered":"2024-09-10T05:58:52.019262+0000","last_clean":"2024-09-10T05:58:52.019262+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:58:52.019262+0000","last_undegraded":"2024-09-10T05:58:52.019262+0000","last_fullsized":"2024-09-10T05:58:52.019262+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:59.859364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'30","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181683+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:58:51.181683+0000","last_peered":"2024-09-10T05:58:51.181683+0000","last_clean":"2024-09-10T05:58:51.181683+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:58:51.181683+0000","last_undegraded":"2024-09-10T05:58:51.181683+0000","last_fullsized":"2024-09-10T05:58:51.181683+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021240+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:58:52.021240+0000","last_peered":"2024-09-10T05:58:52.021240+0000","last_clean":"2024-09-10T05:58:52.021240+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:58:52.021240+0000","last_undegraded":"2024-09-10T05:58:52.021240+0000","last_fullsized":"2024-09-10T05:58:52.021240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"111'17","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020563+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:58:52.020563+0000","last_peered":"2024-09-10T05:58:52.020563+0000","last_clean":"2024-09-10T05:58:52.020563+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:58:52.020563+0000","last_undegraded":"2024-09-10T05:58:52.020563+0000","last_fullsized":"2024-09-10T05:58:52.020563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180107+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:58:51.180107+0000","last_peered":"2024-09-10T05:58:51.180107+0000","last_clean":"2024-09-10T05:58:51.180107+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:58:51.180107+0000","last_undegraded":"2024-09-10T05:58:51.180107+0000","last_fullsized":"2024-09-10T05:58:51.180107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024846+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:58:52.024846+0000","last_peered":"2024-09-10T05:58:52.024846+0000","last_clean":"2024-09-10T05:58:52.024846+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:58:52.024846+0000","last_undegraded":"2024-09-10T05:58:52.024846+0000","last_fullsized":"2024-09-10T05:58:52.024846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":92,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019349+0000","last_change":"2024-09-10T05:58:39.178040+0000","last_active":"2024-09-10T05:58:52.019349+0000","last_peered":"2024-09-10T05:58:52.019349+0000","last_clean":"2024-09-10T05:58:52.019349+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:58:52.019349+0000","last_undegraded":"2024-09-10T05:58:52.019349+0000","last_fullsized":"2024-09-10T05:58:52.019349+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:03.677156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181404+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:58:51.181404+0000","last_peered":"2024-09-10T05:58:51.181404+0000","last_clean":"2024-09-10T05:58:51.181404+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:58:51.181404+0000","last_undegraded":"2024-09-10T05:58:51.181404+0000","last_fullsized":"2024-09-10T05:58:51.181404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"111'38","reported_seq":265,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020365+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:58:52.020365+0000","last_peered":"2024-09-10T05:58:52.020365+0000","last_clean":"2024-09-10T05:58:52.020365+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:58:52.020365+0000","last_undegraded":"2024-09-10T05:58:52.020365+0000","last_fullsized":"2024-09-10T05:58:52.020365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":231,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236696+0000","last_change":"2024-09-10T05:58:36.082148+0000","last_active":"2024-09-10T05:58:51.236696+0000","last_peered":"2024-09-10T05:58:51.236696+0000","last_clean":"2024-09-10T05:58:51.236696+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:58:51.236696+0000","last_undegraded":"2024-09-10T05:58:51.236696+0000","last_fullsized":"2024-09-10T05:58:51.236696+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:32.319630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022296+0000","last_change":"2024-09-10T05:58:36.090193+0000","last_active":"2024-09-10T05:58:52.022296+0000","last_peered":"2024-09-10T05:58:52.022296+0000","last_clean":"2024-09-10T05:58:52.022296+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:58:52.022296+0000","last_undegraded":"2024-09-10T05:58:52.022296+0000","last_fullsized":"2024-09-10T05:58:52.022296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:35.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":227,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181739+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:58:51.181739+0000","last_peered":"2024-09-10T05:58:51.181739+0000","last_clean":"2024-09-10T05:58:51.181739+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:58:51.181739+0000","last_undegraded":"2024-09-10T05:58:51.181739+0000","last_fullsized":"2024-09-10T05:58:51.181739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'25","reported_seq":341,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021132+0000","last_change":"2024-09-10T05:58:38.989267+0000","last_active":"2024-09-10T05:58:52.021132+0000","last_peered":"2024-09-10T05:58:52.021132+0000","last_clean":"2024-09-10T05:58:52.021132+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:58:52.021132+0000","last_undegraded":"2024-09-10T05:58:52.021132+0000","last_fullsized":"2024-09-10T05:58:52.021132+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:54.603097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024628+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:58:52.024628+0000","last_peered":"2024-09-10T05:58:52.024628+0000","last_clean":"2024-09-10T05:58:52.024628+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:58:52.024628+0000","last_undegraded":"2024-09-10T05:58:52.024628+0000","last_fullsized":"2024-09-10T05:58:52.024628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"111'23","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021623+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:58:52.021623+0000","last_peered":"2024-09-10T05:58:52.021623+0000","last_clean":"2024-09-10T05:58:52.021623+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:58:52.021623+0000","last_undegraded":"2024-09-10T05:58:52.021623+0000","last_fullsized":"2024-09-10T05:58:52.021623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020566+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:58:52.020566+0000","last_peered":"2024-09-10T05:58:52.020566+0000","last_clean":"2024-09-10T05:58:52.020566+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:58:52.020566+0000","last_undegraded":"2024-09-10T05:58:52.020566+0000","last_fullsized":"2024-09-10T05:58:52.020566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":203,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020836+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:58:52.020836+0000","last_peered":"2024-09-10T05:58:52.020836+0000","last_clean":"2024-09-10T05:58:52.020836+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:58:52.020836+0000","last_undegraded":"2024-09-10T05:58:52.020836+0000","last_fullsized":"2024-09-10T05:58:52.020836+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022424+0000","last_change":"2024-09-10T05:58:36.755598+0000","last_active":"2024-09-10T05:58:52.022424+0000","last_peered":"2024-09-10T05:58:52.022424+0000","last_clean":"2024-09-10T05:58:52.022424+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:58:52.022424+0000","last_undegraded":"2024-09-10T05:58:52.022424+0000","last_fullsized":"2024-09-10T05:58:52.022424+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:58.858812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'19","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178487+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:58:51.178487+0000","last_peered":"2024-09-10T05:58:51.178487+0000","last_clean":"2024-09-10T05:58:51.178487+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:58:51.178487+0000","last_undegraded":"2024-09-10T05:58:51.178487+0000","last_fullsized":"2024-09-10T05:58:51.178487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":344,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179886+0000","last_change":"2024-09-10T05:58:40.731017+0000","last_active":"2024-09-10T05:58:51.179886+0000","last_peered":"2024-09-10T05:58:51.179886+0000","last_clean":"2024-09-10T05:58:51.179886+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:58:51.179886+0000","last_undegraded":"2024-09-10T05:58:51.179886+0000","last_fullsized":"2024-09-10T05:58:51.179886+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:36.888425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"111'28","reported_seq":54,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023828+0000","last_change":"2024-09-10T05:58:41.114451+0000","last_active":"2024-09-10T05:58:52.023828+0000","last_peered":"2024-09-10T05:58:52.023828+0000","last_clean":"2024-09-10T05:58:52.023828+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:58:52.023828+0000","last_undegraded":"2024-09-10T05:58:52.023828+0000","last_fullsized":"2024-09-10T05:58:52.023828+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:53.586626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62802,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":230,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020254+0000","last_change":"2024-09-10T05:58:36.073669+0000","last_active":"2024-09-10T05:58:52.020254+0000","last_peered":"2024-09-10T05:58:52.020254+0000","last_clean":"2024-09-10T05:58:52.020254+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:58:52.020254+0000","last_undegraded":"2024-09-10T05:58:52.020254+0000","last_fullsized":"2024-09-10T05:58:52.020254+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.770687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":209,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.235996+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:58:51.235996+0000","last_peered":"2024-09-10T05:58:51.235996+0000","last_clean":"2024-09-10T05:58:51.235996+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:58:51.235996+0000","last_undegraded":"2024-09-10T05:58:51.235996+0000","last_fullsized":"2024-09-10T05:58:51.235996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019788+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:58:52.019788+0000","last_peered":"2024-09-10T05:58:52.019788+0000","last_clean":"2024-09-10T05:58:52.019788+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:58:52.019788+0000","last_undegraded":"2024-09-10T05:58:52.019788+0000","last_fullsized":"2024-09-10T05:58:52.019788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'26","reported_seq":249,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180125+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:58:51.180125+0000","last_peered":"2024-09-10T05:58:51.180125+0000","last_clean":"2024-09-10T05:58:51.180125+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:58:51.180125+0000","last_undegraded":"2024-09-10T05:58:51.180125+0000","last_fullsized":"2024-09-10T05:58:51.180125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021577+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:58:52.021577+0000","last_peered":"2024-09-10T05:58:52.021577+0000","last_clean":"2024-09-10T05:58:52.021577+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:58:52.021577+0000","last_undegraded":"2024-09-10T05:58:52.021577+0000","last_fullsized":"2024-09-10T05:58:52.021577+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":237,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178939+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:58:51.178939+0000","last_peered":"2024-09-10T05:58:51.178939+0000","last_clean":"2024-09-10T05:58:51.178939+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:58:51.178939+0000","last_undegraded":"2024-09-10T05:58:51.178939+0000","last_fullsized":"2024-09-10T05:58:51.178939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"111'134","reported_seq":382,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024122+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:58:52.024122+0000","last_peered":"2024-09-10T05:58:52.024122+0000","last_clean":"2024-09-10T05:58:52.024122+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:58:52.024122+0000","last_undegraded":"2024-09-10T05:58:52.024122+0000","last_fullsized":"2024-09-10T05:58:52.024122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":212,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019718+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:58:52.019718+0000","last_peered":"2024-09-10T05:58:52.019718+0000","last_clean":"2024-09-10T05:58:52.019718+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:58:52.019718+0000","last_undegraded":"2024-09-10T05:58:52.019718+0000","last_fullsized":"2024-09-10T05:58:52.019718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":270,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177680+0000","last_change":"2024-09-10T05:58:40.129243+0000","last_active":"2024-09-10T05:58:51.177680+0000","last_peered":"2024-09-10T05:58:51.177680+0000","last_clean":"2024-09-10T05:58:51.177680+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:58:51.177680+0000","last_undegraded":"2024-09-10T05:58:51.177680+0000","last_fullsized":"2024-09-10T05:58:51.177680+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:22.831721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'17","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237316+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:58:51.237316+0000","last_peered":"2024-09-10T05:58:51.237316+0000","last_clean":"2024-09-10T05:58:51.237316+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:58:51.237316+0000","last_undegraded":"2024-09-10T05:58:51.237316+0000","last_fullsized":"2024-09-10T05:58:51.237316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":216,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020828+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:58:52.020828+0000","last_peered":"2024-09-10T05:58:52.020828+0000","last_clean":"2024-09-10T05:58:52.020828+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:58:52.020828+0000","last_undegraded":"2024-09-10T05:58:52.020828+0000","last_fullsized":"2024-09-10T05:58:52.020828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"111'48","reported_seq":293,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236290+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:58:51.236290+0000","last_peered":"2024-09-10T05:58:51.236290+0000","last_clean":"2024-09-10T05:58:51.236290+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:58:51.236290+0000","last_undegraded":"2024-09-10T05:58:51.236290+0000","last_fullsized":"2024-09-10T05:58:51.236290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":64,"num_read_kb":51,"num_write":42,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177538+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:58:51.177538+0000","last_peered":"2024-09-10T05:58:51.177538+0000","last_clean":"2024-09-10T05:58:51.177538+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:58:51.177538+0000","last_undegraded":"2024-09-10T05:58:51.177538+0000","last_fullsized":"2024-09-10T05:58:51.177538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":204,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023234+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:58:52.023234+0000","last_peered":"2024-09-10T05:58:52.023234+0000","last_clean":"2024-09-10T05:58:52.023234+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:58:52.023234+0000","last_undegraded":"2024-09-10T05:58:52.023234+0000","last_fullsized":"2024-09-10T05:58:52.023234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":289,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178127+0000","last_change":"2024-09-10T05:58:37.200455+0000","last_active":"2024-09-10T05:58:51.178127+0000","last_peered":"2024-09-10T05:58:51.178127+0000","last_clean":"2024-09-10T05:58:51.178127+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:58:51.178127+0000","last_undegraded":"2024-09-10T05:58:51.178127+0000","last_fullsized":"2024-09-10T05:58:51.178127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.815795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'23","reported_seq":246,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238244+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:58:51.238244+0000","last_peered":"2024-09-10T05:58:51.238244+0000","last_clean":"2024-09-10T05:58:51.238244+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:58:51.238244+0000","last_undegraded":"2024-09-10T05:58:51.238244+0000","last_fullsized":"2024-09-10T05:58:51.238244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236546+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:58:51.236546+0000","last_peered":"2024-09-10T05:58:51.236546+0000","last_clean":"2024-09-10T05:58:51.236546+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:58:51.236546+0000","last_undegraded":"2024-09-10T05:58:51.236546+0000","last_fullsized":"2024-09-10T05:58:51.236546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"111'23","reported_seq":247,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177550+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:58:51.177550+0000","last_peered":"2024-09-10T05:58:51.177550+0000","last_clean":"2024-09-10T05:58:51.177550+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:58:51.177550+0000","last_undegraded":"2024-09-10T05:58:51.177550+0000","last_fullsized":"2024-09-10T05:58:51.177550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020725+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:58:52.020725+0000","last_peered":"2024-09-10T05:58:52.020725+0000","last_clean":"2024-09-10T05:58:52.020725+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:58:52.020725+0000","last_undegraded":"2024-09-10T05:58:52.020725+0000","last_fullsized":"2024-09-10T05:58:52.020725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":44,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022711+0000","last_change":"2024-09-10T05:58:36.751943+0000","last_active":"2024-09-10T05:58:52.022711+0000","last_peered":"2024-09-10T05:58:52.022711+0000","last_clean":"2024-09-10T05:58:52.022711+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:58:52.022711+0000","last_undegraded":"2024-09-10T05:58:52.022711+0000","last_fullsized":"2024-09-10T05:58:52.022711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:52.279125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020845+0000","last_change":"2024-09-10T05:58:36.760284+0000","last_active":"2024-09-10T05:58:52.020845+0000","last_peered":"2024-09-10T05:58:52.020845+0000","last_clean":"2024-09-10T05:58:52.020845+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:58:52.020845+0000","last_undegraded":"2024-09-10T05:58:52.020845+0000","last_fullsized":"2024-09-10T05:58:52.020845+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:27.695656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'30","reported_seq":102,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022587+0000","last_change":"2024-09-10T05:58:36.748201+0000","last_active":"2024-09-10T05:58:52.022587+0000","last_peered":"2024-09-10T05:58:52.022587+0000","last_clean":"2024-09-10T05:58:52.022587+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:58:52.022587+0000","last_undegraded":"2024-09-10T05:58:52.022587+0000","last_fullsized":"2024-09-10T05:58:52.022587+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.304252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":214,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.176836+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:58:51.176836+0000","last_peered":"2024-09-10T05:58:51.176836+0000","last_clean":"2024-09-10T05:58:51.176836+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:58:51.176836+0000","last_undegraded":"2024-09-10T05:58:51.176836+0000","last_fullsized":"2024-09-10T05:58:51.176836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"111'19","reported_seq":48,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022173+0000","last_change":"2024-09-10T05:58:42.032681+0000","last_active":"2024-09-10T05:58:52.022173+0000","last_peered":"2024-09-10T05:58:52.022173+0000","last_clean":"2024-09-10T05:58:52.022173+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:58:52.022173+0000","last_undegraded":"2024-09-10T05:58:52.022173+0000","last_fullsized":"2024-09-10T05:58:52.022173+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:11.388502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":206,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177156+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:58:51.177156+0000","last_peered":"2024-09-10T05:58:51.177156+0000","last_clean":"2024-09-10T05:58:51.177156+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:58:51.177156+0000","last_undegraded":"2024-09-10T05:58:51.177156+0000","last_fullsized":"2024-09-10T05:58:51.177156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023184+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:58:52.023184+0000","last_peered":"2024-09-10T05:58:52.023184+0000","last_clean":"2024-09-10T05:58:52.023184+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:58:52.023184+0000","last_undegraded":"2024-09-10T05:58:52.023184+0000","last_fullsized":"2024-09-10T05:58:52.023184+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177337+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:58:51.177337+0000","last_peered":"2024-09-10T05:58:51.177337+0000","last_clean":"2024-09-10T05:58:51.177337+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:58:51.177337+0000","last_undegraded":"2024-09-10T05:58:51.177337+0000","last_fullsized":"2024-09-10T05:58:51.177337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'25","reported_seq":210,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019341+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:58:52.019341+0000","last_peered":"2024-09-10T05:58:52.019341+0000","last_clean":"2024-09-10T05:58:52.019341+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:58:52.019341+0000","last_undegraded":"2024-09-10T05:58:52.019341+0000","last_fullsized":"2024-09-10T05:58:52.019341+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020591+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:58:52.020591+0000","last_peered":"2024-09-10T05:58:52.020591+0000","last_clean":"2024-09-10T05:58:52.020591+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:58:52.020591+0000","last_undegraded":"2024-09-10T05:58:52.020591+0000","last_fullsized":"2024-09-10T05:58:52.020591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"111'30","reported_seq":259,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.177568+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:58:51.177568+0000","last_peered":"2024-09-10T05:58:51.177568+0000","last_clean":"2024-09-10T05:58:51.177568+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:58:51.177568+0000","last_undegraded":"2024-09-10T05:58:51.177568+0000","last_fullsized":"2024-09-10T05:58:51.177568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":207,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179764+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:58:51.179764+0000","last_peered":"2024-09-10T05:58:51.179764+0000","last_clean":"2024-09-10T05:58:51.179764+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:58:51.179764+0000","last_undegraded":"2024-09-10T05:58:51.179764+0000","last_fullsized":"2024-09-10T05:58:51.179764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":208,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179999+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:58:51.179999+0000","last_peered":"2024-09-10T05:58:51.179999+0000","last_clean":"2024-09-10T05:58:51.179999+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:58:51.179999+0000","last_undegraded":"2024-09-10T05:58:51.179999+0000","last_fullsized":"2024-09-10T05:58:51.179999+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020418+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:58:52.020418+0000","last_peered":"2024-09-10T05:58:52.020418+0000","last_clean":"2024-09-10T05:58:52.020418+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:58:52.020418+0000","last_undegraded":"2024-09-10T05:58:52.020418+0000","last_fullsized":"2024-09-10T05:58:52.020418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'30","reported_seq":253,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020899+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:58:52.020899+0000","last_peered":"2024-09-10T05:58:52.020899+0000","last_clean":"2024-09-10T05:58:52.020899+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:58:52.020899+0000","last_undegraded":"2024-09-10T05:58:52.020899+0000","last_fullsized":"2024-09-10T05:58:52.020899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020829+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:58:52.020829+0000","last_peered":"2024-09-10T05:58:52.020829+0000","last_clean":"2024-09-10T05:58:52.020829+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:58:52.020829+0000","last_undegraded":"2024-09-10T05:58:52.020829+0000","last_fullsized":"2024-09-10T05:58:52.020829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018586+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:58:52.018586+0000","last_peered":"2024-09-10T05:58:52.018586+0000","last_clean":"2024-09-10T05:58:52.018586+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:58:52.018586+0000","last_undegraded":"2024-09-10T05:58:52.018586+0000","last_fullsized":"2024-09-10T05:58:52.018586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237561+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:58:51.237561+0000","last_peered":"2024-09-10T05:58:51.237561+0000","last_clean":"2024-09-10T05:58:51.237561+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:58:51.237561+0000","last_undegraded":"2024-09-10T05:58:51.237561+0000","last_fullsized":"2024-09-10T05:58:51.237561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":317,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237541+0000","last_change":"2024-09-10T05:58:37.753575+0000","last_active":"2024-09-10T05:58:51.237541+0000","last_peered":"2024-09-10T05:58:51.237541+0000","last_clean":"2024-09-10T05:58:51.237541+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:58:51.237541+0000","last_undegraded":"2024-09-10T05:58:51.237541+0000","last_fullsized":"2024-09-10T05:58:51.237541+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:21.191915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021181+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:58:52.021181+0000","last_peered":"2024-09-10T05:58:52.021181+0000","last_clean":"2024-09-10T05:58:52.021181+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:58:52.021181+0000","last_undegraded":"2024-09-10T05:58:52.021181+0000","last_fullsized":"2024-09-10T05:58:52.021181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'22","reported_seq":325,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.180472+0000","last_change":"2024-09-10T05:58:38.431996+0000","last_active":"2024-09-10T05:58:51.180472+0000","last_peered":"2024-09-10T05:58:51.180472+0000","last_clean":"2024-09-10T05:58:51.180472+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:58:51.180472+0000","last_undegraded":"2024-09-10T05:58:51.180472+0000","last_fullsized":"2024-09-10T05:58:51.180472+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.662612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179378+0000","last_change":"2024-09-10T05:58:40.123148+0000","last_active":"2024-09-10T05:58:51.179378+0000","last_peered":"2024-09-10T05:58:51.179378+0000","last_clean":"2024-09-10T05:58:51.179378+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:58:51.179378+0000","last_undegraded":"2024-09-10T05:58:51.179378+0000","last_fullsized":"2024-09-10T05:58:51.179378+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:28.445530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"111'30","reported_seq":102,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.022628+0000","last_change":"2024-09-10T05:58:37.278065+0000","last_active":"2024-09-10T05:58:52.022628+0000","last_peered":"2024-09-10T05:58:52.022628+0000","last_clean":"2024-09-10T05:58:52.022628+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:58:52.022628+0000","last_undegraded":"2024-09-10T05:58:52.022628+0000","last_fullsized":"2024-09-10T05:58:52.022628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:23.616575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":256,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178428+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:58:51.178428+0000","last_peered":"2024-09-10T05:58:51.178428+0000","last_clean":"2024-09-10T05:58:51.178428+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:58:51.178428+0000","last_undegraded":"2024-09-10T05:58:51.178428+0000","last_fullsized":"2024-09-10T05:58:51.178428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'28","reported_seq":348,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021693+0000","last_change":"2024-09-10T05:58:37.192873+0000","last_active":"2024-09-10T05:58:52.021693+0000","last_peered":"2024-09-10T05:58:52.021693+0000","last_clean":"2024-09-10T05:58:52.021693+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:58:52.021693+0000","last_undegraded":"2024-09-10T05:58:52.021693+0000","last_fullsized":"2024-09-10T05:58:52.021693+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.993383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020610+0000","last_change":"2024-09-10T05:58:36.076255+0000","last_active":"2024-09-10T05:58:52.020610+0000","last_peered":"2024-09-10T05:58:52.020610+0000","last_clean":"2024-09-10T05:58:52.020610+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:58:52.020610+0000","last_undegraded":"2024-09-10T05:58:52.020610+0000","last_fullsized":"2024-09-10T05:58:52.020610+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:20.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'19","reported_seq":242,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024498+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:58:52.024498+0000","last_peered":"2024-09-10T05:58:52.024498+0000","last_clean":"2024-09-10T05:58:52.024498+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:58:52.024498+0000","last_undegraded":"2024-09-10T05:58:52.024498+0000","last_fullsized":"2024-09-10T05:58:52.024498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020628+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:58:52.020628+0000","last_peered":"2024-09-10T05:58:52.020628+0000","last_clean":"2024-09-10T05:58:52.020628+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:58:52.020628+0000","last_undegraded":"2024-09-10T05:58:52.020628+0000","last_fullsized":"2024-09-10T05:58:52.020628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":84,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024047+0000","last_change":"2024-09-10T05:58:40.562955+0000","last_active":"2024-09-10T05:58:52.024047+0000","last_peered":"2024-09-10T05:58:52.024047+0000","last_clean":"2024-09-10T05:58:52.024047+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:58:52.024047+0000","last_undegraded":"2024-09-10T05:58:52.024047+0000","last_fullsized":"2024-09-10T05:58:52.024047+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:55.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":259,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181598+0000","last_change":"2024-09-10T05:58:40.787117+0000","last_active":"2024-09-10T05:58:51.181598+0000","last_peered":"2024-09-10T05:58:51.181598+0000","last_clean":"2024-09-10T05:58:51.181598+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:58:51.181598+0000","last_undegraded":"2024-09-10T05:58:51.181598+0000","last_fullsized":"2024-09-10T05:58:51.181598+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:06.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'28","reported_seq":340,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236785+0000","last_change":"2024-09-10T05:58:40.117727+0000","last_active":"2024-09-10T05:58:51.236785+0000","last_peered":"2024-09-10T05:58:51.236785+0000","last_clean":"2024-09-10T05:58:51.236785+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:58:51.236785+0000","last_undegraded":"2024-09-10T05:58:51.236785+0000","last_fullsized":"2024-09-10T05:58:51.236785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:28.251854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":256,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179219+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:58:51.179219+0000","last_peered":"2024-09-10T05:58:51.179219+0000","last_clean":"2024-09-10T05:58:51.179219+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:58:51.179219+0000","last_undegraded":"2024-09-10T05:58:51.179219+0000","last_fullsized":"2024-09-10T05:58:51.179219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'21","reported_seq":84,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020759+0000","last_change":"2024-09-10T05:58:40.171208+0000","last_active":"2024-09-10T05:58:52.020759+0000","last_peered":"2024-09-10T05:58:52.020759+0000","last_clean":"2024-09-10T05:58:52.020759+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:58:52.020759+0000","last_undegraded":"2024-09-10T05:58:52.020759+0000","last_fullsized":"2024-09-10T05:58:52.020759+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:43.370109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":219,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019605+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:58:52.019605+0000","last_peered":"2024-09-10T05:58:52.019605+0000","last_clean":"2024-09-10T05:58:52.019605+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:58:52.019605+0000","last_undegraded":"2024-09-10T05:58:52.019605+0000","last_fullsized":"2024-09-10T05:58:52.019605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'33","reported_seq":256,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.236910+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:58:51.236910+0000","last_peered":"2024-09-10T05:58:51.236910+0000","last_clean":"2024-09-10T05:58:51.236910+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:58:51.236910+0000","last_undegraded":"2024-09-10T05:58:51.236910+0000","last_fullsized":"2024-09-10T05:58:51.236910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":226,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.179678+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:58:51.179678+0000","last_peered":"2024-09-10T05:58:51.179678+0000","last_clean":"2024-09-10T05:58:51.179678+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:58:51.179678+0000","last_undegraded":"2024-09-10T05:58:51.179678+0000","last_fullsized":"2024-09-10T05:58:51.179678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'18","reported_seq":241,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181119+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:58:51.181119+0000","last_peered":"2024-09-10T05:58:51.181119+0000","last_clean":"2024-09-10T05:58:51.181119+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:58:51.181119+0000","last_undegraded":"2024-09-10T05:58:51.181119+0000","last_fullsized":"2024-09-10T05:58:51.181119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":271,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.021812+0000","last_change":"2024-09-10T05:58:38.090502+0000","last_active":"2024-09-10T05:58:52.021812+0000","last_peered":"2024-09-10T05:58:52.021812+0000","last_clean":"2024-09-10T05:58:52.021812+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:58:52.021812+0000","last_undegraded":"2024-09-10T05:58:52.021812+0000","last_fullsized":"2024-09-10T05:58:52.021812+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:56.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'21","reported_seq":250,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.023463+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:58:52.023463+0000","last_peered":"2024-09-10T05:58:52.023463+0000","last_clean":"2024-09-10T05:58:52.023463+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:58:52.023463+0000","last_undegraded":"2024-09-10T05:58:52.023463+0000","last_fullsized":"2024-09-10T05:58:52.023463+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":235,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.178395+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:58:51.178395+0000","last_peered":"2024-09-10T05:58:51.178395+0000","last_clean":"2024-09-10T05:58:51.178395+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:58:51.178395+0000","last_undegraded":"2024-09-10T05:58:51.178395+0000","last_fullsized":"2024-09-10T05:58:51.178395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'24","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.024196+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:58:52.024196+0000","last_peered":"2024-09-10T05:58:52.024196+0000","last_clean":"2024-09-10T05:58:52.024196+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:58:52.024196+0000","last_undegraded":"2024-09-10T05:58:52.024196+0000","last_fullsized":"2024-09-10T05:58:52.024196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":46,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020972+0000","last_change":"2024-09-10T05:58:36.090342+0000","last_active":"2024-09-10T05:58:52.020972+0000","last_peered":"2024-09-10T05:58:52.020972+0000","last_clean":"2024-09-10T05:58:52.020972+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:58:52.020972+0000","last_undegraded":"2024-09-10T05:58:52.020972+0000","last_fullsized":"2024-09-10T05:58:52.020972+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:15.019257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"111'20","reported_seq":243,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.019935+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:58:52.019935+0000","last_peered":"2024-09-10T05:58:52.019935+0000","last_clean":"2024-09-10T05:58:52.019935+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:58:52.019935+0000","last_undegraded":"2024-09-10T05:58:52.019935+0000","last_fullsized":"2024-09-10T05:58:52.019935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":244,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020118+0000","last_change":"2024-09-10T05:58:36.079403+0000","last_active":"2024-09-10T05:58:52.020118+0000","last_peered":"2024-09-10T05:58:52.020118+0000","last_clean":"2024-09-10T05:58:52.020118+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:58:52.020118+0000","last_undegraded":"2024-09-10T05:58:52.020118+0000","last_fullsized":"2024-09-10T05:58:52.020118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.025854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'25","reported_seq":248,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.238469+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:58:51.238469+0000","last_peered":"2024-09-10T05:58:51.238469+0000","last_clean":"2024-09-10T05:58:51.238469+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:58:51.238469+0000","last_undegraded":"2024-09-10T05:58:51.238469+0000","last_fullsized":"2024-09-10T05:58:51.238469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"111'24","reported_seq":155,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.018534+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:58:52.018534+0000","last_peered":"2024-09-10T05:58:52.018534+0000","last_clean":"2024-09-10T05:58:52.018534+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:58:52.018534+0000","last_undegraded":"2024-09-10T05:58:52.018534+0000","last_fullsized":"2024-09-10T05:58:52.018534+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":275,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.181443+0000","last_change":"2024-09-10T05:58:40.744836+0000","last_active":"2024-09-10T05:58:51.181443+0000","last_peered":"2024-09-10T05:58:51.181443+0000","last_clean":"2024-09-10T05:58:51.181443+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:58:51.181443+0000","last_undegraded":"2024-09-10T05:58:51.181443+0000","last_fullsized":"2024-09-10T05:58:51.181443+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'23","reported_seq":245,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:52.020993+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:58:52.020993+0000","last_peered":"2024-09-10T05:58:52.020993+0000","last_clean":"2024-09-10T05:58:52.020993+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:58:52.020993+0000","last_undegraded":"2024-09-10T05:58:52.020993+0000","last_fullsized":"2024-09-10T05:58:52.020993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":236,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-10T05:58:51.237966+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:58:51.237966+0000","last_peered":"2024-09-10T05:58:51.237966+0000","last_clean":"2024-09-10T05:58:51.237966+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:58:51.237966+0000","last_undegraded":"2024-09-10T05:58:51.237966+0000","last_fullsized":"2024-09-10T05:58:51.237966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1086,"ondisk_log_size":1086,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382933,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1132,"num_read_kb":862,"num_write":655,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":951,"ondisk_log_size":951,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1856104,"kb_used_data":1820756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92515736,"statfs":{"total":96636764160,"available":94736113664,"internally_reserved":0,"allocated":1864454144,"data_stored":1863774286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163296,"kb_used_data":1132104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93208544,"statfs":{"total":96636764160,"available":95445549056,"internally_reserved":0,"allocated":1159274496,"data_stored":1158607791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1816860,"kb_used_data":1781504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92554980,"statfs":{"total":96636764160,"available":94776299520,"internally_reserved":0,"allocated":1824260096,"data_stored":1823530013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542193,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693836,"kb_used_data":1658484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92678004,"statfs":{"total":96636764160,"available":94902276096,"internally_reserved":0,"allocated":1698287616,"data_stored":1697633854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542193,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1931324,"kb_used_data":1900136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92440516,"statfs":{"total":96636764160,"available":94659088384,"internally_reserved":0,"allocated":1945739264,"data_stored":1945048496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099864,"kb_used_data":1060356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93271976,"statfs":{"total":96636764160,"available":95510503424,"internally_reserved":0,"allocated":1085804544,"data_stored":1085155240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202588,"kb_used_data":1163076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93169252,"statfs":{"total":96636764160,"available":95405314048,"internally_reserved":0,"allocated":1190989824,"data_stored":1190297542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1841848,"kb_used_data":1802332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92529992,"statfs":{"total":96636764160,"available":94750711808,"internally_reserved":0,"allocated":1845587968,"data_stored":1844915572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1843396608,"data_stored":1843396608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1189085184,"data_stored":1189085184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1084227584,"data_stored":1084227584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1944059904,"data_stored":1944059904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1822425088,"data_stored":1822425088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1157627904,"data_stored":1157627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1862270976,"data_stored":1862270976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":59916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":117427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":177431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:58:55.136 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-10T05:58:55.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-10T05:58:55.473 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T05:58:55.482 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T05:58:55.482 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:58:55.483 INFO:tasks.rgw.client.0.smithi070.stdout:2024-09-10T05:58:55.476+0000 7f76197fd640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31710) UID: 0 2024-09-10T05:58:55.483 INFO:tasks.rgw.client.0.smithi070.stdout:2024-09-10T05:58:55.476+0000 7f761d045a40 -1 shutting down 2024-09-10T05:59:07.686 INFO:tasks.rgw.client.0:Stopped 2024-09-10T05:59:07.686 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T05:59:07.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T05:59:07.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T05:59:07.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T05:59:07.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T05:59:07.808 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T05:59:09.077 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T05:59:09.087 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T05:59:09.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:59:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:59:09.423 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:59:09.440 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-10T05:59:07.735347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819944,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3465,"num_read_kb":3124,"num_write":2963,"num_write_kb":6187124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":853,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4066,"ondisk_log_size":4066,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":531,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12605956,"kb_used_data":12319000,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":742368764,"statfs":{"total":773094113280,"available":760185614336,"internally_reserved":0,"allocated":12614656000,"data_stored":12609129452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003582"},"pg_stats":[{"pgid":"3.3f","version":"111'22","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972734+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:59:01.972734+0000","last_peered":"2024-09-10T05:59:01.972734+0000","last_clean":"2024-09-10T05:59:01.972734+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:59:01.972734+0000","last_undegraded":"2024-09-10T05:59:01.972734+0000","last_fullsized":"2024-09-10T05:59:01.972734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971871+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:59:01.971871+0000","last_peered":"2024-09-10T05:59:01.971871+0000","last_clean":"2024-09-10T05:59:01.971871+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:59:01.971871+0000","last_undegraded":"2024-09-10T05:59:01.971871+0000","last_fullsized":"2024-09-10T05:59:01.971871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'27","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971064+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:59:01.971064+0000","last_peered":"2024-09-10T05:59:01.971064+0000","last_clean":"2024-09-10T05:59:01.971064+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:59:01.971064+0000","last_undegraded":"2024-09-10T05:59:01.971064+0000","last_fullsized":"2024-09-10T05:59:01.971064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969559+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:59:01.969559+0000","last_peered":"2024-09-10T05:59:01.969559+0000","last_clean":"2024-09-10T05:59:01.969559+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:59:01.969559+0000","last_undegraded":"2024-09-10T05:59:01.969559+0000","last_fullsized":"2024-09-10T05:59:01.969559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'27","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815127+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:59:01.815127+0000","last_peered":"2024-09-10T05:59:01.815127+0000","last_clean":"2024-09-10T05:59:01.815127+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:59:01.815127+0000","last_undegraded":"2024-09-10T05:59:01.815127+0000","last_fullsized":"2024-09-10T05:59:01.815127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813155+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:59:01.813155+0000","last_peered":"2024-09-10T05:59:01.813155+0000","last_clean":"2024-09-10T05:59:01.813155+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:59:01.813155+0000","last_undegraded":"2024-09-10T05:59:01.813155+0000","last_fullsized":"2024-09-10T05:59:01.813155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'21","reported_seq":323,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975785+0000","last_change":"2024-09-10T05:58:40.694618+0000","last_active":"2024-09-10T05:59:01.975785+0000","last_peered":"2024-09-10T05:59:01.975785+0000","last_clean":"2024-09-10T05:59:01.975785+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:59:01.975785+0000","last_undegraded":"2024-09-10T05:59:01.975785+0000","last_fullsized":"2024-09-10T05:59:01.975785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:55.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":310,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813864+0000","last_change":"2024-09-10T05:58:40.726727+0000","last_active":"2024-09-10T05:59:01.813864+0000","last_peered":"2024-09-10T05:59:01.813864+0000","last_clean":"2024-09-10T05:59:01.813864+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:59:01.813864+0000","last_undegraded":"2024-09-10T05:59:01.813864+0000","last_fullsized":"2024-09-10T05:59:01.813864+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:59.972041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'29","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969974+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:59:01.969974+0000","last_peered":"2024-09-10T05:59:01.969974+0000","last_clean":"2024-09-10T05:59:01.969974+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:59:01.969974+0000","last_undegraded":"2024-09-10T05:59:01.969974+0000","last_fullsized":"2024-09-10T05:59:01.969974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975880+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:59:01.975880+0000","last_peered":"2024-09-10T05:59:01.975880+0000","last_clean":"2024-09-10T05:59:01.975880+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:59:01.975880+0000","last_undegraded":"2024-09-10T05:59:01.975880+0000","last_fullsized":"2024-09-10T05:59:01.975880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973856+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:59:01.973856+0000","last_peered":"2024-09-10T05:59:01.973856+0000","last_clean":"2024-09-10T05:59:01.973856+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:59:01.973856+0000","last_undegraded":"2024-09-10T05:59:01.973856+0000","last_fullsized":"2024-09-10T05:59:01.973856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814413+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:59:01.814413+0000","last_peered":"2024-09-10T05:59:01.814413+0000","last_clean":"2024-09-10T05:59:01.814413+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:59:01.814413+0000","last_undegraded":"2024-09-10T05:59:01.814413+0000","last_fullsized":"2024-09-10T05:59:01.814413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'20","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970430+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:59:01.970430+0000","last_peered":"2024-09-10T05:59:01.970430+0000","last_clean":"2024-09-10T05:59:01.970430+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:59:01.970430+0000","last_undegraded":"2024-09-10T05:59:01.970430+0000","last_fullsized":"2024-09-10T05:59:01.970430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975884+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:59:01.975884+0000","last_peered":"2024-09-10T05:59:01.975884+0000","last_clean":"2024-09-10T05:59:01.975884+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:59:01.975884+0000","last_undegraded":"2024-09-10T05:59:01.975884+0000","last_fullsized":"2024-09-10T05:59:01.975884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'13","reported_seq":72,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822936+0000","last_change":"2024-09-10T05:58:42.015968+0000","last_active":"2024-09-10T05:59:01.822936+0000","last_peered":"2024-09-10T05:59:01.822936+0000","last_clean":"2024-09-10T05:59:01.822936+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:59:01.822936+0000","last_undegraded":"2024-09-10T05:59:01.822936+0000","last_fullsized":"2024-09-10T05:59:01.822936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:22.893621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.986778+0000","last_change":"2024-09-10T05:59:01.986479+0000","last_active":"2024-09-10T05:59:01.986778+0000","last_peered":"2024-09-10T05:59:01.986778+0000","last_clean":"2024-09-10T05:59:01.986778+0000","last_became_active":"2024-09-10T05:59:01.981080+0000","last_became_peered":"2024-09-10T05:59:01.981080+0000","last_unstale":"2024-09-10T05:59:01.986778+0000","last_undegraded":"2024-09-10T05:59:01.986778+0000","last_fullsized":"2024-09-10T05:59:01.986778+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:00.572672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812290+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:59:01.812290+0000","last_peered":"2024-09-10T05:59:01.812290+0000","last_clean":"2024-09-10T05:59:01.812290+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:59:01.812290+0000","last_undegraded":"2024-09-10T05:59:01.812290+0000","last_fullsized":"2024-09-10T05:59:01.812290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'19","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972982+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:59:01.972982+0000","last_peered":"2024-09-10T05:59:01.972982+0000","last_clean":"2024-09-10T05:59:01.972982+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:59:01.972982+0000","last_undegraded":"2024-09-10T05:59:01.972982+0000","last_fullsized":"2024-09-10T05:59:01.972982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969838+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:59:01.969838+0000","last_peered":"2024-09-10T05:59:01.969838+0000","last_clean":"2024-09-10T05:59:01.969838+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:59:01.969838+0000","last_undegraded":"2024-09-10T05:59:01.969838+0000","last_fullsized":"2024-09-10T05:59:01.969838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978182+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:59:01.978182+0000","last_peered":"2024-09-10T05:59:01.978182+0000","last_clean":"2024-09-10T05:59:01.978182+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:59:01.978182+0000","last_undegraded":"2024-09-10T05:59:01.978182+0000","last_fullsized":"2024-09-10T05:59:01.978182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974629+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:59:01.974629+0000","last_peered":"2024-09-10T05:59:01.974629+0000","last_clean":"2024-09-10T05:59:01.974629+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:59:01.974629+0000","last_undegraded":"2024-09-10T05:59:01.974629+0000","last_fullsized":"2024-09-10T05:59:01.974629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'18","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978095+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:59:01.978095+0000","last_peered":"2024-09-10T05:59:01.978095+0000","last_clean":"2024-09-10T05:59:01.978095+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:59:01.978095+0000","last_undegraded":"2024-09-10T05:59:01.978095+0000","last_fullsized":"2024-09-10T05:59:01.978095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":277,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816892+0000","last_change":"2024-09-10T05:58:39.367642+0000","last_active":"2024-09-10T05:59:01.816892+0000","last_peered":"2024-09-10T05:59:01.816892+0000","last_clean":"2024-09-10T05:59:01.816892+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:59:01.816892+0000","last_undegraded":"2024-09-10T05:59:01.816892+0000","last_fullsized":"2024-09-10T05:59:01.816892+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'28","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814125+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:59:01.814125+0000","last_peered":"2024-09-10T05:59:01.814125+0000","last_clean":"2024-09-10T05:59:01.814125+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:59:01.814125+0000","last_undegraded":"2024-09-10T05:59:01.814125+0000","last_fullsized":"2024-09-10T05:59:01.814125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818018+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:59:01.818018+0000","last_peered":"2024-09-10T05:59:01.818018+0000","last_clean":"2024-09-10T05:59:01.818018+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:59:01.818018+0000","last_undegraded":"2024-09-10T05:59:01.818018+0000","last_fullsized":"2024-09-10T05:59:01.818018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824233+0000","last_change":"2024-09-10T05:58:42.304778+0000","last_active":"2024-09-10T05:59:01.824233+0000","last_peered":"2024-09-10T05:59:01.824233+0000","last_clean":"2024-09-10T05:59:01.824233+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:59:01.824233+0000","last_undegraded":"2024-09-10T05:59:01.824233+0000","last_fullsized":"2024-09-10T05:59:01.824233+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:41.747059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814552+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:59:01.814552+0000","last_peered":"2024-09-10T05:59:01.814552+0000","last_clean":"2024-09-10T05:59:01.814552+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:59:01.814552+0000","last_undegraded":"2024-09-10T05:59:01.814552+0000","last_fullsized":"2024-09-10T05:59:01.814552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813423+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:59:01.813423+0000","last_peered":"2024-09-10T05:59:01.813423+0000","last_clean":"2024-09-10T05:59:01.813423+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:59:01.813423+0000","last_undegraded":"2024-09-10T05:59:01.813423+0000","last_fullsized":"2024-09-10T05:59:01.813423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811956+0000","last_change":"2024-09-10T05:58:38.995573+0000","last_active":"2024-09-10T05:59:01.811956+0000","last_peered":"2024-09-10T05:59:01.811956+0000","last_clean":"2024-09-10T05:59:01.811956+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:59:01.811956+0000","last_undegraded":"2024-09-10T05:59:01.811956+0000","last_fullsized":"2024-09-10T05:59:01.811956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":54,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825533+0000","last_change":"2024-09-10T05:58:37.289796+0000","last_active":"2024-09-10T05:59:01.825533+0000","last_peered":"2024-09-10T05:59:01.825533+0000","last_clean":"2024-09-10T05:59:01.825533+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:59:01.825533+0000","last_undegraded":"2024-09-10T05:59:01.825533+0000","last_fullsized":"2024-09-10T05:59:01.825533+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:13.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'19","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970418+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:59:01.970418+0000","last_peered":"2024-09-10T05:59:01.970418+0000","last_clean":"2024-09-10T05:59:01.970418+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:59:01.970418+0000","last_undegraded":"2024-09-10T05:59:01.970418+0000","last_fullsized":"2024-09-10T05:59:01.970418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976010+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:59:01.976010+0000","last_peered":"2024-09-10T05:59:01.976010+0000","last_clean":"2024-09-10T05:59:01.976010+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:59:01.976010+0000","last_undegraded":"2024-09-10T05:59:01.976010+0000","last_fullsized":"2024-09-10T05:59:01.976010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"111'30","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815225+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:59:01.815225+0000","last_peered":"2024-09-10T05:59:01.815225+0000","last_clean":"2024-09-10T05:59:01.815225+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:59:01.815225+0000","last_undegraded":"2024-09-10T05:59:01.815225+0000","last_fullsized":"2024-09-10T05:59:01.815225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972175+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:59:01.972175+0000","last_peered":"2024-09-10T05:59:01.972175+0000","last_clean":"2024-09-10T05:59:01.972175+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:59:01.972175+0000","last_undegraded":"2024-09-10T05:59:01.972175+0000","last_fullsized":"2024-09-10T05:59:01.972175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"111'48","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972638+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:59:01.972638+0000","last_peered":"2024-09-10T05:59:01.972638+0000","last_clean":"2024-09-10T05:59:01.972638+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:59:01.972638+0000","last_undegraded":"2024-09-10T05:59:01.972638+0000","last_fullsized":"2024-09-10T05:59:01.972638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980010+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:59:01.980010+0000","last_peered":"2024-09-10T05:59:01.980010+0000","last_clean":"2024-09-10T05:59:01.980010+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:59:01.980010+0000","last_undegraded":"2024-09-10T05:59:01.980010+0000","last_fullsized":"2024-09-10T05:59:01.980010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813555+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:59:01.813555+0000","last_peered":"2024-09-10T05:59:01.813555+0000","last_clean":"2024-09-10T05:59:01.813555+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:59:01.813555+0000","last_undegraded":"2024-09-10T05:59:01.813555+0000","last_fullsized":"2024-09-10T05:59:01.813555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825797+0000","last_change":"2024-09-10T05:58:36.074698+0000","last_active":"2024-09-10T05:59:01.825797+0000","last_peered":"2024-09-10T05:59:01.825797+0000","last_clean":"2024-09-10T05:59:01.825797+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:59:01.825797+0000","last_undegraded":"2024-09-10T05:59:01.825797+0000","last_fullsized":"2024-09-10T05:59:01.825797+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:37.044312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814922+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:59:01.814922+0000","last_peered":"2024-09-10T05:59:01.814922+0000","last_clean":"2024-09-10T05:59:01.814922+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:59:01.814922+0000","last_undegraded":"2024-09-10T05:59:01.814922+0000","last_fullsized":"2024-09-10T05:59:01.814922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814332+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:59:01.814332+0000","last_peered":"2024-09-10T05:59:01.814332+0000","last_clean":"2024-09-10T05:59:01.814332+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:59:01.814332+0000","last_undegraded":"2024-09-10T05:59:01.814332+0000","last_fullsized":"2024-09-10T05:59:01.814332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813141+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:59:01.813141+0000","last_peered":"2024-09-10T05:59:01.813141+0000","last_clean":"2024-09-10T05:59:01.813141+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:59:01.813141+0000","last_undegraded":"2024-09-10T05:59:01.813141+0000","last_fullsized":"2024-09-10T05:59:01.813141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816148+0000","last_change":"2024-09-10T05:58:36.709426+0000","last_active":"2024-09-10T05:59:01.816148+0000","last_peered":"2024-09-10T05:59:01.816148+0000","last_clean":"2024-09-10T05:59:01.816148+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:59:01.816148+0000","last_undegraded":"2024-09-10T05:59:01.816148+0000","last_fullsized":"2024-09-10T05:59:01.816148+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:16.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970499+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:59:01.970499+0000","last_peered":"2024-09-10T05:59:01.970499+0000","last_clean":"2024-09-10T05:59:01.970499+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:59:01.970499+0000","last_undegraded":"2024-09-10T05:59:01.970499+0000","last_fullsized":"2024-09-10T05:59:01.970499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825597+0000","last_change":"2024-09-10T05:58:36.086954+0000","last_active":"2024-09-10T05:59:01.825597+0000","last_peered":"2024-09-10T05:59:01.825597+0000","last_clean":"2024-09-10T05:59:01.825597+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:59:01.825597+0000","last_undegraded":"2024-09-10T05:59:01.825597+0000","last_fullsized":"2024-09-10T05:59:01.825597+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:57.423283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817459+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:59:01.817459+0000","last_peered":"2024-09-10T05:59:01.817459+0000","last_clean":"2024-09-10T05:59:01.817459+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:59:01.817459+0000","last_undegraded":"2024-09-10T05:59:01.817459+0000","last_fullsized":"2024-09-10T05:59:01.817459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"131'135","reported_seq":388,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969726+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:59:01.969726+0000","last_peered":"2024-09-10T05:59:01.969726+0000","last_clean":"2024-09-10T05:59:01.969726+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:59:01.969726+0000","last_undegraded":"2024-09-10T05:59:01.969726+0000","last_fullsized":"2024-09-10T05:59:01.969726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812887+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:59:01.812887+0000","last_peered":"2024-09-10T05:59:01.812887+0000","last_clean":"2024-09-10T05:59:01.812887+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:59:01.812887+0000","last_undegraded":"2024-09-10T05:59:01.812887+0000","last_fullsized":"2024-09-10T05:59:01.812887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825894+0000","last_change":"2024-09-10T05:58:39.658860+0000","last_active":"2024-09-10T05:59:01.825894+0000","last_peered":"2024-09-10T05:59:01.825894+0000","last_clean":"2024-09-10T05:59:01.825894+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:59:01.825894+0000","last_undegraded":"2024-09-10T05:59:01.825894+0000","last_fullsized":"2024-09-10T05:59:01.825894+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:22.522890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'18","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980852+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:59:01.980852+0000","last_peered":"2024-09-10T05:59:01.980852+0000","last_clean":"2024-09-10T05:59:01.980852+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:59:01.980852+0000","last_undegraded":"2024-09-10T05:59:01.980852+0000","last_fullsized":"2024-09-10T05:59:01.980852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975529+0000","last_change":"2024-09-10T05:58:36.076514+0000","last_active":"2024-09-10T05:59:01.975529+0000","last_peered":"2024-09-10T05:59:01.975529+0000","last_clean":"2024-09-10T05:59:01.975529+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:59:01.975529+0000","last_undegraded":"2024-09-10T05:59:01.975529+0000","last_fullsized":"2024-09-10T05:59:01.975529+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:58.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"111'23","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970669+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:59:01.970669+0000","last_peered":"2024-09-10T05:59:01.970669+0000","last_clean":"2024-09-10T05:59:01.970669+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:59:01.970669+0000","last_undegraded":"2024-09-10T05:59:01.970669+0000","last_fullsized":"2024-09-10T05:59:01.970669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"131'142","reported_seq":348,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825244+0000","last_change":"2024-09-10T05:58:42.104842+0000","last_active":"2024-09-10T05:59:01.825244+0000","last_peered":"2024-09-10T05:59:01.825244+0000","last_clean":"2024-09-10T05:59:01.825244+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:59:01.825244+0000","last_undegraded":"2024-09-10T05:59:01.825244+0000","last_fullsized":"2024-09-10T05:59:01.825244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:06.712578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980182+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:59:01.980182+0000","last_peered":"2024-09-10T05:59:01.980182+0000","last_clean":"2024-09-10T05:59:01.980182+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:59:01.980182+0000","last_undegraded":"2024-09-10T05:59:01.980182+0000","last_fullsized":"2024-09-10T05:59:01.980182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973225+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:59:01.973225+0000","last_peered":"2024-09-10T05:59:01.973225+0000","last_clean":"2024-09-10T05:59:01.973225+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:59:01.973225+0000","last_undegraded":"2024-09-10T05:59:01.973225+0000","last_fullsized":"2024-09-10T05:59:01.973225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969010+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:59:01.969010+0000","last_peered":"2024-09-10T05:59:01.969010+0000","last_clean":"2024-09-10T05:59:01.969010+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:59:01.969010+0000","last_undegraded":"2024-09-10T05:59:01.969010+0000","last_fullsized":"2024-09-10T05:59:01.969010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"111'35","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973945+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:59:01.973945+0000","last_peered":"2024-09-10T05:59:01.973945+0000","last_clean":"2024-09-10T05:59:01.973945+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:59:01.973945+0000","last_undegraded":"2024-09-10T05:59:01.973945+0000","last_fullsized":"2024-09-10T05:59:01.973945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969386+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:59:01.969386+0000","last_peered":"2024-09-10T05:59:01.969386+0000","last_clean":"2024-09-10T05:59:01.969386+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:59:01.969386+0000","last_undegraded":"2024-09-10T05:59:01.969386+0000","last_fullsized":"2024-09-10T05:59:01.969386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975163+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:59:01.975163+0000","last_peered":"2024-09-10T05:59:01.975163+0000","last_clean":"2024-09-10T05:59:01.975163+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:59:01.975163+0000","last_undegraded":"2024-09-10T05:59:01.975163+0000","last_fullsized":"2024-09-10T05:59:01.975163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812553+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:59:01.812553+0000","last_peered":"2024-09-10T05:59:01.812553+0000","last_clean":"2024-09-10T05:59:01.812553+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:59:01.812553+0000","last_undegraded":"2024-09-10T05:59:01.812553+0000","last_fullsized":"2024-09-10T05:59:01.812553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'21","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972822+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:59:01.972822+0000","last_peered":"2024-09-10T05:59:01.972822+0000","last_clean":"2024-09-10T05:59:01.972822+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:59:01.972822+0000","last_undegraded":"2024-09-10T05:59:01.972822+0000","last_fullsized":"2024-09-10T05:59:01.972822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816319+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:59:01.816319+0000","last_peered":"2024-09-10T05:59:01.816319+0000","last_clean":"2024-09-10T05:59:01.816319+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:59:01.816319+0000","last_undegraded":"2024-09-10T05:59:01.816319+0000","last_fullsized":"2024-09-10T05:59:01.816319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"111'23","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824547+0000","last_change":"2024-09-10T05:58:41.124218+0000","last_active":"2024-09-10T05:59:01.824547+0000","last_peered":"2024-09-10T05:59:01.824547+0000","last_clean":"2024-09-10T05:59:01.824547+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:59:01.824547+0000","last_undegraded":"2024-09-10T05:59:01.824547+0000","last_fullsized":"2024-09-10T05:59:01.824547+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:13.232943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823296+0000","last_change":"2024-09-10T05:58:36.068634+0000","last_active":"2024-09-10T05:59:01.823296+0000","last_peered":"2024-09-10T05:59:01.823296+0000","last_clean":"2024-09-10T05:59:01.823296+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:59:01.823296+0000","last_undegraded":"2024-09-10T05:59:01.823296+0000","last_fullsized":"2024-09-10T05:59:01.823296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:54.848895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977060+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:59:01.977060+0000","last_peered":"2024-09-10T05:59:01.977060+0000","last_clean":"2024-09-10T05:59:01.977060+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:59:01.977060+0000","last_undegraded":"2024-09-10T05:59:01.977060+0000","last_fullsized":"2024-09-10T05:59:01.977060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974434+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:59:01.974434+0000","last_peered":"2024-09-10T05:59:01.974434+0000","last_clean":"2024-09-10T05:59:01.974434+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:59:01.974434+0000","last_undegraded":"2024-09-10T05:59:01.974434+0000","last_fullsized":"2024-09-10T05:59:01.974434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'23","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971267+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:59:01.971267+0000","last_peered":"2024-09-10T05:59:01.971267+0000","last_clean":"2024-09-10T05:59:01.971267+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:59:01.971267+0000","last_undegraded":"2024-09-10T05:59:01.971267+0000","last_fullsized":"2024-09-10T05:59:01.971267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818189+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:59:01.818189+0000","last_peered":"2024-09-10T05:59:01.818189+0000","last_clean":"2024-09-10T05:59:01.818189+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:59:01.818189+0000","last_undegraded":"2024-09-10T05:59:01.818189+0000","last_fullsized":"2024-09-10T05:59:01.818189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"111'35","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969535+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:59:01.969535+0000","last_peered":"2024-09-10T05:59:01.969535+0000","last_clean":"2024-09-10T05:59:01.969535+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:59:01.969535+0000","last_undegraded":"2024-09-10T05:59:01.969535+0000","last_fullsized":"2024-09-10T05:59:01.969535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"131'135","reported_seq":465,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812578+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:59:01.812578+0000","last_peered":"2024-09-10T05:59:01.812578+0000","last_clean":"2024-09-10T05:59:01.812578+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:59:01.812578+0000","last_undegraded":"2024-09-10T05:59:01.812578+0000","last_fullsized":"2024-09-10T05:59:01.812578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815295+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:59:01.815295+0000","last_peered":"2024-09-10T05:59:01.815295+0000","last_clean":"2024-09-10T05:59:01.815295+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:59:01.815295+0000","last_undegraded":"2024-09-10T05:59:01.815295+0000","last_fullsized":"2024-09-10T05:59:01.815295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814879+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:59:01.814879+0000","last_peered":"2024-09-10T05:59:01.814879+0000","last_clean":"2024-09-10T05:59:01.814879+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:59:01.814879+0000","last_undegraded":"2024-09-10T05:59:01.814879+0000","last_fullsized":"2024-09-10T05:59:01.814879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'12","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816872+0000","last_change":"2024-09-10T05:58:38.085546+0000","last_active":"2024-09-10T05:59:01.816872+0000","last_peered":"2024-09-10T05:59:01.816872+0000","last_clean":"2024-09-10T05:59:01.816872+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:59:01.816872+0000","last_undegraded":"2024-09-10T05:59:01.816872+0000","last_fullsized":"2024-09-10T05:59:01.816872+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:10.893758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817040+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:59:01.817040+0000","last_peered":"2024-09-10T05:59:01.817040+0000","last_clean":"2024-09-10T05:59:01.817040+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:59:01.817040+0000","last_undegraded":"2024-09-10T05:59:01.817040+0000","last_fullsized":"2024-09-10T05:59:01.817040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'40","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813070+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:59:01.813070+0000","last_peered":"2024-09-10T05:59:01.813070+0000","last_clean":"2024-09-10T05:59:01.813070+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:59:01.813070+0000","last_undegraded":"2024-09-10T05:59:01.813070+0000","last_fullsized":"2024-09-10T05:59:01.813070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816028+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:59:01.816028+0000","last_peered":"2024-09-10T05:59:01.816028+0000","last_clean":"2024-09-10T05:59:01.816028+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:59:01.816028+0000","last_undegraded":"2024-09-10T05:59:01.816028+0000","last_fullsized":"2024-09-10T05:59:01.816028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970802+0000","last_change":"2024-09-10T05:58:39.385287+0000","last_active":"2024-09-10T05:59:01.970802+0000","last_peered":"2024-09-10T05:59:01.970802+0000","last_clean":"2024-09-10T05:59:01.970802+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:59:01.970802+0000","last_undegraded":"2024-09-10T05:59:01.970802+0000","last_fullsized":"2024-09-10T05:59:01.970802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:27.225607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814320+0000","last_change":"2024-09-10T05:58:40.751831+0000","last_active":"2024-09-10T05:59:01.814320+0000","last_peered":"2024-09-10T05:59:01.814320+0000","last_clean":"2024-09-10T05:59:01.814320+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:59:01.814320+0000","last_undegraded":"2024-09-10T05:59:01.814320+0000","last_fullsized":"2024-09-10T05:59:01.814320+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:32.405571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'27","reported_seq":100,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826184+0000","last_change":"2024-09-10T05:58:38.720733+0000","last_active":"2024-09-10T05:59:01.826184+0000","last_peered":"2024-09-10T05:59:01.826184+0000","last_clean":"2024-09-10T05:59:01.826184+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:59:01.826184+0000","last_undegraded":"2024-09-10T05:59:01.826184+0000","last_fullsized":"2024-09-10T05:59:01.826184+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:07.402320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817160+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:59:01.817160+0000","last_peered":"2024-09-10T05:59:01.817160+0000","last_clean":"2024-09-10T05:59:01.817160+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:59:01.817160+0000","last_undegraded":"2024-09-10T05:59:01.817160+0000","last_fullsized":"2024-09-10T05:59:01.817160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"111'28","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814499+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:59:01.814499+0000","last_peered":"2024-09-10T05:59:01.814499+0000","last_clean":"2024-09-10T05:59:01.814499+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:59:01.814499+0000","last_undegraded":"2024-09-10T05:59:01.814499+0000","last_fullsized":"2024-09-10T05:59:01.814499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":23,"num_write":20,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815733+0000","last_change":"2024-09-10T05:58:36.081028+0000","last_active":"2024-09-10T05:59:01.815733+0000","last_peered":"2024-09-10T05:59:01.815733+0000","last_clean":"2024-09-10T05:59:01.815733+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:59:01.815733+0000","last_undegraded":"2024-09-10T05:59:01.815733+0000","last_fullsized":"2024-09-10T05:59:01.815733+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:17.752342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822644+0000","last_change":"2024-09-10T05:58:42.021549+0000","last_active":"2024-09-10T05:59:01.822644+0000","last_peered":"2024-09-10T05:59:01.822644+0000","last_clean":"2024-09-10T05:59:01.822644+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:59:01.822644+0000","last_undegraded":"2024-09-10T05:59:01.822644+0000","last_fullsized":"2024-09-10T05:59:01.822644+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:23.621053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814696+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:59:01.814696+0000","last_peered":"2024-09-10T05:59:01.814696+0000","last_clean":"2024-09-10T05:59:01.814696+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:59:01.814696+0000","last_undegraded":"2024-09-10T05:59:01.814696+0000","last_fullsized":"2024-09-10T05:59:01.814696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974982+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:59:01.974982+0000","last_peered":"2024-09-10T05:59:01.974982+0000","last_clean":"2024-09-10T05:59:01.974982+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:59:01.974982+0000","last_undegraded":"2024-09-10T05:59:01.974982+0000","last_fullsized":"2024-09-10T05:59:01.974982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969798+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:59:01.969798+0000","last_peered":"2024-09-10T05:59:01.969798+0000","last_clean":"2024-09-10T05:59:01.969798+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:59:01.969798+0000","last_undegraded":"2024-09-10T05:59:01.969798+0000","last_fullsized":"2024-09-10T05:59:01.969798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"111'23","reported_seq":336,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817802+0000","last_change":"2024-09-10T05:58:40.714764+0000","last_active":"2024-09-10T05:59:01.817802+0000","last_peered":"2024-09-10T05:59:01.817802+0000","last_clean":"2024-09-10T05:59:01.817802+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:59:01.817802+0000","last_undegraded":"2024-09-10T05:59:01.817802+0000","last_fullsized":"2024-09-10T05:59:01.817802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:27.289268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"131'135","reported_seq":402,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817330+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:59:01.817330+0000","last_peered":"2024-09-10T05:59:01.817330+0000","last_clean":"2024-09-10T05:59:01.817330+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:59:01.817330+0000","last_undegraded":"2024-09-10T05:59:01.817330+0000","last_fullsized":"2024-09-10T05:59:01.817330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969247+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:59:01.969247+0000","last_peered":"2024-09-10T05:59:01.969247+0000","last_clean":"2024-09-10T05:59:01.969247+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:59:01.969247+0000","last_undegraded":"2024-09-10T05:59:01.969247+0000","last_fullsized":"2024-09-10T05:59:01.969247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815015+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:59:01.815015+0000","last_peered":"2024-09-10T05:59:01.815015+0000","last_clean":"2024-09-10T05:59:01.815015+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:59:01.815015+0000","last_undegraded":"2024-09-10T05:59:01.815015+0000","last_fullsized":"2024-09-10T05:59:01.815015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813269+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:59:01.813269+0000","last_peered":"2024-09-10T05:59:01.813269+0000","last_clean":"2024-09-10T05:59:01.813269+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:59:01.813269+0000","last_undegraded":"2024-09-10T05:59:01.813269+0000","last_fullsized":"2024-09-10T05:59:01.813269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":398,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976555+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:59:01.976555+0000","last_peered":"2024-09-10T05:59:01.976555+0000","last_clean":"2024-09-10T05:59:01.976555+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:59:01.976555+0000","last_undegraded":"2024-09-10T05:59:01.976555+0000","last_fullsized":"2024-09-10T05:59:01.976555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824969+0000","last_change":"2024-09-10T05:58:37.286390+0000","last_active":"2024-09-10T05:59:01.824969+0000","last_peered":"2024-09-10T05:59:01.824969+0000","last_clean":"2024-09-10T05:59:01.824969+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:59:01.824969+0000","last_undegraded":"2024-09-10T05:59:01.824969+0000","last_fullsized":"2024-09-10T05:59:01.824969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:08.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"131'135","reported_seq":434,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977577+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:59:01.977577+0000","last_peered":"2024-09-10T05:59:01.977577+0000","last_clean":"2024-09-10T05:59:01.977577+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:59:01.977577+0000","last_undegraded":"2024-09-10T05:59:01.977577+0000","last_fullsized":"2024-09-10T05:59:01.977577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812864+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:59:01.812864+0000","last_peered":"2024-09-10T05:59:01.812864+0000","last_clean":"2024-09-10T05:59:01.812864+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:59:01.812864+0000","last_undegraded":"2024-09-10T05:59:01.812864+0000","last_fullsized":"2024-09-10T05:59:01.812864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976229+0000","last_change":"2024-09-10T05:58:40.805304+0000","last_active":"2024-09-10T05:59:01.976229+0000","last_peered":"2024-09-10T05:59:01.976229+0000","last_clean":"2024-09-10T05:59:01.976229+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:59:01.976229+0000","last_undegraded":"2024-09-10T05:59:01.976229+0000","last_fullsized":"2024-09-10T05:59:01.976229+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:26.888956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823741+0000","last_change":"2024-09-10T05:58:41.608913+0000","last_active":"2024-09-10T05:59:01.823741+0000","last_peered":"2024-09-10T05:59:01.823741+0000","last_clean":"2024-09-10T05:59:01.823741+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:59:01.823741+0000","last_undegraded":"2024-09-10T05:59:01.823741+0000","last_fullsized":"2024-09-10T05:59:01.823741+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:15.544218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814783+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:59:01.814783+0000","last_peered":"2024-09-10T05:59:01.814783+0000","last_clean":"2024-09-10T05:59:01.814783+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:59:01.814783+0000","last_undegraded":"2024-09-10T05:59:01.814783+0000","last_fullsized":"2024-09-10T05:59:01.814783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"111'25","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975641+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:59:01.975641+0000","last_peered":"2024-09-10T05:59:01.975641+0000","last_clean":"2024-09-10T05:59:01.975641+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:59:01.975641+0000","last_undegraded":"2024-09-10T05:59:01.975641+0000","last_fullsized":"2024-09-10T05:59:01.975641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975062+0000","last_change":"2024-09-10T05:58:36.080814+0000","last_active":"2024-09-10T05:59:01.975062+0000","last_peered":"2024-09-10T05:59:01.975062+0000","last_clean":"2024-09-10T05:59:01.975062+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:59:01.975062+0000","last_undegraded":"2024-09-10T05:59:01.975062+0000","last_fullsized":"2024-09-10T05:59:01.975062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:12.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969254+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:59:01.969254+0000","last_peered":"2024-09-10T05:59:01.969254+0000","last_clean":"2024-09-10T05:59:01.969254+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:59:01.969254+0000","last_undegraded":"2024-09-10T05:59:01.969254+0000","last_fullsized":"2024-09-10T05:59:01.969254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978032+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:59:01.978032+0000","last_peered":"2024-09-10T05:59:01.978032+0000","last_clean":"2024-09-10T05:59:01.978032+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:59:01.978032+0000","last_undegraded":"2024-09-10T05:59:01.978032+0000","last_fullsized":"2024-09-10T05:59:01.978032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969848+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:59:01.969848+0000","last_peered":"2024-09-10T05:59:01.969848+0000","last_clean":"2024-09-10T05:59:01.969848+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:59:01.969848+0000","last_undegraded":"2024-09-10T05:59:01.969848+0000","last_fullsized":"2024-09-10T05:59:01.969848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973650+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:59:01.973650+0000","last_peered":"2024-09-10T05:59:01.973650+0000","last_clean":"2024-09-10T05:59:01.973650+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:59:01.973650+0000","last_undegraded":"2024-09-10T05:59:01.973650+0000","last_fullsized":"2024-09-10T05:59:01.973650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"111'28","reported_seq":102,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822940+0000","last_change":"2024-09-10T05:58:38.110183+0000","last_active":"2024-09-10T05:59:01.822940+0000","last_peered":"2024-09-10T05:59:01.822940+0000","last_clean":"2024-09-10T05:59:01.822940+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:59:01.822940+0000","last_undegraded":"2024-09-10T05:59:01.822940+0000","last_fullsized":"2024-09-10T05:59:01.822940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.156258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970305+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:59:01.970305+0000","last_peered":"2024-09-10T05:59:01.970305+0000","last_clean":"2024-09-10T05:59:01.970305+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:59:01.970305+0000","last_undegraded":"2024-09-10T05:59:01.970305+0000","last_fullsized":"2024-09-10T05:59:01.970305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"111'43","reported_seq":357,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976753+0000","last_change":"2024-09-10T05:58:40.775802+0000","last_active":"2024-09-10T05:59:01.976753+0000","last_peered":"2024-09-10T05:59:01.976753+0000","last_clean":"2024-09-10T05:59:01.976753+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:59:01.976753+0000","last_undegraded":"2024-09-10T05:59:01.976753+0000","last_fullsized":"2024-09-10T05:59:01.976753+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.223922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815484+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:59:01.815484+0000","last_peered":"2024-09-10T05:59:01.815484+0000","last_clean":"2024-09-10T05:59:01.815484+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:59:01.815484+0000","last_undegraded":"2024-09-10T05:59:01.815484+0000","last_fullsized":"2024-09-10T05:59:01.815484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973038+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:59:01.973038+0000","last_peered":"2024-09-10T05:59:01.973038+0000","last_clean":"2024-09-10T05:59:01.973038+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:59:01.973038+0000","last_undegraded":"2024-09-10T05:59:01.973038+0000","last_fullsized":"2024-09-10T05:59:01.973038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815904+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:59:01.815904+0000","last_peered":"2024-09-10T05:59:01.815904+0000","last_clean":"2024-09-10T05:59:01.815904+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:59:01.815904+0000","last_undegraded":"2024-09-10T05:59:01.815904+0000","last_fullsized":"2024-09-10T05:59:01.815904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969288+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:59:01.969288+0000","last_peered":"2024-09-10T05:59:01.969288+0000","last_clean":"2024-09-10T05:59:01.969288+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:59:01.969288+0000","last_undegraded":"2024-09-10T05:59:01.969288+0000","last_fullsized":"2024-09-10T05:59:01.969288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'19","reported_seq":246,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813209+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:59:01.813209+0000","last_peered":"2024-09-10T05:59:01.813209+0000","last_clean":"2024-09-10T05:59:01.813209+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:59:01.813209+0000","last_undegraded":"2024-09-10T05:59:01.813209+0000","last_fullsized":"2024-09-10T05:59:01.813209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979956+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:59:01.979956+0000","last_peered":"2024-09-10T05:59:01.979956+0000","last_clean":"2024-09-10T05:59:01.979956+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:59:01.979956+0000","last_undegraded":"2024-09-10T05:59:01.979956+0000","last_fullsized":"2024-09-10T05:59:01.979956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"131'143","reported_seq":466,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969792+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:59:01.969792+0000","last_peered":"2024-09-10T05:59:01.969792+0000","last_clean":"2024-09-10T05:59:01.969792+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:59:01.969792+0000","last_undegraded":"2024-09-10T05:59:01.969792+0000","last_fullsized":"2024-09-10T05:59:01.969792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":185,"num_read_kb":169,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970038+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:59:01.970038+0000","last_peered":"2024-09-10T05:59:01.970038+0000","last_clean":"2024-09-10T05:59:01.970038+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:59:01.970038+0000","last_undegraded":"2024-09-10T05:59:01.970038+0000","last_fullsized":"2024-09-10T05:59:01.970038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969029+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:59:01.969029+0000","last_peered":"2024-09-10T05:59:01.969029+0000","last_clean":"2024-09-10T05:59:01.969029+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:59:01.969029+0000","last_undegraded":"2024-09-10T05:59:01.969029+0000","last_fullsized":"2024-09-10T05:59:01.969029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971269+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:59:01.971269+0000","last_peered":"2024-09-10T05:59:01.971269+0000","last_clean":"2024-09-10T05:59:01.971269+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:59:01.971269+0000","last_undegraded":"2024-09-10T05:59:01.971269+0000","last_fullsized":"2024-09-10T05:59:01.971269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816763+0000","last_change":"2024-09-10T05:58:36.063964+0000","last_active":"2024-09-10T05:59:01.816763+0000","last_peered":"2024-09-10T05:59:01.816763+0000","last_clean":"2024-09-10T05:59:01.816763+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:59:01.816763+0000","last_undegraded":"2024-09-10T05:59:01.816763+0000","last_fullsized":"2024-09-10T05:59:01.816763+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:53.613158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969020+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:59:01.969020+0000","last_peered":"2024-09-10T05:59:01.969020+0000","last_clean":"2024-09-10T05:59:01.969020+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:59:01.969020+0000","last_undegraded":"2024-09-10T05:59:01.969020+0000","last_fullsized":"2024-09-10T05:59:01.969020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817645+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:59:01.817645+0000","last_peered":"2024-09-10T05:59:01.817645+0000","last_clean":"2024-09-10T05:59:01.817645+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:59:01.817645+0000","last_undegraded":"2024-09-10T05:59:01.817645+0000","last_fullsized":"2024-09-10T05:59:01.817645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"131'16","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970890+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:59:01.970890+0000","last_peered":"2024-09-10T05:59:01.970890+0000","last_clean":"2024-09-10T05:59:01.970890+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:59:01.970890+0000","last_undegraded":"2024-09-10T05:59:01.970890+0000","last_fullsized":"2024-09-10T05:59:01.970890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814189+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:59:01.814189+0000","last_peered":"2024-09-10T05:59:01.814189+0000","last_clean":"2024-09-10T05:59:01.814189+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:59:01.814189+0000","last_undegraded":"2024-09-10T05:59:01.814189+0000","last_fullsized":"2024-09-10T05:59:01.814189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825738+0000","last_change":"2024-09-10T05:58:36.090394+0000","last_active":"2024-09-10T05:59:01.825738+0000","last_peered":"2024-09-10T05:59:01.825738+0000","last_clean":"2024-09-10T05:59:01.825738+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:59:01.825738+0000","last_undegraded":"2024-09-10T05:59:01.825738+0000","last_fullsized":"2024-09-10T05:59:01.825738+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:49.622437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970102+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:59:01.970102+0000","last_peered":"2024-09-10T05:59:01.970102+0000","last_clean":"2024-09-10T05:59:01.970102+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:59:01.970102+0000","last_undegraded":"2024-09-10T05:59:01.970102+0000","last_fullsized":"2024-09-10T05:59:01.970102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975334+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:59:01.975334+0000","last_peered":"2024-09-10T05:59:01.975334+0000","last_clean":"2024-09-10T05:59:01.975334+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:59:01.975334+0000","last_undegraded":"2024-09-10T05:59:01.975334+0000","last_fullsized":"2024-09-10T05:59:01.975334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'35","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814126+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:59:01.814126+0000","last_peered":"2024-09-10T05:59:01.814126+0000","last_clean":"2024-09-10T05:59:01.814126+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:59:01.814126+0000","last_undegraded":"2024-09-10T05:59:01.814126+0000","last_fullsized":"2024-09-10T05:59:01.814126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814731+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:59:01.814731+0000","last_peered":"2024-09-10T05:59:01.814731+0000","last_clean":"2024-09-10T05:59:01.814731+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:59:01.814731+0000","last_undegraded":"2024-09-10T05:59:01.814731+0000","last_fullsized":"2024-09-10T05:59:01.814731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825316+0000","last_change":"2024-09-10T05:58:37.301597+0000","last_active":"2024-09-10T05:59:01.825316+0000","last_peered":"2024-09-10T05:59:01.825316+0000","last_clean":"2024-09-10T05:59:01.825316+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:59:01.825316+0000","last_undegraded":"2024-09-10T05:59:01.825316+0000","last_fullsized":"2024-09-10T05:59:01.825316+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:30.282821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978658+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:59:01.978658+0000","last_peered":"2024-09-10T05:59:01.978658+0000","last_clean":"2024-09-10T05:59:01.978658+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:59:01.978658+0000","last_undegraded":"2024-09-10T05:59:01.978658+0000","last_fullsized":"2024-09-10T05:59:01.978658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971389+0000","last_change":"2024-09-10T05:58:40.735106+0000","last_active":"2024-09-10T05:59:01.971389+0000","last_peered":"2024-09-10T05:59:01.971389+0000","last_clean":"2024-09-10T05:59:01.971389+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:59:01.971389+0000","last_undegraded":"2024-09-10T05:59:01.971389+0000","last_fullsized":"2024-09-10T05:59:01.971389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:08.686783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":197,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816305+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:59:01.816305+0000","last_peered":"2024-09-10T05:59:01.816305+0000","last_clean":"2024-09-10T05:59:01.816305+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:59:01.816305+0000","last_undegraded":"2024-09-10T05:59:01.816305+0000","last_fullsized":"2024-09-10T05:59:01.816305+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"111'25","reported_seq":331,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980506+0000","last_change":"2024-09-10T05:58:39.363982+0000","last_active":"2024-09-10T05:59:01.980506+0000","last_peered":"2024-09-10T05:59:01.980506+0000","last_clean":"2024-09-10T05:59:01.980506+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:59:01.980506+0000","last_undegraded":"2024-09-10T05:59:01.980506+0000","last_fullsized":"2024-09-10T05:59:01.980506+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:12.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970391+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:59:01.970391+0000","last_peered":"2024-09-10T05:59:01.970391+0000","last_clean":"2024-09-10T05:59:01.970391+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:59:01.970391+0000","last_undegraded":"2024-09-10T05:59:01.970391+0000","last_fullsized":"2024-09-10T05:59:01.970391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":309,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814142+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:59:01.814142+0000","last_peered":"2024-09-10T05:59:01.814142+0000","last_clean":"2024-09-10T05:59:01.814142+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:59:01.814142+0000","last_undegraded":"2024-09-10T05:59:01.814142+0000","last_fullsized":"2024-09-10T05:59:01.814142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"111'47","reported_seq":400,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812698+0000","last_change":"2024-09-10T05:58:39.382781+0000","last_active":"2024-09-10T05:59:01.812698+0000","last_peered":"2024-09-10T05:59:01.812698+0000","last_clean":"2024-09-10T05:59:01.812698+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:59:01.812698+0000","last_undegraded":"2024-09-10T05:59:01.812698+0000","last_fullsized":"2024-09-10T05:59:01.812698+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:54.079756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812156+0000","last_change":"2024-09-10T05:58:36.065033+0000","last_active":"2024-09-10T05:59:01.812156+0000","last_peered":"2024-09-10T05:59:01.812156+0000","last_clean":"2024-09-10T05:59:01.812156+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:59:01.812156+0000","last_undegraded":"2024-09-10T05:59:01.812156+0000","last_fullsized":"2024-09-10T05:59:01.812156+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.563276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814898+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:59:01.814898+0000","last_peered":"2024-09-10T05:59:01.814898+0000","last_clean":"2024-09-10T05:59:01.814898+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:59:01.814898+0000","last_undegraded":"2024-09-10T05:59:01.814898+0000","last_fullsized":"2024-09-10T05:59:01.814898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":232,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814807+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:59:01.814807+0000","last_peered":"2024-09-10T05:59:01.814807+0000","last_clean":"2024-09-10T05:59:01.814807+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:59:01.814807+0000","last_undegraded":"2024-09-10T05:59:01.814807+0000","last_fullsized":"2024-09-10T05:59:01.814807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'31","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970197+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:59:01.970197+0000","last_peered":"2024-09-10T05:59:01.970197+0000","last_clean":"2024-09-10T05:59:01.970197+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:59:01.970197+0000","last_undegraded":"2024-09-10T05:59:01.970197+0000","last_fullsized":"2024-09-10T05:59:01.970197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972249+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:59:01.972249+0000","last_peered":"2024-09-10T05:59:01.972249+0000","last_clean":"2024-09-10T05:59:01.972249+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:59:01.972249+0000","last_undegraded":"2024-09-10T05:59:01.972249+0000","last_fullsized":"2024-09-10T05:59:01.972249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973885+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:59:01.973885+0000","last_peered":"2024-09-10T05:59:01.973885+0000","last_clean":"2024-09-10T05:59:01.973885+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:59:01.973885+0000","last_undegraded":"2024-09-10T05:59:01.973885+0000","last_fullsized":"2024-09-10T05:59:01.973885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968759+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:59:01.968759+0000","last_peered":"2024-09-10T05:59:01.968759+0000","last_clean":"2024-09-10T05:59:01.968759+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:59:01.968759+0000","last_undegraded":"2024-09-10T05:59:01.968759+0000","last_fullsized":"2024-09-10T05:59:01.968759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"131'135","reported_seq":386,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972261+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:59:01.972261+0000","last_peered":"2024-09-10T05:59:01.972261+0000","last_clean":"2024-09-10T05:59:01.972261+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:59:01.972261+0000","last_undegraded":"2024-09-10T05:59:01.972261+0000","last_fullsized":"2024-09-10T05:59:01.972261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825935+0000","last_change":"2024-09-10T05:58:40.566181+0000","last_active":"2024-09-10T05:59:01.825935+0000","last_peered":"2024-09-10T05:59:01.825935+0000","last_clean":"2024-09-10T05:59:01.825935+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:59:01.825935+0000","last_undegraded":"2024-09-10T05:59:01.825935+0000","last_fullsized":"2024-09-10T05:59:01.825935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.161299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823699+0000","last_change":"2024-09-10T05:58:38.725304+0000","last_active":"2024-09-10T05:59:01.823699+0000","last_peered":"2024-09-10T05:59:01.823699+0000","last_clean":"2024-09-10T05:59:01.823699+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:59:01.823699+0000","last_undegraded":"2024-09-10T05:59:01.823699+0000","last_fullsized":"2024-09-10T05:59:01.823699+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:37.191390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826198+0000","last_change":"2024-09-10T05:58:41.098579+0000","last_active":"2024-09-10T05:59:01.826198+0000","last_peered":"2024-09-10T05:59:01.826198+0000","last_clean":"2024-09-10T05:59:01.826198+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:59:01.826198+0000","last_undegraded":"2024-09-10T05:59:01.826198+0000","last_fullsized":"2024-09-10T05:59:01.826198+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:26.154411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971162+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:59:01.971162+0000","last_peered":"2024-09-10T05:59:01.971162+0000","last_clean":"2024-09-10T05:59:01.971162+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:59:01.971162+0000","last_undegraded":"2024-09-10T05:59:01.971162+0000","last_fullsized":"2024-09-10T05:59:01.971162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812454+0000","last_change":"2024-09-10T05:58:36.065339+0000","last_active":"2024-09-10T05:59:01.812454+0000","last_peered":"2024-09-10T05:59:01.812454+0000","last_clean":"2024-09-10T05:59:01.812454+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:59:01.812454+0000","last_undegraded":"2024-09-10T05:59:01.812454+0000","last_fullsized":"2024-09-10T05:59:01.812454+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:58.311550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813201+0000","last_change":"2024-09-10T05:58:39.400842+0000","last_active":"2024-09-10T05:59:01.813201+0000","last_peered":"2024-09-10T05:59:01.813201+0000","last_clean":"2024-09-10T05:59:01.813201+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:59:01.813201+0000","last_undegraded":"2024-09-10T05:59:01.813201+0000","last_fullsized":"2024-09-10T05:59:01.813201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:57.886787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"131'142","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826043+0000","last_change":"2024-09-10T05:58:42.102476+0000","last_active":"2024-09-10T05:59:01.826043+0000","last_peered":"2024-09-10T05:59:01.826043+0000","last_clean":"2024-09-10T05:59:01.826043+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:59:01.826043+0000","last_undegraded":"2024-09-10T05:59:01.826043+0000","last_fullsized":"2024-09-10T05:59:01.826043+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:33.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814423+0000","last_change":"2024-09-10T05:58:36.071317+0000","last_active":"2024-09-10T05:59:01.814423+0000","last_peered":"2024-09-10T05:59:01.814423+0000","last_clean":"2024-09-10T05:59:01.814423+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:59:01.814423+0000","last_undegraded":"2024-09-10T05:59:01.814423+0000","last_fullsized":"2024-09-10T05:59:01.814423+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:36.078639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812728+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:59:01.812728+0000","last_peered":"2024-09-10T05:59:01.812728+0000","last_clean":"2024-09-10T05:59:01.812728+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:59:01.812728+0000","last_undegraded":"2024-09-10T05:59:01.812728+0000","last_fullsized":"2024-09-10T05:59:01.812728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'21","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816229+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:59:01.816229+0000","last_peered":"2024-09-10T05:59:01.816229+0000","last_clean":"2024-09-10T05:59:01.816229+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:59:01.816229+0000","last_undegraded":"2024-09-10T05:59:01.816229+0000","last_fullsized":"2024-09-10T05:59:01.816229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979439+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:59:01.979439+0000","last_peered":"2024-09-10T05:59:01.979439+0000","last_clean":"2024-09-10T05:59:01.979439+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:59:01.979439+0000","last_undegraded":"2024-09-10T05:59:01.979439+0000","last_fullsized":"2024-09-10T05:59:01.979439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824622+0000","last_change":"2024-09-10T05:58:36.083175+0000","last_active":"2024-09-10T05:59:01.824622+0000","last_peered":"2024-09-10T05:59:01.824622+0000","last_clean":"2024-09-10T05:59:01.824622+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:59:01.824622+0000","last_undegraded":"2024-09-10T05:59:01.824622+0000","last_fullsized":"2024-09-10T05:59:01.824622+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:50.357709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"111'50","reported_seq":289,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969479+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:59:01.969479+0000","last_peered":"2024-09-10T05:59:01.969479+0000","last_clean":"2024-09-10T05:59:01.969479+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:59:01.969479+0000","last_undegraded":"2024-09-10T05:59:01.969479+0000","last_fullsized":"2024-09-10T05:59:01.969479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823349+0000","last_change":"2024-09-10T05:58:36.068927+0000","last_active":"2024-09-10T05:59:01.823349+0000","last_peered":"2024-09-10T05:59:01.823349+0000","last_clean":"2024-09-10T05:59:01.823349+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:59:01.823349+0000","last_undegraded":"2024-09-10T05:59:01.823349+0000","last_fullsized":"2024-09-10T05:59:01.823349+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:34.118740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972639+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:59:01.972639+0000","last_peered":"2024-09-10T05:59:01.972639+0000","last_clean":"2024-09-10T05:59:01.972639+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:59:01.972639+0000","last_undegraded":"2024-09-10T05:59:01.972639+0000","last_fullsized":"2024-09-10T05:59:01.972639+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815536+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:59:01.815536+0000","last_peered":"2024-09-10T05:59:01.815536+0000","last_clean":"2024-09-10T05:59:01.815536+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:59:01.815536+0000","last_undegraded":"2024-09-10T05:59:01.815536+0000","last_fullsized":"2024-09-10T05:59:01.815536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813747+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:59:01.813747+0000","last_peered":"2024-09-10T05:59:01.813747+0000","last_clean":"2024-09-10T05:59:01.813747+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:59:01.813747+0000","last_undegraded":"2024-09-10T05:59:01.813747+0000","last_fullsized":"2024-09-10T05:59:01.813747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'26","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813964+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:59:01.813964+0000","last_peered":"2024-09-10T05:59:01.813964+0000","last_clean":"2024-09-10T05:59:01.813964+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:59:01.813964+0000","last_undegraded":"2024-09-10T05:59:01.813964+0000","last_fullsized":"2024-09-10T05:59:01.813964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969521+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:59:01.969521+0000","last_peered":"2024-09-10T05:59:01.969521+0000","last_clean":"2024-09-10T05:59:01.969521+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:59:01.969521+0000","last_undegraded":"2024-09-10T05:59:01.969521+0000","last_fullsized":"2024-09-10T05:59:01.969521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"111'26","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823152+0000","last_change":"2024-09-10T05:58:36.101085+0000","last_active":"2024-09-10T05:59:01.823152+0000","last_peered":"2024-09-10T05:59:01.823152+0000","last_clean":"2024-09-10T05:59:01.823152+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:59:01.823152+0000","last_undegraded":"2024-09-10T05:59:01.823152+0000","last_fullsized":"2024-09-10T05:59:01.823152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:36.463324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822640+0000","last_change":"2024-09-10T05:58:36.083554+0000","last_active":"2024-09-10T05:59:01.822640+0000","last_peered":"2024-09-10T05:59:01.822640+0000","last_clean":"2024-09-10T05:59:01.822640+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:59:01.822640+0000","last_undegraded":"2024-09-10T05:59:01.822640+0000","last_fullsized":"2024-09-10T05:59:01.822640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:47.211919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825582+0000","last_change":"2024-09-10T05:58:36.106761+0000","last_active":"2024-09-10T05:59:01.825582+0000","last_peered":"2024-09-10T05:59:01.825582+0000","last_clean":"2024-09-10T05:59:01.825582+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:59:01.825582+0000","last_undegraded":"2024-09-10T05:59:01.825582+0000","last_fullsized":"2024-09-10T05:59:01.825582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:44.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969400+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:59:01.969400+0000","last_peered":"2024-09-10T05:59:01.969400+0000","last_clean":"2024-09-10T05:59:01.969400+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:59:01.969400+0000","last_undegraded":"2024-09-10T05:59:01.969400+0000","last_fullsized":"2024-09-10T05:59:01.969400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'25","reported_seq":341,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971105+0000","last_change":"2024-09-10T05:58:36.704691+0000","last_active":"2024-09-10T05:59:01.971105+0000","last_peered":"2024-09-10T05:59:01.971105+0000","last_clean":"2024-09-10T05:59:01.971105+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:59:01.971105+0000","last_undegraded":"2024-09-10T05:59:01.971105+0000","last_fullsized":"2024-09-10T05:59:01.971105+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:15.480906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825072+0000","last_change":"2024-09-10T05:58:36.087688+0000","last_active":"2024-09-10T05:59:01.825072+0000","last_peered":"2024-09-10T05:59:01.825072+0000","last_clean":"2024-09-10T05:59:01.825072+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:59:01.825072+0000","last_undegraded":"2024-09-10T05:59:01.825072+0000","last_fullsized":"2024-09-10T05:59:01.825072+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:11.802961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'10","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812168+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:59:01.812168+0000","last_peered":"2024-09-10T05:59:01.812168+0000","last_clean":"2024-09-10T05:59:01.812168+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:59:01.812168+0000","last_undegraded":"2024-09-10T05:59:01.812168+0000","last_fullsized":"2024-09-10T05:59:01.812168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969302+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:59:01.969302+0000","last_peered":"2024-09-10T05:59:01.969302+0000","last_clean":"2024-09-10T05:59:01.969302+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:59:01.969302+0000","last_undegraded":"2024-09-10T05:59:01.969302+0000","last_fullsized":"2024-09-10T05:59:01.969302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814579+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:59:01.814579+0000","last_peered":"2024-09-10T05:59:01.814579+0000","last_clean":"2024-09-10T05:59:01.814579+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:59:01.814579+0000","last_undegraded":"2024-09-10T05:59:01.814579+0000","last_fullsized":"2024-09-10T05:59:01.814579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822857+0000","last_change":"2024-09-10T05:58:36.104832+0000","last_active":"2024-09-10T05:59:01.822857+0000","last_peered":"2024-09-10T05:59:01.822857+0000","last_clean":"2024-09-10T05:59:01.822857+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:59:01.822857+0000","last_undegraded":"2024-09-10T05:59:01.822857+0000","last_fullsized":"2024-09-10T05:59:01.822857+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:15.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976784+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:59:01.976784+0000","last_peered":"2024-09-10T05:59:01.976784+0000","last_clean":"2024-09-10T05:59:01.976784+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:59:01.976784+0000","last_undegraded":"2024-09-10T05:59:01.976784+0000","last_fullsized":"2024-09-10T05:59:01.976784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968619+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:59:01.968619+0000","last_peered":"2024-09-10T05:59:01.968619+0000","last_clean":"2024-09-10T05:59:01.968619+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:59:01.968619+0000","last_undegraded":"2024-09-10T05:59:01.968619+0000","last_fullsized":"2024-09-10T05:59:01.968619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"111'21","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825309+0000","last_change":"2024-09-10T05:58:41.135121+0000","last_active":"2024-09-10T05:59:01.825309+0000","last_peered":"2024-09-10T05:59:01.825309+0000","last_clean":"2024-09-10T05:59:01.825309+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:59:01.825309+0000","last_undegraded":"2024-09-10T05:59:01.825309+0000","last_fullsized":"2024-09-10T05:59:01.825309+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:59.259766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973584+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:59:01.973584+0000","last_peered":"2024-09-10T05:59:01.973584+0000","last_clean":"2024-09-10T05:59:01.973584+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:59:01.973584+0000","last_undegraded":"2024-09-10T05:59:01.973584+0000","last_fullsized":"2024-09-10T05:59:01.973584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974783+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:59:01.974783+0000","last_peered":"2024-09-10T05:59:01.974783+0000","last_clean":"2024-09-10T05:59:01.974783+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:59:01.974783+0000","last_undegraded":"2024-09-10T05:59:01.974783+0000","last_fullsized":"2024-09-10T05:59:01.974783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822940+0000","last_change":"2024-09-10T05:58:41.614433+0000","last_active":"2024-09-10T05:59:01.822940+0000","last_peered":"2024-09-10T05:59:01.822940+0000","last_clean":"2024-09-10T05:59:01.822940+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:59:01.822940+0000","last_undegraded":"2024-09-10T05:59:01.822940+0000","last_fullsized":"2024-09-10T05:59:01.822940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:59.859364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'30","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816052+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:59:01.816052+0000","last_peered":"2024-09-10T05:59:01.816052+0000","last_clean":"2024-09-10T05:59:01.816052+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:59:01.816052+0000","last_undegraded":"2024-09-10T05:59:01.816052+0000","last_fullsized":"2024-09-10T05:59:01.816052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978080+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:59:01.978080+0000","last_peered":"2024-09-10T05:59:01.978080+0000","last_clean":"2024-09-10T05:59:01.978080+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:59:01.978080+0000","last_undegraded":"2024-09-10T05:59:01.978080+0000","last_fullsized":"2024-09-10T05:59:01.978080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"111'17","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969261+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:59:01.969261+0000","last_peered":"2024-09-10T05:59:01.969261+0000","last_clean":"2024-09-10T05:59:01.969261+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:59:01.969261+0000","last_undegraded":"2024-09-10T05:59:01.969261+0000","last_fullsized":"2024-09-10T05:59:01.969261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813668+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:59:01.813668+0000","last_peered":"2024-09-10T05:59:01.813668+0000","last_clean":"2024-09-10T05:59:01.813668+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:59:01.813668+0000","last_undegraded":"2024-09-10T05:59:01.813668+0000","last_fullsized":"2024-09-10T05:59:01.813668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979090+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:59:01.979090+0000","last_peered":"2024-09-10T05:59:01.979090+0000","last_clean":"2024-09-10T05:59:01.979090+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:59:01.979090+0000","last_undegraded":"2024-09-10T05:59:01.979090+0000","last_fullsized":"2024-09-10T05:59:01.979090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":96,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823231+0000","last_change":"2024-09-10T05:58:39.178040+0000","last_active":"2024-09-10T05:59:01.823231+0000","last_peered":"2024-09-10T05:59:01.823231+0000","last_clean":"2024-09-10T05:59:01.823231+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:59:01.823231+0000","last_undegraded":"2024-09-10T05:59:01.823231+0000","last_fullsized":"2024-09-10T05:59:01.823231+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:03.677156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815572+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:59:01.815572+0000","last_peered":"2024-09-10T05:59:01.815572+0000","last_clean":"2024-09-10T05:59:01.815572+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:59:01.815572+0000","last_undegraded":"2024-09-10T05:59:01.815572+0000","last_fullsized":"2024-09-10T05:59:01.815572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"111'38","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970364+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:59:01.970364+0000","last_peered":"2024-09-10T05:59:01.970364+0000","last_clean":"2024-09-10T05:59:01.970364+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:59:01.970364+0000","last_undegraded":"2024-09-10T05:59:01.970364+0000","last_fullsized":"2024-09-10T05:59:01.970364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975447+0000","last_change":"2024-09-10T05:58:36.082148+0000","last_active":"2024-09-10T05:59:01.975447+0000","last_peered":"2024-09-10T05:59:01.975447+0000","last_clean":"2024-09-10T05:59:01.975447+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:59:01.975447+0000","last_undegraded":"2024-09-10T05:59:01.975447+0000","last_fullsized":"2024-09-10T05:59:01.975447+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:32.319630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824811+0000","last_change":"2024-09-10T05:58:36.090193+0000","last_active":"2024-09-10T05:59:01.824811+0000","last_peered":"2024-09-10T05:59:01.824811+0000","last_clean":"2024-09-10T05:59:01.824811+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:59:01.824811+0000","last_undegraded":"2024-09-10T05:59:01.824811+0000","last_fullsized":"2024-09-10T05:59:01.824811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:35.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815817+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:59:01.815817+0000","last_peered":"2024-09-10T05:59:01.815817+0000","last_clean":"2024-09-10T05:59:01.815817+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:59:01.815817+0000","last_undegraded":"2024-09-10T05:59:01.815817+0000","last_fullsized":"2024-09-10T05:59:01.815817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'25","reported_seq":345,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969953+0000","last_change":"2024-09-10T05:58:38.989267+0000","last_active":"2024-09-10T05:59:01.969953+0000","last_peered":"2024-09-10T05:59:01.969953+0000","last_clean":"2024-09-10T05:59:01.969953+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:59:01.969953+0000","last_undegraded":"2024-09-10T05:59:01.969953+0000","last_fullsized":"2024-09-10T05:59:01.969953+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:54.603097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978818+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:59:01.978818+0000","last_peered":"2024-09-10T05:59:01.978818+0000","last_clean":"2024-09-10T05:59:01.978818+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:59:01.978818+0000","last_undegraded":"2024-09-10T05:59:01.978818+0000","last_fullsized":"2024-09-10T05:59:01.978818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969860+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:59:01.969860+0000","last_peered":"2024-09-10T05:59:01.969860+0000","last_clean":"2024-09-10T05:59:01.969860+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:59:01.969860+0000","last_undegraded":"2024-09-10T05:59:01.969860+0000","last_fullsized":"2024-09-10T05:59:01.969860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970684+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:59:01.970684+0000","last_peered":"2024-09-10T05:59:01.970684+0000","last_clean":"2024-09-10T05:59:01.970684+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:59:01.970684+0000","last_undegraded":"2024-09-10T05:59:01.970684+0000","last_fullsized":"2024-09-10T05:59:01.970684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973068+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:59:01.973068+0000","last_peered":"2024-09-10T05:59:01.973068+0000","last_clean":"2024-09-10T05:59:01.973068+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:59:01.973068+0000","last_undegraded":"2024-09-10T05:59:01.973068+0000","last_fullsized":"2024-09-10T05:59:01.973068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824492+0000","last_change":"2024-09-10T05:58:36.755598+0000","last_active":"2024-09-10T05:59:01.824492+0000","last_peered":"2024-09-10T05:59:01.824492+0000","last_clean":"2024-09-10T05:59:01.824492+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:59:01.824492+0000","last_undegraded":"2024-09-10T05:59:01.824492+0000","last_fullsized":"2024-09-10T05:59:01.824492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:58.858812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'19","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813759+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:59:01.813759+0000","last_peered":"2024-09-10T05:59:01.813759+0000","last_clean":"2024-09-10T05:59:01.813759+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:59:01.813759+0000","last_undegraded":"2024-09-10T05:59:01.813759+0000","last_fullsized":"2024-09-10T05:59:01.813759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":348,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814989+0000","last_change":"2024-09-10T05:58:40.731017+0000","last_active":"2024-09-10T05:59:01.814989+0000","last_peered":"2024-09-10T05:59:01.814989+0000","last_clean":"2024-09-10T05:59:01.814989+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:59:01.814989+0000","last_undegraded":"2024-09-10T05:59:01.814989+0000","last_fullsized":"2024-09-10T05:59:01.814989+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:36.888425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"111'28","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825595+0000","last_change":"2024-09-10T05:58:41.114451+0000","last_active":"2024-09-10T05:59:01.825595+0000","last_peered":"2024-09-10T05:59:01.825595+0000","last_clean":"2024-09-10T05:59:01.825595+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:59:01.825595+0000","last_undegraded":"2024-09-10T05:59:01.825595+0000","last_fullsized":"2024-09-10T05:59:01.825595+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:53.586626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62802,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970582+0000","last_change":"2024-09-10T05:58:36.073669+0000","last_active":"2024-09-10T05:59:01.970582+0000","last_peered":"2024-09-10T05:59:01.970582+0000","last_clean":"2024-09-10T05:59:01.970582+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:59:01.970582+0000","last_undegraded":"2024-09-10T05:59:01.970582+0000","last_fullsized":"2024-09-10T05:59:01.970582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.770687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973043+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:59:01.973043+0000","last_peered":"2024-09-10T05:59:01.973043+0000","last_clean":"2024-09-10T05:59:01.973043+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:59:01.973043+0000","last_undegraded":"2024-09-10T05:59:01.973043+0000","last_fullsized":"2024-09-10T05:59:01.973043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818325+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:59:01.818325+0000","last_peered":"2024-09-10T05:59:01.818325+0000","last_clean":"2024-09-10T05:59:01.818325+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:59:01.818325+0000","last_undegraded":"2024-09-10T05:59:01.818325+0000","last_fullsized":"2024-09-10T05:59:01.818325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813863+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:59:01.813863+0000","last_peered":"2024-09-10T05:59:01.813863+0000","last_clean":"2024-09-10T05:59:01.813863+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:59:01.813863+0000","last_undegraded":"2024-09-10T05:59:01.813863+0000","last_fullsized":"2024-09-10T05:59:01.813863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970972+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:59:01.970972+0000","last_peered":"2024-09-10T05:59:01.970972+0000","last_clean":"2024-09-10T05:59:01.970972+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:59:01.970972+0000","last_undegraded":"2024-09-10T05:59:01.970972+0000","last_fullsized":"2024-09-10T05:59:01.970972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814598+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:59:01.814598+0000","last_peered":"2024-09-10T05:59:01.814598+0000","last_clean":"2024-09-10T05:59:01.814598+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:59:01.814598+0000","last_undegraded":"2024-09-10T05:59:01.814598+0000","last_fullsized":"2024-09-10T05:59:01.814598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"131'135","reported_seq":386,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978135+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:59:01.978135+0000","last_peered":"2024-09-10T05:59:01.978135+0000","last_clean":"2024-09-10T05:59:01.978135+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:59:01.978135+0000","last_undegraded":"2024-09-10T05:59:01.978135+0000","last_fullsized":"2024-09-10T05:59:01.978135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968551+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:59:01.968551+0000","last_peered":"2024-09-10T05:59:01.968551+0000","last_clean":"2024-09-10T05:59:01.968551+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:59:01.968551+0000","last_undegraded":"2024-09-10T05:59:01.968551+0000","last_fullsized":"2024-09-10T05:59:01.968551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813457+0000","last_change":"2024-09-10T05:58:40.129243+0000","last_active":"2024-09-10T05:59:01.813457+0000","last_peered":"2024-09-10T05:59:01.813457+0000","last_clean":"2024-09-10T05:59:01.813457+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:59:01.813457+0000","last_undegraded":"2024-09-10T05:59:01.813457+0000","last_fullsized":"2024-09-10T05:59:01.813457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:22.831721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'17","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975868+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:59:01.975868+0000","last_peered":"2024-09-10T05:59:01.975868+0000","last_clean":"2024-09-10T05:59:01.975868+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:59:01.975868+0000","last_undegraded":"2024-09-10T05:59:01.975868+0000","last_fullsized":"2024-09-10T05:59:01.975868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969585+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:59:01.969585+0000","last_peered":"2024-09-10T05:59:01.969585+0000","last_clean":"2024-09-10T05:59:01.969585+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:59:01.969585+0000","last_undegraded":"2024-09-10T05:59:01.969585+0000","last_fullsized":"2024-09-10T05:59:01.969585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"111'48","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973667+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:59:01.973667+0000","last_peered":"2024-09-10T05:59:01.973667+0000","last_clean":"2024-09-10T05:59:01.973667+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:59:01.973667+0000","last_undegraded":"2024-09-10T05:59:01.973667+0000","last_fullsized":"2024-09-10T05:59:01.973667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":64,"num_read_kb":51,"num_write":42,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811526+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:59:01.811526+0000","last_peered":"2024-09-10T05:59:01.811526+0000","last_clean":"2024-09-10T05:59:01.811526+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:59:01.811526+0000","last_undegraded":"2024-09-10T05:59:01.811526+0000","last_fullsized":"2024-09-10T05:59:01.811526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973463+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:59:01.973463+0000","last_peered":"2024-09-10T05:59:01.973463+0000","last_clean":"2024-09-10T05:59:01.973463+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:59:01.973463+0000","last_undegraded":"2024-09-10T05:59:01.973463+0000","last_fullsized":"2024-09-10T05:59:01.973463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":293,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813505+0000","last_change":"2024-09-10T05:58:37.200455+0000","last_active":"2024-09-10T05:59:01.813505+0000","last_peered":"2024-09-10T05:59:01.813505+0000","last_clean":"2024-09-10T05:59:01.813505+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:59:01.813505+0000","last_undegraded":"2024-09-10T05:59:01.813505+0000","last_fullsized":"2024-09-10T05:59:01.813505+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.815795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980118+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:59:01.980118+0000","last_peered":"2024-09-10T05:59:01.980118+0000","last_clean":"2024-09-10T05:59:01.980118+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:59:01.980118+0000","last_undegraded":"2024-09-10T05:59:01.980118+0000","last_fullsized":"2024-09-10T05:59:01.980118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973100+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:59:01.973100+0000","last_peered":"2024-09-10T05:59:01.973100+0000","last_clean":"2024-09-10T05:59:01.973100+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:59:01.973100+0000","last_undegraded":"2024-09-10T05:59:01.973100+0000","last_fullsized":"2024-09-10T05:59:01.973100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"111'23","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811678+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:59:01.811678+0000","last_peered":"2024-09-10T05:59:01.811678+0000","last_clean":"2024-09-10T05:59:01.811678+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:59:01.811678+0000","last_undegraded":"2024-09-10T05:59:01.811678+0000","last_fullsized":"2024-09-10T05:59:01.811678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978365+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:59:01.978365+0000","last_peered":"2024-09-10T05:59:01.978365+0000","last_clean":"2024-09-10T05:59:01.978365+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:59:01.978365+0000","last_undegraded":"2024-09-10T05:59:01.978365+0000","last_fullsized":"2024-09-10T05:59:01.978365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825337+0000","last_change":"2024-09-10T05:58:36.751943+0000","last_active":"2024-09-10T05:59:01.825337+0000","last_peered":"2024-09-10T05:59:01.825337+0000","last_clean":"2024-09-10T05:59:01.825337+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:59:01.825337+0000","last_undegraded":"2024-09-10T05:59:01.825337+0000","last_fullsized":"2024-09-10T05:59:01.825337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:52.279125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823701+0000","last_change":"2024-09-10T05:58:36.760284+0000","last_active":"2024-09-10T05:59:01.823701+0000","last_peered":"2024-09-10T05:59:01.823701+0000","last_clean":"2024-09-10T05:59:01.823701+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:59:01.823701+0000","last_undegraded":"2024-09-10T05:59:01.823701+0000","last_fullsized":"2024-09-10T05:59:01.823701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:27.695656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'30","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824955+0000","last_change":"2024-09-10T05:58:36.748201+0000","last_active":"2024-09-10T05:59:01.824955+0000","last_peered":"2024-09-10T05:59:01.824955+0000","last_clean":"2024-09-10T05:59:01.824955+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:59:01.824955+0000","last_undegraded":"2024-09-10T05:59:01.824955+0000","last_fullsized":"2024-09-10T05:59:01.824955+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.304252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811947+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:59:01.811947+0000","last_peered":"2024-09-10T05:59:01.811947+0000","last_clean":"2024-09-10T05:59:01.811947+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:59:01.811947+0000","last_undegraded":"2024-09-10T05:59:01.811947+0000","last_fullsized":"2024-09-10T05:59:01.811947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"111'19","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823948+0000","last_change":"2024-09-10T05:58:42.032681+0000","last_active":"2024-09-10T05:59:01.823948+0000","last_peered":"2024-09-10T05:59:01.823948+0000","last_clean":"2024-09-10T05:59:01.823948+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:59:01.823948+0000","last_undegraded":"2024-09-10T05:59:01.823948+0000","last_fullsized":"2024-09-10T05:59:01.823948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:11.388502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812414+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:59:01.812414+0000","last_peered":"2024-09-10T05:59:01.812414+0000","last_clean":"2024-09-10T05:59:01.812414+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:59:01.812414+0000","last_undegraded":"2024-09-10T05:59:01.812414+0000","last_fullsized":"2024-09-10T05:59:01.812414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970419+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:59:01.970419+0000","last_peered":"2024-09-10T05:59:01.970419+0000","last_clean":"2024-09-10T05:59:01.970419+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:59:01.970419+0000","last_undegraded":"2024-09-10T05:59:01.970419+0000","last_fullsized":"2024-09-10T05:59:01.970419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812442+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:59:01.812442+0000","last_peered":"2024-09-10T05:59:01.812442+0000","last_clean":"2024-09-10T05:59:01.812442+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:59:01.812442+0000","last_undegraded":"2024-09-10T05:59:01.812442+0000","last_fullsized":"2024-09-10T05:59:01.812442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'25","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817492+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:59:01.817492+0000","last_peered":"2024-09-10T05:59:01.817492+0000","last_clean":"2024-09-10T05:59:01.817492+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:59:01.817492+0000","last_undegraded":"2024-09-10T05:59:01.817492+0000","last_fullsized":"2024-09-10T05:59:01.817492+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968961+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:59:01.968961+0000","last_peered":"2024-09-10T05:59:01.968961+0000","last_clean":"2024-09-10T05:59:01.968961+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:59:01.968961+0000","last_undegraded":"2024-09-10T05:59:01.968961+0000","last_fullsized":"2024-09-10T05:59:01.968961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"111'30","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812862+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:59:01.812862+0000","last_peered":"2024-09-10T05:59:01.812862+0000","last_clean":"2024-09-10T05:59:01.812862+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:59:01.812862+0000","last_undegraded":"2024-09-10T05:59:01.812862+0000","last_fullsized":"2024-09-10T05:59:01.812862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813606+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:59:01.813606+0000","last_peered":"2024-09-10T05:59:01.813606+0000","last_clean":"2024-09-10T05:59:01.813606+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:59:01.813606+0000","last_undegraded":"2024-09-10T05:59:01.813606+0000","last_fullsized":"2024-09-10T05:59:01.813606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815081+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:59:01.815081+0000","last_peered":"2024-09-10T05:59:01.815081+0000","last_clean":"2024-09-10T05:59:01.815081+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:59:01.815081+0000","last_undegraded":"2024-09-10T05:59:01.815081+0000","last_fullsized":"2024-09-10T05:59:01.815081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971172+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:59:01.971172+0000","last_peered":"2024-09-10T05:59:01.971172+0000","last_clean":"2024-09-10T05:59:01.971172+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:59:01.971172+0000","last_undegraded":"2024-09-10T05:59:01.971172+0000","last_fullsized":"2024-09-10T05:59:01.971172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'30","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980571+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:59:01.980571+0000","last_peered":"2024-09-10T05:59:01.980571+0000","last_clean":"2024-09-10T05:59:01.980571+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:59:01.980571+0000","last_undegraded":"2024-09-10T05:59:01.980571+0000","last_fullsized":"2024-09-10T05:59:01.980571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970866+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:59:01.970866+0000","last_peered":"2024-09-10T05:59:01.970866+0000","last_clean":"2024-09-10T05:59:01.970866+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:59:01.970866+0000","last_undegraded":"2024-09-10T05:59:01.970866+0000","last_fullsized":"2024-09-10T05:59:01.970866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816382+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:59:01.816382+0000","last_peered":"2024-09-10T05:59:01.816382+0000","last_clean":"2024-09-10T05:59:01.816382+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:59:01.816382+0000","last_undegraded":"2024-09-10T05:59:01.816382+0000","last_fullsized":"2024-09-10T05:59:01.816382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976396+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:59:01.976396+0000","last_peered":"2024-09-10T05:59:01.976396+0000","last_clean":"2024-09-10T05:59:01.976396+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:59:01.976396+0000","last_undegraded":"2024-09-10T05:59:01.976396+0000","last_fullsized":"2024-09-10T05:59:01.976396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":320,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975064+0000","last_change":"2024-09-10T05:58:37.753575+0000","last_active":"2024-09-10T05:59:01.975064+0000","last_peered":"2024-09-10T05:59:01.975064+0000","last_clean":"2024-09-10T05:59:01.975064+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:59:01.975064+0000","last_undegraded":"2024-09-10T05:59:01.975064+0000","last_fullsized":"2024-09-10T05:59:01.975064+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:21.191915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970245+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:59:01.970245+0000","last_peered":"2024-09-10T05:59:01.970245+0000","last_clean":"2024-09-10T05:59:01.970245+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:59:01.970245+0000","last_undegraded":"2024-09-10T05:59:01.970245+0000","last_fullsized":"2024-09-10T05:59:01.970245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'22","reported_seq":329,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814122+0000","last_change":"2024-09-10T05:58:38.431996+0000","last_active":"2024-09-10T05:59:01.814122+0000","last_peered":"2024-09-10T05:59:01.814122+0000","last_clean":"2024-09-10T05:59:01.814122+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:59:01.814122+0000","last_undegraded":"2024-09-10T05:59:01.814122+0000","last_fullsized":"2024-09-10T05:59:01.814122+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.662612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813281+0000","last_change":"2024-09-10T05:58:40.123148+0000","last_active":"2024-09-10T05:59:01.813281+0000","last_peered":"2024-09-10T05:59:01.813281+0000","last_clean":"2024-09-10T05:59:01.813281+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:59:01.813281+0000","last_undegraded":"2024-09-10T05:59:01.813281+0000","last_fullsized":"2024-09-10T05:59:01.813281+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:28.445530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"111'30","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825927+0000","last_change":"2024-09-10T05:58:37.278065+0000","last_active":"2024-09-10T05:59:01.825927+0000","last_peered":"2024-09-10T05:59:01.825927+0000","last_clean":"2024-09-10T05:59:01.825927+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:59:01.825927+0000","last_undegraded":"2024-09-10T05:59:01.825927+0000","last_fullsized":"2024-09-10T05:59:01.825927+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:23.616575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813671+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:59:01.813671+0000","last_peered":"2024-09-10T05:59:01.813671+0000","last_clean":"2024-09-10T05:59:01.813671+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:59:01.813671+0000","last_undegraded":"2024-09-10T05:59:01.813671+0000","last_fullsized":"2024-09-10T05:59:01.813671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'28","reported_seq":352,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971390+0000","last_change":"2024-09-10T05:58:37.192873+0000","last_active":"2024-09-10T05:59:01.971390+0000","last_peered":"2024-09-10T05:59:01.971390+0000","last_clean":"2024-09-10T05:59:01.971390+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:59:01.971390+0000","last_undegraded":"2024-09-10T05:59:01.971390+0000","last_fullsized":"2024-09-10T05:59:01.971390+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.993383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823416+0000","last_change":"2024-09-10T05:58:36.076255+0000","last_active":"2024-09-10T05:59:01.823416+0000","last_peered":"2024-09-10T05:59:01.823416+0000","last_clean":"2024-09-10T05:59:01.823416+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:59:01.823416+0000","last_undegraded":"2024-09-10T05:59:01.823416+0000","last_fullsized":"2024-09-10T05:59:01.823416+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:20.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'19","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978448+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:59:01.978448+0000","last_peered":"2024-09-10T05:59:01.978448+0000","last_clean":"2024-09-10T05:59:01.978448+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:59:01.978448+0000","last_undegraded":"2024-09-10T05:59:01.978448+0000","last_fullsized":"2024-09-10T05:59:01.978448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980248+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:59:01.980248+0000","last_peered":"2024-09-10T05:59:01.980248+0000","last_clean":"2024-09-10T05:59:01.980248+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:59:01.980248+0000","last_undegraded":"2024-09-10T05:59:01.980248+0000","last_fullsized":"2024-09-10T05:59:01.980248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826148+0000","last_change":"2024-09-10T05:58:40.562955+0000","last_active":"2024-09-10T05:59:01.826148+0000","last_peered":"2024-09-10T05:59:01.826148+0000","last_clean":"2024-09-10T05:59:01.826148+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:59:01.826148+0000","last_undegraded":"2024-09-10T05:59:01.826148+0000","last_fullsized":"2024-09-10T05:59:01.826148+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:55.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815897+0000","last_change":"2024-09-10T05:58:40.787117+0000","last_active":"2024-09-10T05:59:01.815897+0000","last_peered":"2024-09-10T05:59:01.815897+0000","last_clean":"2024-09-10T05:59:01.815897+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:59:01.815897+0000","last_undegraded":"2024-09-10T05:59:01.815897+0000","last_fullsized":"2024-09-10T05:59:01.815897+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:06.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'28","reported_seq":343,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980220+0000","last_change":"2024-09-10T05:58:40.117727+0000","last_active":"2024-09-10T05:59:01.980220+0000","last_peered":"2024-09-10T05:59:01.980220+0000","last_clean":"2024-09-10T05:59:01.980220+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:59:01.980220+0000","last_undegraded":"2024-09-10T05:59:01.980220+0000","last_fullsized":"2024-09-10T05:59:01.980220+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:28.251854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814850+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:59:01.814850+0000","last_peered":"2024-09-10T05:59:01.814850+0000","last_clean":"2024-09-10T05:59:01.814850+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:59:01.814850+0000","last_undegraded":"2024-09-10T05:59:01.814850+0000","last_fullsized":"2024-09-10T05:59:01.814850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'21","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823684+0000","last_change":"2024-09-10T05:58:40.171208+0000","last_active":"2024-09-10T05:59:01.823684+0000","last_peered":"2024-09-10T05:59:01.823684+0000","last_clean":"2024-09-10T05:59:01.823684+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:59:01.823684+0000","last_undegraded":"2024-09-10T05:59:01.823684+0000","last_fullsized":"2024-09-10T05:59:01.823684+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:43.370109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":223,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817504+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:59:01.817504+0000","last_peered":"2024-09-10T05:59:01.817504+0000","last_clean":"2024-09-10T05:59:01.817504+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:59:01.817504+0000","last_undegraded":"2024-09-10T05:59:01.817504+0000","last_fullsized":"2024-09-10T05:59:01.817504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'33","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974919+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:59:01.974919+0000","last_peered":"2024-09-10T05:59:01.974919+0000","last_clean":"2024-09-10T05:59:01.974919+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:59:01.974919+0000","last_undegraded":"2024-09-10T05:59:01.974919+0000","last_fullsized":"2024-09-10T05:59:01.974919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814626+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:59:01.814626+0000","last_peered":"2024-09-10T05:59:01.814626+0000","last_clean":"2024-09-10T05:59:01.814626+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:59:01.814626+0000","last_undegraded":"2024-09-10T05:59:01.814626+0000","last_fullsized":"2024-09-10T05:59:01.814626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'18","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814398+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:59:01.814398+0000","last_peered":"2024-09-10T05:59:01.814398+0000","last_clean":"2024-09-10T05:59:01.814398+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:59:01.814398+0000","last_undegraded":"2024-09-10T05:59:01.814398+0000","last_fullsized":"2024-09-10T05:59:01.814398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970326+0000","last_change":"2024-09-10T05:58:38.090502+0000","last_active":"2024-09-10T05:59:01.970326+0000","last_peered":"2024-09-10T05:59:01.970326+0000","last_clean":"2024-09-10T05:59:01.970326+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:59:01.970326+0000","last_undegraded":"2024-09-10T05:59:01.970326+0000","last_fullsized":"2024-09-10T05:59:01.970326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:56.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'21","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976575+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:59:01.976575+0000","last_peered":"2024-09-10T05:59:01.976575+0000","last_clean":"2024-09-10T05:59:01.976575+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:59:01.976575+0000","last_undegraded":"2024-09-10T05:59:01.976575+0000","last_fullsized":"2024-09-10T05:59:01.976575+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812931+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:59:01.812931+0000","last_peered":"2024-09-10T05:59:01.812931+0000","last_clean":"2024-09-10T05:59:01.812931+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:59:01.812931+0000","last_undegraded":"2024-09-10T05:59:01.812931+0000","last_fullsized":"2024-09-10T05:59:01.812931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'24","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971973+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:59:01.971973+0000","last_peered":"2024-09-10T05:59:01.971973+0000","last_clean":"2024-09-10T05:59:01.971973+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:59:01.971973+0000","last_undegraded":"2024-09-10T05:59:01.971973+0000","last_fullsized":"2024-09-10T05:59:01.971973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824020+0000","last_change":"2024-09-10T05:58:36.090342+0000","last_active":"2024-09-10T05:59:01.824020+0000","last_peered":"2024-09-10T05:59:01.824020+0000","last_clean":"2024-09-10T05:59:01.824020+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:59:01.824020+0000","last_undegraded":"2024-09-10T05:59:01.824020+0000","last_fullsized":"2024-09-10T05:59:01.824020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:15.019257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"111'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817922+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:59:01.817922+0000","last_peered":"2024-09-10T05:59:01.817922+0000","last_clean":"2024-09-10T05:59:01.817922+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:59:01.817922+0000","last_undegraded":"2024-09-10T05:59:01.817922+0000","last_fullsized":"2024-09-10T05:59:01.817922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969117+0000","last_change":"2024-09-10T05:58:36.079403+0000","last_active":"2024-09-10T05:59:01.969117+0000","last_peered":"2024-09-10T05:59:01.969117+0000","last_clean":"2024-09-10T05:59:01.969117+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:59:01.969117+0000","last_undegraded":"2024-09-10T05:59:01.969117+0000","last_fullsized":"2024-09-10T05:59:01.969117+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.025854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980775+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:59:01.980775+0000","last_peered":"2024-09-10T05:59:01.980775+0000","last_clean":"2024-09-10T05:59:01.980775+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:59:01.980775+0000","last_undegraded":"2024-09-10T05:59:01.980775+0000","last_fullsized":"2024-09-10T05:59:01.980775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"111'24","reported_seq":159,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816009+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:59:01.816009+0000","last_peered":"2024-09-10T05:59:01.816009+0000","last_clean":"2024-09-10T05:59:01.816009+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:59:01.816009+0000","last_undegraded":"2024-09-10T05:59:01.816009+0000","last_fullsized":"2024-09-10T05:59:01.816009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815803+0000","last_change":"2024-09-10T05:58:40.744836+0000","last_active":"2024-09-10T05:59:01.815803+0000","last_peered":"2024-09-10T05:59:01.815803+0000","last_clean":"2024-09-10T05:59:01.815803+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:59:01.815803+0000","last_undegraded":"2024-09-10T05:59:01.815803+0000","last_fullsized":"2024-09-10T05:59:01.815803+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969764+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:59:01.969764+0000","last_peered":"2024-09-10T05:59:01.969764+0000","last_clean":"2024-09-10T05:59:01.969764+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:59:01.969764+0000","last_undegraded":"2024-09-10T05:59:01.969764+0000","last_fullsized":"2024-09-10T05:59:01.969764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976451+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:59:01.976451+0000","last_peered":"2024-09-10T05:59:01.976451+0000","last_clean":"2024-09-10T05:59:01.976451+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:59:01.976451+0000","last_undegraded":"2024-09-10T05:59:01.976451+0000","last_fullsized":"2024-09-10T05:59:01.976451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1094,"ondisk_log_size":1094,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382933,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1132,"num_read_kb":862,"num_write":655,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1856152,"kb_used_data":1820804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92515688,"statfs":{"total":96636764160,"available":94736064512,"internally_reserved":0,"allocated":1864503296,"data_stored":1863805989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163328,"kb_used_data":1132140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93208512,"statfs":{"total":96636764160,"available":95445516288,"internally_reserved":0,"allocated":1159311360,"data_stored":1158631588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1816876,"kb_used_data":1781528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92554964,"statfs":{"total":96636764160,"available":94776283136,"internally_reserved":0,"allocated":1824284672,"data_stored":1823545904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693872,"kb_used_data":1658520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677968,"statfs":{"total":96636764160,"available":94902239232,"internally_reserved":0,"allocated":1698324480,"data_stored":1697657651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1931348,"kb_used_data":1900160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92440492,"statfs":{"total":96636764160,"available":94659063808,"internally_reserved":0,"allocated":1945763840,"data_stored":1945064387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099892,"kb_used_data":1060380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93271948,"statfs":{"total":96636764160,"available":95510474752,"internally_reserved":0,"allocated":1085829120,"data_stored":1085171131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202624,"kb_used_data":1163112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93169216,"statfs":{"total":96636764160,"available":95405277184,"internally_reserved":0,"allocated":1191026688,"data_stored":1190321339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1841864,"kb_used_data":1802356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92529976,"statfs":{"total":96636764160,"available":94750695424,"internally_reserved":0,"allocated":1845612544,"data_stored":1844931463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1843396608,"data_stored":1843396608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1189085184,"data_stored":1189085184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1084227584,"data_stored":1084227584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1944059904,"data_stored":1944059904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1822425088,"data_stored":1822425088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1157627904,"data_stored":1157627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1862270976,"data_stored":1862270976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":59916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":117427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":177431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:59:09.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:59:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:59:09.828 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:59:09.844 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-10T05:59:09.736447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819944,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3465,"num_read_kb":3124,"num_write":2963,"num_write_kb":6187124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":853,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4066,"ondisk_log_size":4066,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":531,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12605956,"kb_used_data":12319000,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":742368764,"statfs":{"total":773094113280,"available":760185614336,"internally_reserved":0,"allocated":12614656000,"data_stored":12609129452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.937643"},"pg_stats":[{"pgid":"3.3f","version":"111'22","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972734+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:59:01.972734+0000","last_peered":"2024-09-10T05:59:01.972734+0000","last_clean":"2024-09-10T05:59:01.972734+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:59:01.972734+0000","last_undegraded":"2024-09-10T05:59:01.972734+0000","last_fullsized":"2024-09-10T05:59:01.972734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971871+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:59:01.971871+0000","last_peered":"2024-09-10T05:59:01.971871+0000","last_clean":"2024-09-10T05:59:01.971871+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:59:01.971871+0000","last_undegraded":"2024-09-10T05:59:01.971871+0000","last_fullsized":"2024-09-10T05:59:01.971871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'27","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971064+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:59:01.971064+0000","last_peered":"2024-09-10T05:59:01.971064+0000","last_clean":"2024-09-10T05:59:01.971064+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:59:01.971064+0000","last_undegraded":"2024-09-10T05:59:01.971064+0000","last_fullsized":"2024-09-10T05:59:01.971064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969559+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:59:01.969559+0000","last_peered":"2024-09-10T05:59:01.969559+0000","last_clean":"2024-09-10T05:59:01.969559+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:59:01.969559+0000","last_undegraded":"2024-09-10T05:59:01.969559+0000","last_fullsized":"2024-09-10T05:59:01.969559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'27","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815127+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:59:01.815127+0000","last_peered":"2024-09-10T05:59:01.815127+0000","last_clean":"2024-09-10T05:59:01.815127+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:59:01.815127+0000","last_undegraded":"2024-09-10T05:59:01.815127+0000","last_fullsized":"2024-09-10T05:59:01.815127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813155+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:59:01.813155+0000","last_peered":"2024-09-10T05:59:01.813155+0000","last_clean":"2024-09-10T05:59:01.813155+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:59:01.813155+0000","last_undegraded":"2024-09-10T05:59:01.813155+0000","last_fullsized":"2024-09-10T05:59:01.813155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'21","reported_seq":323,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975785+0000","last_change":"2024-09-10T05:58:40.694618+0000","last_active":"2024-09-10T05:59:01.975785+0000","last_peered":"2024-09-10T05:59:01.975785+0000","last_clean":"2024-09-10T05:59:01.975785+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:59:01.975785+0000","last_undegraded":"2024-09-10T05:59:01.975785+0000","last_fullsized":"2024-09-10T05:59:01.975785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:55.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":310,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813864+0000","last_change":"2024-09-10T05:58:40.726727+0000","last_active":"2024-09-10T05:59:01.813864+0000","last_peered":"2024-09-10T05:59:01.813864+0000","last_clean":"2024-09-10T05:59:01.813864+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:59:01.813864+0000","last_undegraded":"2024-09-10T05:59:01.813864+0000","last_fullsized":"2024-09-10T05:59:01.813864+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:59.972041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'29","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969974+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:59:01.969974+0000","last_peered":"2024-09-10T05:59:01.969974+0000","last_clean":"2024-09-10T05:59:01.969974+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:59:01.969974+0000","last_undegraded":"2024-09-10T05:59:01.969974+0000","last_fullsized":"2024-09-10T05:59:01.969974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975880+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:59:01.975880+0000","last_peered":"2024-09-10T05:59:01.975880+0000","last_clean":"2024-09-10T05:59:01.975880+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:59:01.975880+0000","last_undegraded":"2024-09-10T05:59:01.975880+0000","last_fullsized":"2024-09-10T05:59:01.975880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973856+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:59:01.973856+0000","last_peered":"2024-09-10T05:59:01.973856+0000","last_clean":"2024-09-10T05:59:01.973856+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:59:01.973856+0000","last_undegraded":"2024-09-10T05:59:01.973856+0000","last_fullsized":"2024-09-10T05:59:01.973856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814413+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:59:01.814413+0000","last_peered":"2024-09-10T05:59:01.814413+0000","last_clean":"2024-09-10T05:59:01.814413+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:59:01.814413+0000","last_undegraded":"2024-09-10T05:59:01.814413+0000","last_fullsized":"2024-09-10T05:59:01.814413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'20","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970430+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:59:01.970430+0000","last_peered":"2024-09-10T05:59:01.970430+0000","last_clean":"2024-09-10T05:59:01.970430+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:59:01.970430+0000","last_undegraded":"2024-09-10T05:59:01.970430+0000","last_fullsized":"2024-09-10T05:59:01.970430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975884+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:59:01.975884+0000","last_peered":"2024-09-10T05:59:01.975884+0000","last_clean":"2024-09-10T05:59:01.975884+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:59:01.975884+0000","last_undegraded":"2024-09-10T05:59:01.975884+0000","last_fullsized":"2024-09-10T05:59:01.975884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'13","reported_seq":72,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822936+0000","last_change":"2024-09-10T05:58:42.015968+0000","last_active":"2024-09-10T05:59:01.822936+0000","last_peered":"2024-09-10T05:59:01.822936+0000","last_clean":"2024-09-10T05:59:01.822936+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:59:01.822936+0000","last_undegraded":"2024-09-10T05:59:01.822936+0000","last_fullsized":"2024-09-10T05:59:01.822936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:22.893621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.986778+0000","last_change":"2024-09-10T05:59:01.986479+0000","last_active":"2024-09-10T05:59:01.986778+0000","last_peered":"2024-09-10T05:59:01.986778+0000","last_clean":"2024-09-10T05:59:01.986778+0000","last_became_active":"2024-09-10T05:59:01.981080+0000","last_became_peered":"2024-09-10T05:59:01.981080+0000","last_unstale":"2024-09-10T05:59:01.986778+0000","last_undegraded":"2024-09-10T05:59:01.986778+0000","last_fullsized":"2024-09-10T05:59:01.986778+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:00.572672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812290+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:59:01.812290+0000","last_peered":"2024-09-10T05:59:01.812290+0000","last_clean":"2024-09-10T05:59:01.812290+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:59:01.812290+0000","last_undegraded":"2024-09-10T05:59:01.812290+0000","last_fullsized":"2024-09-10T05:59:01.812290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'19","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972982+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:59:01.972982+0000","last_peered":"2024-09-10T05:59:01.972982+0000","last_clean":"2024-09-10T05:59:01.972982+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:59:01.972982+0000","last_undegraded":"2024-09-10T05:59:01.972982+0000","last_fullsized":"2024-09-10T05:59:01.972982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969838+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:59:01.969838+0000","last_peered":"2024-09-10T05:59:01.969838+0000","last_clean":"2024-09-10T05:59:01.969838+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:59:01.969838+0000","last_undegraded":"2024-09-10T05:59:01.969838+0000","last_fullsized":"2024-09-10T05:59:01.969838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978182+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:59:01.978182+0000","last_peered":"2024-09-10T05:59:01.978182+0000","last_clean":"2024-09-10T05:59:01.978182+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:59:01.978182+0000","last_undegraded":"2024-09-10T05:59:01.978182+0000","last_fullsized":"2024-09-10T05:59:01.978182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974629+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:59:01.974629+0000","last_peered":"2024-09-10T05:59:01.974629+0000","last_clean":"2024-09-10T05:59:01.974629+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:59:01.974629+0000","last_undegraded":"2024-09-10T05:59:01.974629+0000","last_fullsized":"2024-09-10T05:59:01.974629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'18","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978095+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:59:01.978095+0000","last_peered":"2024-09-10T05:59:01.978095+0000","last_clean":"2024-09-10T05:59:01.978095+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:59:01.978095+0000","last_undegraded":"2024-09-10T05:59:01.978095+0000","last_fullsized":"2024-09-10T05:59:01.978095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":277,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816892+0000","last_change":"2024-09-10T05:58:39.367642+0000","last_active":"2024-09-10T05:59:01.816892+0000","last_peered":"2024-09-10T05:59:01.816892+0000","last_clean":"2024-09-10T05:59:01.816892+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:59:01.816892+0000","last_undegraded":"2024-09-10T05:59:01.816892+0000","last_fullsized":"2024-09-10T05:59:01.816892+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'28","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814125+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:59:01.814125+0000","last_peered":"2024-09-10T05:59:01.814125+0000","last_clean":"2024-09-10T05:59:01.814125+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:59:01.814125+0000","last_undegraded":"2024-09-10T05:59:01.814125+0000","last_fullsized":"2024-09-10T05:59:01.814125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818018+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:59:01.818018+0000","last_peered":"2024-09-10T05:59:01.818018+0000","last_clean":"2024-09-10T05:59:01.818018+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:59:01.818018+0000","last_undegraded":"2024-09-10T05:59:01.818018+0000","last_fullsized":"2024-09-10T05:59:01.818018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824233+0000","last_change":"2024-09-10T05:58:42.304778+0000","last_active":"2024-09-10T05:59:01.824233+0000","last_peered":"2024-09-10T05:59:01.824233+0000","last_clean":"2024-09-10T05:59:01.824233+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:59:01.824233+0000","last_undegraded":"2024-09-10T05:59:01.824233+0000","last_fullsized":"2024-09-10T05:59:01.824233+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:41.747059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814552+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:59:01.814552+0000","last_peered":"2024-09-10T05:59:01.814552+0000","last_clean":"2024-09-10T05:59:01.814552+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:59:01.814552+0000","last_undegraded":"2024-09-10T05:59:01.814552+0000","last_fullsized":"2024-09-10T05:59:01.814552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813423+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:59:01.813423+0000","last_peered":"2024-09-10T05:59:01.813423+0000","last_clean":"2024-09-10T05:59:01.813423+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:59:01.813423+0000","last_undegraded":"2024-09-10T05:59:01.813423+0000","last_fullsized":"2024-09-10T05:59:01.813423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811956+0000","last_change":"2024-09-10T05:58:38.995573+0000","last_active":"2024-09-10T05:59:01.811956+0000","last_peered":"2024-09-10T05:59:01.811956+0000","last_clean":"2024-09-10T05:59:01.811956+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:59:01.811956+0000","last_undegraded":"2024-09-10T05:59:01.811956+0000","last_fullsized":"2024-09-10T05:59:01.811956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":54,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825533+0000","last_change":"2024-09-10T05:58:37.289796+0000","last_active":"2024-09-10T05:59:01.825533+0000","last_peered":"2024-09-10T05:59:01.825533+0000","last_clean":"2024-09-10T05:59:01.825533+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:59:01.825533+0000","last_undegraded":"2024-09-10T05:59:01.825533+0000","last_fullsized":"2024-09-10T05:59:01.825533+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:13.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'19","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970418+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:59:01.970418+0000","last_peered":"2024-09-10T05:59:01.970418+0000","last_clean":"2024-09-10T05:59:01.970418+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:59:01.970418+0000","last_undegraded":"2024-09-10T05:59:01.970418+0000","last_fullsized":"2024-09-10T05:59:01.970418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976010+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:59:01.976010+0000","last_peered":"2024-09-10T05:59:01.976010+0000","last_clean":"2024-09-10T05:59:01.976010+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:59:01.976010+0000","last_undegraded":"2024-09-10T05:59:01.976010+0000","last_fullsized":"2024-09-10T05:59:01.976010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"111'30","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815225+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:59:01.815225+0000","last_peered":"2024-09-10T05:59:01.815225+0000","last_clean":"2024-09-10T05:59:01.815225+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:59:01.815225+0000","last_undegraded":"2024-09-10T05:59:01.815225+0000","last_fullsized":"2024-09-10T05:59:01.815225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972175+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:59:01.972175+0000","last_peered":"2024-09-10T05:59:01.972175+0000","last_clean":"2024-09-10T05:59:01.972175+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:59:01.972175+0000","last_undegraded":"2024-09-10T05:59:01.972175+0000","last_fullsized":"2024-09-10T05:59:01.972175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"111'48","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972638+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:59:01.972638+0000","last_peered":"2024-09-10T05:59:01.972638+0000","last_clean":"2024-09-10T05:59:01.972638+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:59:01.972638+0000","last_undegraded":"2024-09-10T05:59:01.972638+0000","last_fullsized":"2024-09-10T05:59:01.972638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980010+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:59:01.980010+0000","last_peered":"2024-09-10T05:59:01.980010+0000","last_clean":"2024-09-10T05:59:01.980010+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:59:01.980010+0000","last_undegraded":"2024-09-10T05:59:01.980010+0000","last_fullsized":"2024-09-10T05:59:01.980010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813555+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:59:01.813555+0000","last_peered":"2024-09-10T05:59:01.813555+0000","last_clean":"2024-09-10T05:59:01.813555+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:59:01.813555+0000","last_undegraded":"2024-09-10T05:59:01.813555+0000","last_fullsized":"2024-09-10T05:59:01.813555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825797+0000","last_change":"2024-09-10T05:58:36.074698+0000","last_active":"2024-09-10T05:59:01.825797+0000","last_peered":"2024-09-10T05:59:01.825797+0000","last_clean":"2024-09-10T05:59:01.825797+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:59:01.825797+0000","last_undegraded":"2024-09-10T05:59:01.825797+0000","last_fullsized":"2024-09-10T05:59:01.825797+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:37.044312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814922+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:59:01.814922+0000","last_peered":"2024-09-10T05:59:01.814922+0000","last_clean":"2024-09-10T05:59:01.814922+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:59:01.814922+0000","last_undegraded":"2024-09-10T05:59:01.814922+0000","last_fullsized":"2024-09-10T05:59:01.814922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814332+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:59:01.814332+0000","last_peered":"2024-09-10T05:59:01.814332+0000","last_clean":"2024-09-10T05:59:01.814332+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:59:01.814332+0000","last_undegraded":"2024-09-10T05:59:01.814332+0000","last_fullsized":"2024-09-10T05:59:01.814332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813141+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:59:01.813141+0000","last_peered":"2024-09-10T05:59:01.813141+0000","last_clean":"2024-09-10T05:59:01.813141+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:59:01.813141+0000","last_undegraded":"2024-09-10T05:59:01.813141+0000","last_fullsized":"2024-09-10T05:59:01.813141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816148+0000","last_change":"2024-09-10T05:58:36.709426+0000","last_active":"2024-09-10T05:59:01.816148+0000","last_peered":"2024-09-10T05:59:01.816148+0000","last_clean":"2024-09-10T05:59:01.816148+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:59:01.816148+0000","last_undegraded":"2024-09-10T05:59:01.816148+0000","last_fullsized":"2024-09-10T05:59:01.816148+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:16.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970499+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:59:01.970499+0000","last_peered":"2024-09-10T05:59:01.970499+0000","last_clean":"2024-09-10T05:59:01.970499+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:59:01.970499+0000","last_undegraded":"2024-09-10T05:59:01.970499+0000","last_fullsized":"2024-09-10T05:59:01.970499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825597+0000","last_change":"2024-09-10T05:58:36.086954+0000","last_active":"2024-09-10T05:59:01.825597+0000","last_peered":"2024-09-10T05:59:01.825597+0000","last_clean":"2024-09-10T05:59:01.825597+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:59:01.825597+0000","last_undegraded":"2024-09-10T05:59:01.825597+0000","last_fullsized":"2024-09-10T05:59:01.825597+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:57.423283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817459+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:59:01.817459+0000","last_peered":"2024-09-10T05:59:01.817459+0000","last_clean":"2024-09-10T05:59:01.817459+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:59:01.817459+0000","last_undegraded":"2024-09-10T05:59:01.817459+0000","last_fullsized":"2024-09-10T05:59:01.817459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"131'135","reported_seq":388,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969726+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:59:01.969726+0000","last_peered":"2024-09-10T05:59:01.969726+0000","last_clean":"2024-09-10T05:59:01.969726+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:59:01.969726+0000","last_undegraded":"2024-09-10T05:59:01.969726+0000","last_fullsized":"2024-09-10T05:59:01.969726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812887+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:59:01.812887+0000","last_peered":"2024-09-10T05:59:01.812887+0000","last_clean":"2024-09-10T05:59:01.812887+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:59:01.812887+0000","last_undegraded":"2024-09-10T05:59:01.812887+0000","last_fullsized":"2024-09-10T05:59:01.812887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825894+0000","last_change":"2024-09-10T05:58:39.658860+0000","last_active":"2024-09-10T05:59:01.825894+0000","last_peered":"2024-09-10T05:59:01.825894+0000","last_clean":"2024-09-10T05:59:01.825894+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:59:01.825894+0000","last_undegraded":"2024-09-10T05:59:01.825894+0000","last_fullsized":"2024-09-10T05:59:01.825894+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:22.522890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'18","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980852+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:59:01.980852+0000","last_peered":"2024-09-10T05:59:01.980852+0000","last_clean":"2024-09-10T05:59:01.980852+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:59:01.980852+0000","last_undegraded":"2024-09-10T05:59:01.980852+0000","last_fullsized":"2024-09-10T05:59:01.980852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975529+0000","last_change":"2024-09-10T05:58:36.076514+0000","last_active":"2024-09-10T05:59:01.975529+0000","last_peered":"2024-09-10T05:59:01.975529+0000","last_clean":"2024-09-10T05:59:01.975529+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:59:01.975529+0000","last_undegraded":"2024-09-10T05:59:01.975529+0000","last_fullsized":"2024-09-10T05:59:01.975529+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:58.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"111'23","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970669+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:59:01.970669+0000","last_peered":"2024-09-10T05:59:01.970669+0000","last_clean":"2024-09-10T05:59:01.970669+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:59:01.970669+0000","last_undegraded":"2024-09-10T05:59:01.970669+0000","last_fullsized":"2024-09-10T05:59:01.970669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"131'142","reported_seq":348,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825244+0000","last_change":"2024-09-10T05:58:42.104842+0000","last_active":"2024-09-10T05:59:01.825244+0000","last_peered":"2024-09-10T05:59:01.825244+0000","last_clean":"2024-09-10T05:59:01.825244+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:59:01.825244+0000","last_undegraded":"2024-09-10T05:59:01.825244+0000","last_fullsized":"2024-09-10T05:59:01.825244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:06.712578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980182+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:59:01.980182+0000","last_peered":"2024-09-10T05:59:01.980182+0000","last_clean":"2024-09-10T05:59:01.980182+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:59:01.980182+0000","last_undegraded":"2024-09-10T05:59:01.980182+0000","last_fullsized":"2024-09-10T05:59:01.980182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973225+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:59:01.973225+0000","last_peered":"2024-09-10T05:59:01.973225+0000","last_clean":"2024-09-10T05:59:01.973225+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:59:01.973225+0000","last_undegraded":"2024-09-10T05:59:01.973225+0000","last_fullsized":"2024-09-10T05:59:01.973225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969010+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:59:01.969010+0000","last_peered":"2024-09-10T05:59:01.969010+0000","last_clean":"2024-09-10T05:59:01.969010+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:59:01.969010+0000","last_undegraded":"2024-09-10T05:59:01.969010+0000","last_fullsized":"2024-09-10T05:59:01.969010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"111'35","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973945+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:59:01.973945+0000","last_peered":"2024-09-10T05:59:01.973945+0000","last_clean":"2024-09-10T05:59:01.973945+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:59:01.973945+0000","last_undegraded":"2024-09-10T05:59:01.973945+0000","last_fullsized":"2024-09-10T05:59:01.973945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969386+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:59:01.969386+0000","last_peered":"2024-09-10T05:59:01.969386+0000","last_clean":"2024-09-10T05:59:01.969386+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:59:01.969386+0000","last_undegraded":"2024-09-10T05:59:01.969386+0000","last_fullsized":"2024-09-10T05:59:01.969386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975163+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:59:01.975163+0000","last_peered":"2024-09-10T05:59:01.975163+0000","last_clean":"2024-09-10T05:59:01.975163+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:59:01.975163+0000","last_undegraded":"2024-09-10T05:59:01.975163+0000","last_fullsized":"2024-09-10T05:59:01.975163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812553+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:59:01.812553+0000","last_peered":"2024-09-10T05:59:01.812553+0000","last_clean":"2024-09-10T05:59:01.812553+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:59:01.812553+0000","last_undegraded":"2024-09-10T05:59:01.812553+0000","last_fullsized":"2024-09-10T05:59:01.812553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'21","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972822+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:59:01.972822+0000","last_peered":"2024-09-10T05:59:01.972822+0000","last_clean":"2024-09-10T05:59:01.972822+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:59:01.972822+0000","last_undegraded":"2024-09-10T05:59:01.972822+0000","last_fullsized":"2024-09-10T05:59:01.972822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816319+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:59:01.816319+0000","last_peered":"2024-09-10T05:59:01.816319+0000","last_clean":"2024-09-10T05:59:01.816319+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:59:01.816319+0000","last_undegraded":"2024-09-10T05:59:01.816319+0000","last_fullsized":"2024-09-10T05:59:01.816319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"111'23","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824547+0000","last_change":"2024-09-10T05:58:41.124218+0000","last_active":"2024-09-10T05:59:01.824547+0000","last_peered":"2024-09-10T05:59:01.824547+0000","last_clean":"2024-09-10T05:59:01.824547+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:59:01.824547+0000","last_undegraded":"2024-09-10T05:59:01.824547+0000","last_fullsized":"2024-09-10T05:59:01.824547+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:13.232943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823296+0000","last_change":"2024-09-10T05:58:36.068634+0000","last_active":"2024-09-10T05:59:01.823296+0000","last_peered":"2024-09-10T05:59:01.823296+0000","last_clean":"2024-09-10T05:59:01.823296+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:59:01.823296+0000","last_undegraded":"2024-09-10T05:59:01.823296+0000","last_fullsized":"2024-09-10T05:59:01.823296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:54.848895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977060+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:59:01.977060+0000","last_peered":"2024-09-10T05:59:01.977060+0000","last_clean":"2024-09-10T05:59:01.977060+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:59:01.977060+0000","last_undegraded":"2024-09-10T05:59:01.977060+0000","last_fullsized":"2024-09-10T05:59:01.977060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974434+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:59:01.974434+0000","last_peered":"2024-09-10T05:59:01.974434+0000","last_clean":"2024-09-10T05:59:01.974434+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:59:01.974434+0000","last_undegraded":"2024-09-10T05:59:01.974434+0000","last_fullsized":"2024-09-10T05:59:01.974434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'23","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971267+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:59:01.971267+0000","last_peered":"2024-09-10T05:59:01.971267+0000","last_clean":"2024-09-10T05:59:01.971267+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:59:01.971267+0000","last_undegraded":"2024-09-10T05:59:01.971267+0000","last_fullsized":"2024-09-10T05:59:01.971267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818189+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:59:01.818189+0000","last_peered":"2024-09-10T05:59:01.818189+0000","last_clean":"2024-09-10T05:59:01.818189+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:59:01.818189+0000","last_undegraded":"2024-09-10T05:59:01.818189+0000","last_fullsized":"2024-09-10T05:59:01.818189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"111'35","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969535+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:59:01.969535+0000","last_peered":"2024-09-10T05:59:01.969535+0000","last_clean":"2024-09-10T05:59:01.969535+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:59:01.969535+0000","last_undegraded":"2024-09-10T05:59:01.969535+0000","last_fullsized":"2024-09-10T05:59:01.969535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"131'135","reported_seq":465,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812578+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:59:01.812578+0000","last_peered":"2024-09-10T05:59:01.812578+0000","last_clean":"2024-09-10T05:59:01.812578+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:59:01.812578+0000","last_undegraded":"2024-09-10T05:59:01.812578+0000","last_fullsized":"2024-09-10T05:59:01.812578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815295+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:59:01.815295+0000","last_peered":"2024-09-10T05:59:01.815295+0000","last_clean":"2024-09-10T05:59:01.815295+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:59:01.815295+0000","last_undegraded":"2024-09-10T05:59:01.815295+0000","last_fullsized":"2024-09-10T05:59:01.815295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814879+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:59:01.814879+0000","last_peered":"2024-09-10T05:59:01.814879+0000","last_clean":"2024-09-10T05:59:01.814879+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:59:01.814879+0000","last_undegraded":"2024-09-10T05:59:01.814879+0000","last_fullsized":"2024-09-10T05:59:01.814879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'12","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816872+0000","last_change":"2024-09-10T05:58:38.085546+0000","last_active":"2024-09-10T05:59:01.816872+0000","last_peered":"2024-09-10T05:59:01.816872+0000","last_clean":"2024-09-10T05:59:01.816872+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:59:01.816872+0000","last_undegraded":"2024-09-10T05:59:01.816872+0000","last_fullsized":"2024-09-10T05:59:01.816872+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:10.893758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817040+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:59:01.817040+0000","last_peered":"2024-09-10T05:59:01.817040+0000","last_clean":"2024-09-10T05:59:01.817040+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:59:01.817040+0000","last_undegraded":"2024-09-10T05:59:01.817040+0000","last_fullsized":"2024-09-10T05:59:01.817040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'40","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813070+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:59:01.813070+0000","last_peered":"2024-09-10T05:59:01.813070+0000","last_clean":"2024-09-10T05:59:01.813070+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:59:01.813070+0000","last_undegraded":"2024-09-10T05:59:01.813070+0000","last_fullsized":"2024-09-10T05:59:01.813070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816028+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:59:01.816028+0000","last_peered":"2024-09-10T05:59:01.816028+0000","last_clean":"2024-09-10T05:59:01.816028+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:59:01.816028+0000","last_undegraded":"2024-09-10T05:59:01.816028+0000","last_fullsized":"2024-09-10T05:59:01.816028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970802+0000","last_change":"2024-09-10T05:58:39.385287+0000","last_active":"2024-09-10T05:59:01.970802+0000","last_peered":"2024-09-10T05:59:01.970802+0000","last_clean":"2024-09-10T05:59:01.970802+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:59:01.970802+0000","last_undegraded":"2024-09-10T05:59:01.970802+0000","last_fullsized":"2024-09-10T05:59:01.970802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:27.225607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814320+0000","last_change":"2024-09-10T05:58:40.751831+0000","last_active":"2024-09-10T05:59:01.814320+0000","last_peered":"2024-09-10T05:59:01.814320+0000","last_clean":"2024-09-10T05:59:01.814320+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:59:01.814320+0000","last_undegraded":"2024-09-10T05:59:01.814320+0000","last_fullsized":"2024-09-10T05:59:01.814320+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:32.405571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'27","reported_seq":100,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826184+0000","last_change":"2024-09-10T05:58:38.720733+0000","last_active":"2024-09-10T05:59:01.826184+0000","last_peered":"2024-09-10T05:59:01.826184+0000","last_clean":"2024-09-10T05:59:01.826184+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:59:01.826184+0000","last_undegraded":"2024-09-10T05:59:01.826184+0000","last_fullsized":"2024-09-10T05:59:01.826184+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:07.402320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817160+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:59:01.817160+0000","last_peered":"2024-09-10T05:59:01.817160+0000","last_clean":"2024-09-10T05:59:01.817160+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:59:01.817160+0000","last_undegraded":"2024-09-10T05:59:01.817160+0000","last_fullsized":"2024-09-10T05:59:01.817160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"111'28","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814499+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:59:01.814499+0000","last_peered":"2024-09-10T05:59:01.814499+0000","last_clean":"2024-09-10T05:59:01.814499+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:59:01.814499+0000","last_undegraded":"2024-09-10T05:59:01.814499+0000","last_fullsized":"2024-09-10T05:59:01.814499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":23,"num_write":20,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815733+0000","last_change":"2024-09-10T05:58:36.081028+0000","last_active":"2024-09-10T05:59:01.815733+0000","last_peered":"2024-09-10T05:59:01.815733+0000","last_clean":"2024-09-10T05:59:01.815733+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:59:01.815733+0000","last_undegraded":"2024-09-10T05:59:01.815733+0000","last_fullsized":"2024-09-10T05:59:01.815733+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:17.752342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822644+0000","last_change":"2024-09-10T05:58:42.021549+0000","last_active":"2024-09-10T05:59:01.822644+0000","last_peered":"2024-09-10T05:59:01.822644+0000","last_clean":"2024-09-10T05:59:01.822644+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:59:01.822644+0000","last_undegraded":"2024-09-10T05:59:01.822644+0000","last_fullsized":"2024-09-10T05:59:01.822644+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:23.621053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814696+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:59:01.814696+0000","last_peered":"2024-09-10T05:59:01.814696+0000","last_clean":"2024-09-10T05:59:01.814696+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:59:01.814696+0000","last_undegraded":"2024-09-10T05:59:01.814696+0000","last_fullsized":"2024-09-10T05:59:01.814696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974982+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:59:01.974982+0000","last_peered":"2024-09-10T05:59:01.974982+0000","last_clean":"2024-09-10T05:59:01.974982+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:59:01.974982+0000","last_undegraded":"2024-09-10T05:59:01.974982+0000","last_fullsized":"2024-09-10T05:59:01.974982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969798+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:59:01.969798+0000","last_peered":"2024-09-10T05:59:01.969798+0000","last_clean":"2024-09-10T05:59:01.969798+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:59:01.969798+0000","last_undegraded":"2024-09-10T05:59:01.969798+0000","last_fullsized":"2024-09-10T05:59:01.969798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"111'23","reported_seq":336,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817802+0000","last_change":"2024-09-10T05:58:40.714764+0000","last_active":"2024-09-10T05:59:01.817802+0000","last_peered":"2024-09-10T05:59:01.817802+0000","last_clean":"2024-09-10T05:59:01.817802+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:59:01.817802+0000","last_undegraded":"2024-09-10T05:59:01.817802+0000","last_fullsized":"2024-09-10T05:59:01.817802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:27.289268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"131'135","reported_seq":402,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817330+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:59:01.817330+0000","last_peered":"2024-09-10T05:59:01.817330+0000","last_clean":"2024-09-10T05:59:01.817330+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:59:01.817330+0000","last_undegraded":"2024-09-10T05:59:01.817330+0000","last_fullsized":"2024-09-10T05:59:01.817330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969247+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:59:01.969247+0000","last_peered":"2024-09-10T05:59:01.969247+0000","last_clean":"2024-09-10T05:59:01.969247+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:59:01.969247+0000","last_undegraded":"2024-09-10T05:59:01.969247+0000","last_fullsized":"2024-09-10T05:59:01.969247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815015+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:59:01.815015+0000","last_peered":"2024-09-10T05:59:01.815015+0000","last_clean":"2024-09-10T05:59:01.815015+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:59:01.815015+0000","last_undegraded":"2024-09-10T05:59:01.815015+0000","last_fullsized":"2024-09-10T05:59:01.815015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813269+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:59:01.813269+0000","last_peered":"2024-09-10T05:59:01.813269+0000","last_clean":"2024-09-10T05:59:01.813269+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:59:01.813269+0000","last_undegraded":"2024-09-10T05:59:01.813269+0000","last_fullsized":"2024-09-10T05:59:01.813269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":398,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976555+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:59:01.976555+0000","last_peered":"2024-09-10T05:59:01.976555+0000","last_clean":"2024-09-10T05:59:01.976555+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:59:01.976555+0000","last_undegraded":"2024-09-10T05:59:01.976555+0000","last_fullsized":"2024-09-10T05:59:01.976555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824969+0000","last_change":"2024-09-10T05:58:37.286390+0000","last_active":"2024-09-10T05:59:01.824969+0000","last_peered":"2024-09-10T05:59:01.824969+0000","last_clean":"2024-09-10T05:59:01.824969+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:59:01.824969+0000","last_undegraded":"2024-09-10T05:59:01.824969+0000","last_fullsized":"2024-09-10T05:59:01.824969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:08.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"131'135","reported_seq":434,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977577+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:59:01.977577+0000","last_peered":"2024-09-10T05:59:01.977577+0000","last_clean":"2024-09-10T05:59:01.977577+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:59:01.977577+0000","last_undegraded":"2024-09-10T05:59:01.977577+0000","last_fullsized":"2024-09-10T05:59:01.977577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812864+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:59:01.812864+0000","last_peered":"2024-09-10T05:59:01.812864+0000","last_clean":"2024-09-10T05:59:01.812864+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:59:01.812864+0000","last_undegraded":"2024-09-10T05:59:01.812864+0000","last_fullsized":"2024-09-10T05:59:01.812864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976229+0000","last_change":"2024-09-10T05:58:40.805304+0000","last_active":"2024-09-10T05:59:01.976229+0000","last_peered":"2024-09-10T05:59:01.976229+0000","last_clean":"2024-09-10T05:59:01.976229+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:59:01.976229+0000","last_undegraded":"2024-09-10T05:59:01.976229+0000","last_fullsized":"2024-09-10T05:59:01.976229+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:26.888956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823741+0000","last_change":"2024-09-10T05:58:41.608913+0000","last_active":"2024-09-10T05:59:01.823741+0000","last_peered":"2024-09-10T05:59:01.823741+0000","last_clean":"2024-09-10T05:59:01.823741+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:59:01.823741+0000","last_undegraded":"2024-09-10T05:59:01.823741+0000","last_fullsized":"2024-09-10T05:59:01.823741+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:15.544218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814783+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:59:01.814783+0000","last_peered":"2024-09-10T05:59:01.814783+0000","last_clean":"2024-09-10T05:59:01.814783+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:59:01.814783+0000","last_undegraded":"2024-09-10T05:59:01.814783+0000","last_fullsized":"2024-09-10T05:59:01.814783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"111'25","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975641+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:59:01.975641+0000","last_peered":"2024-09-10T05:59:01.975641+0000","last_clean":"2024-09-10T05:59:01.975641+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:59:01.975641+0000","last_undegraded":"2024-09-10T05:59:01.975641+0000","last_fullsized":"2024-09-10T05:59:01.975641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975062+0000","last_change":"2024-09-10T05:58:36.080814+0000","last_active":"2024-09-10T05:59:01.975062+0000","last_peered":"2024-09-10T05:59:01.975062+0000","last_clean":"2024-09-10T05:59:01.975062+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:59:01.975062+0000","last_undegraded":"2024-09-10T05:59:01.975062+0000","last_fullsized":"2024-09-10T05:59:01.975062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:12.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969254+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:59:01.969254+0000","last_peered":"2024-09-10T05:59:01.969254+0000","last_clean":"2024-09-10T05:59:01.969254+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:59:01.969254+0000","last_undegraded":"2024-09-10T05:59:01.969254+0000","last_fullsized":"2024-09-10T05:59:01.969254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978032+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:59:01.978032+0000","last_peered":"2024-09-10T05:59:01.978032+0000","last_clean":"2024-09-10T05:59:01.978032+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:59:01.978032+0000","last_undegraded":"2024-09-10T05:59:01.978032+0000","last_fullsized":"2024-09-10T05:59:01.978032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969848+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:59:01.969848+0000","last_peered":"2024-09-10T05:59:01.969848+0000","last_clean":"2024-09-10T05:59:01.969848+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:59:01.969848+0000","last_undegraded":"2024-09-10T05:59:01.969848+0000","last_fullsized":"2024-09-10T05:59:01.969848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973650+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:59:01.973650+0000","last_peered":"2024-09-10T05:59:01.973650+0000","last_clean":"2024-09-10T05:59:01.973650+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:59:01.973650+0000","last_undegraded":"2024-09-10T05:59:01.973650+0000","last_fullsized":"2024-09-10T05:59:01.973650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"111'28","reported_seq":102,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822940+0000","last_change":"2024-09-10T05:58:38.110183+0000","last_active":"2024-09-10T05:59:01.822940+0000","last_peered":"2024-09-10T05:59:01.822940+0000","last_clean":"2024-09-10T05:59:01.822940+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:59:01.822940+0000","last_undegraded":"2024-09-10T05:59:01.822940+0000","last_fullsized":"2024-09-10T05:59:01.822940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.156258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970305+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:59:01.970305+0000","last_peered":"2024-09-10T05:59:01.970305+0000","last_clean":"2024-09-10T05:59:01.970305+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:59:01.970305+0000","last_undegraded":"2024-09-10T05:59:01.970305+0000","last_fullsized":"2024-09-10T05:59:01.970305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"111'43","reported_seq":357,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976753+0000","last_change":"2024-09-10T05:58:40.775802+0000","last_active":"2024-09-10T05:59:01.976753+0000","last_peered":"2024-09-10T05:59:01.976753+0000","last_clean":"2024-09-10T05:59:01.976753+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:59:01.976753+0000","last_undegraded":"2024-09-10T05:59:01.976753+0000","last_fullsized":"2024-09-10T05:59:01.976753+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.223922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815484+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:59:01.815484+0000","last_peered":"2024-09-10T05:59:01.815484+0000","last_clean":"2024-09-10T05:59:01.815484+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:59:01.815484+0000","last_undegraded":"2024-09-10T05:59:01.815484+0000","last_fullsized":"2024-09-10T05:59:01.815484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973038+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:59:01.973038+0000","last_peered":"2024-09-10T05:59:01.973038+0000","last_clean":"2024-09-10T05:59:01.973038+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:59:01.973038+0000","last_undegraded":"2024-09-10T05:59:01.973038+0000","last_fullsized":"2024-09-10T05:59:01.973038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815904+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:59:01.815904+0000","last_peered":"2024-09-10T05:59:01.815904+0000","last_clean":"2024-09-10T05:59:01.815904+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:59:01.815904+0000","last_undegraded":"2024-09-10T05:59:01.815904+0000","last_fullsized":"2024-09-10T05:59:01.815904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969288+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:59:01.969288+0000","last_peered":"2024-09-10T05:59:01.969288+0000","last_clean":"2024-09-10T05:59:01.969288+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:59:01.969288+0000","last_undegraded":"2024-09-10T05:59:01.969288+0000","last_fullsized":"2024-09-10T05:59:01.969288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'19","reported_seq":246,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813209+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:59:01.813209+0000","last_peered":"2024-09-10T05:59:01.813209+0000","last_clean":"2024-09-10T05:59:01.813209+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:59:01.813209+0000","last_undegraded":"2024-09-10T05:59:01.813209+0000","last_fullsized":"2024-09-10T05:59:01.813209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979956+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:59:01.979956+0000","last_peered":"2024-09-10T05:59:01.979956+0000","last_clean":"2024-09-10T05:59:01.979956+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:59:01.979956+0000","last_undegraded":"2024-09-10T05:59:01.979956+0000","last_fullsized":"2024-09-10T05:59:01.979956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"131'143","reported_seq":466,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969792+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:59:01.969792+0000","last_peered":"2024-09-10T05:59:01.969792+0000","last_clean":"2024-09-10T05:59:01.969792+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:59:01.969792+0000","last_undegraded":"2024-09-10T05:59:01.969792+0000","last_fullsized":"2024-09-10T05:59:01.969792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":185,"num_read_kb":169,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970038+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:59:01.970038+0000","last_peered":"2024-09-10T05:59:01.970038+0000","last_clean":"2024-09-10T05:59:01.970038+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:59:01.970038+0000","last_undegraded":"2024-09-10T05:59:01.970038+0000","last_fullsized":"2024-09-10T05:59:01.970038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969029+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:59:01.969029+0000","last_peered":"2024-09-10T05:59:01.969029+0000","last_clean":"2024-09-10T05:59:01.969029+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:59:01.969029+0000","last_undegraded":"2024-09-10T05:59:01.969029+0000","last_fullsized":"2024-09-10T05:59:01.969029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971269+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:59:01.971269+0000","last_peered":"2024-09-10T05:59:01.971269+0000","last_clean":"2024-09-10T05:59:01.971269+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:59:01.971269+0000","last_undegraded":"2024-09-10T05:59:01.971269+0000","last_fullsized":"2024-09-10T05:59:01.971269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816763+0000","last_change":"2024-09-10T05:58:36.063964+0000","last_active":"2024-09-10T05:59:01.816763+0000","last_peered":"2024-09-10T05:59:01.816763+0000","last_clean":"2024-09-10T05:59:01.816763+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:59:01.816763+0000","last_undegraded":"2024-09-10T05:59:01.816763+0000","last_fullsized":"2024-09-10T05:59:01.816763+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:53.613158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969020+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:59:01.969020+0000","last_peered":"2024-09-10T05:59:01.969020+0000","last_clean":"2024-09-10T05:59:01.969020+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:59:01.969020+0000","last_undegraded":"2024-09-10T05:59:01.969020+0000","last_fullsized":"2024-09-10T05:59:01.969020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817645+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:59:01.817645+0000","last_peered":"2024-09-10T05:59:01.817645+0000","last_clean":"2024-09-10T05:59:01.817645+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:59:01.817645+0000","last_undegraded":"2024-09-10T05:59:01.817645+0000","last_fullsized":"2024-09-10T05:59:01.817645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"131'16","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970890+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:59:01.970890+0000","last_peered":"2024-09-10T05:59:01.970890+0000","last_clean":"2024-09-10T05:59:01.970890+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:59:01.970890+0000","last_undegraded":"2024-09-10T05:59:01.970890+0000","last_fullsized":"2024-09-10T05:59:01.970890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814189+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:59:01.814189+0000","last_peered":"2024-09-10T05:59:01.814189+0000","last_clean":"2024-09-10T05:59:01.814189+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:59:01.814189+0000","last_undegraded":"2024-09-10T05:59:01.814189+0000","last_fullsized":"2024-09-10T05:59:01.814189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825738+0000","last_change":"2024-09-10T05:58:36.090394+0000","last_active":"2024-09-10T05:59:01.825738+0000","last_peered":"2024-09-10T05:59:01.825738+0000","last_clean":"2024-09-10T05:59:01.825738+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:59:01.825738+0000","last_undegraded":"2024-09-10T05:59:01.825738+0000","last_fullsized":"2024-09-10T05:59:01.825738+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:49.622437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970102+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:59:01.970102+0000","last_peered":"2024-09-10T05:59:01.970102+0000","last_clean":"2024-09-10T05:59:01.970102+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:59:01.970102+0000","last_undegraded":"2024-09-10T05:59:01.970102+0000","last_fullsized":"2024-09-10T05:59:01.970102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975334+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:59:01.975334+0000","last_peered":"2024-09-10T05:59:01.975334+0000","last_clean":"2024-09-10T05:59:01.975334+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:59:01.975334+0000","last_undegraded":"2024-09-10T05:59:01.975334+0000","last_fullsized":"2024-09-10T05:59:01.975334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'35","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814126+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:59:01.814126+0000","last_peered":"2024-09-10T05:59:01.814126+0000","last_clean":"2024-09-10T05:59:01.814126+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:59:01.814126+0000","last_undegraded":"2024-09-10T05:59:01.814126+0000","last_fullsized":"2024-09-10T05:59:01.814126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814731+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:59:01.814731+0000","last_peered":"2024-09-10T05:59:01.814731+0000","last_clean":"2024-09-10T05:59:01.814731+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:59:01.814731+0000","last_undegraded":"2024-09-10T05:59:01.814731+0000","last_fullsized":"2024-09-10T05:59:01.814731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825316+0000","last_change":"2024-09-10T05:58:37.301597+0000","last_active":"2024-09-10T05:59:01.825316+0000","last_peered":"2024-09-10T05:59:01.825316+0000","last_clean":"2024-09-10T05:59:01.825316+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:59:01.825316+0000","last_undegraded":"2024-09-10T05:59:01.825316+0000","last_fullsized":"2024-09-10T05:59:01.825316+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:30.282821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978658+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:59:01.978658+0000","last_peered":"2024-09-10T05:59:01.978658+0000","last_clean":"2024-09-10T05:59:01.978658+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:59:01.978658+0000","last_undegraded":"2024-09-10T05:59:01.978658+0000","last_fullsized":"2024-09-10T05:59:01.978658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971389+0000","last_change":"2024-09-10T05:58:40.735106+0000","last_active":"2024-09-10T05:59:01.971389+0000","last_peered":"2024-09-10T05:59:01.971389+0000","last_clean":"2024-09-10T05:59:01.971389+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:59:01.971389+0000","last_undegraded":"2024-09-10T05:59:01.971389+0000","last_fullsized":"2024-09-10T05:59:01.971389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:08.686783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":197,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816305+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:59:01.816305+0000","last_peered":"2024-09-10T05:59:01.816305+0000","last_clean":"2024-09-10T05:59:01.816305+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:59:01.816305+0000","last_undegraded":"2024-09-10T05:59:01.816305+0000","last_fullsized":"2024-09-10T05:59:01.816305+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"111'25","reported_seq":331,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980506+0000","last_change":"2024-09-10T05:58:39.363982+0000","last_active":"2024-09-10T05:59:01.980506+0000","last_peered":"2024-09-10T05:59:01.980506+0000","last_clean":"2024-09-10T05:59:01.980506+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:59:01.980506+0000","last_undegraded":"2024-09-10T05:59:01.980506+0000","last_fullsized":"2024-09-10T05:59:01.980506+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:12.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970391+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:59:01.970391+0000","last_peered":"2024-09-10T05:59:01.970391+0000","last_clean":"2024-09-10T05:59:01.970391+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:59:01.970391+0000","last_undegraded":"2024-09-10T05:59:01.970391+0000","last_fullsized":"2024-09-10T05:59:01.970391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":309,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814142+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:59:01.814142+0000","last_peered":"2024-09-10T05:59:01.814142+0000","last_clean":"2024-09-10T05:59:01.814142+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:59:01.814142+0000","last_undegraded":"2024-09-10T05:59:01.814142+0000","last_fullsized":"2024-09-10T05:59:01.814142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"111'47","reported_seq":400,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812698+0000","last_change":"2024-09-10T05:58:39.382781+0000","last_active":"2024-09-10T05:59:01.812698+0000","last_peered":"2024-09-10T05:59:01.812698+0000","last_clean":"2024-09-10T05:59:01.812698+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:59:01.812698+0000","last_undegraded":"2024-09-10T05:59:01.812698+0000","last_fullsized":"2024-09-10T05:59:01.812698+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:54.079756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812156+0000","last_change":"2024-09-10T05:58:36.065033+0000","last_active":"2024-09-10T05:59:01.812156+0000","last_peered":"2024-09-10T05:59:01.812156+0000","last_clean":"2024-09-10T05:59:01.812156+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:59:01.812156+0000","last_undegraded":"2024-09-10T05:59:01.812156+0000","last_fullsized":"2024-09-10T05:59:01.812156+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.563276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814898+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:59:01.814898+0000","last_peered":"2024-09-10T05:59:01.814898+0000","last_clean":"2024-09-10T05:59:01.814898+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:59:01.814898+0000","last_undegraded":"2024-09-10T05:59:01.814898+0000","last_fullsized":"2024-09-10T05:59:01.814898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":232,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814807+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:59:01.814807+0000","last_peered":"2024-09-10T05:59:01.814807+0000","last_clean":"2024-09-10T05:59:01.814807+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:59:01.814807+0000","last_undegraded":"2024-09-10T05:59:01.814807+0000","last_fullsized":"2024-09-10T05:59:01.814807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'31","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970197+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:59:01.970197+0000","last_peered":"2024-09-10T05:59:01.970197+0000","last_clean":"2024-09-10T05:59:01.970197+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:59:01.970197+0000","last_undegraded":"2024-09-10T05:59:01.970197+0000","last_fullsized":"2024-09-10T05:59:01.970197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972249+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:59:01.972249+0000","last_peered":"2024-09-10T05:59:01.972249+0000","last_clean":"2024-09-10T05:59:01.972249+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:59:01.972249+0000","last_undegraded":"2024-09-10T05:59:01.972249+0000","last_fullsized":"2024-09-10T05:59:01.972249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973885+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:59:01.973885+0000","last_peered":"2024-09-10T05:59:01.973885+0000","last_clean":"2024-09-10T05:59:01.973885+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:59:01.973885+0000","last_undegraded":"2024-09-10T05:59:01.973885+0000","last_fullsized":"2024-09-10T05:59:01.973885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968759+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:59:01.968759+0000","last_peered":"2024-09-10T05:59:01.968759+0000","last_clean":"2024-09-10T05:59:01.968759+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:59:01.968759+0000","last_undegraded":"2024-09-10T05:59:01.968759+0000","last_fullsized":"2024-09-10T05:59:01.968759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"131'135","reported_seq":386,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972261+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:59:01.972261+0000","last_peered":"2024-09-10T05:59:01.972261+0000","last_clean":"2024-09-10T05:59:01.972261+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:59:01.972261+0000","last_undegraded":"2024-09-10T05:59:01.972261+0000","last_fullsized":"2024-09-10T05:59:01.972261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825935+0000","last_change":"2024-09-10T05:58:40.566181+0000","last_active":"2024-09-10T05:59:01.825935+0000","last_peered":"2024-09-10T05:59:01.825935+0000","last_clean":"2024-09-10T05:59:01.825935+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:59:01.825935+0000","last_undegraded":"2024-09-10T05:59:01.825935+0000","last_fullsized":"2024-09-10T05:59:01.825935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.161299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823699+0000","last_change":"2024-09-10T05:58:38.725304+0000","last_active":"2024-09-10T05:59:01.823699+0000","last_peered":"2024-09-10T05:59:01.823699+0000","last_clean":"2024-09-10T05:59:01.823699+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:59:01.823699+0000","last_undegraded":"2024-09-10T05:59:01.823699+0000","last_fullsized":"2024-09-10T05:59:01.823699+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:37.191390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826198+0000","last_change":"2024-09-10T05:58:41.098579+0000","last_active":"2024-09-10T05:59:01.826198+0000","last_peered":"2024-09-10T05:59:01.826198+0000","last_clean":"2024-09-10T05:59:01.826198+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:59:01.826198+0000","last_undegraded":"2024-09-10T05:59:01.826198+0000","last_fullsized":"2024-09-10T05:59:01.826198+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:26.154411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971162+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:59:01.971162+0000","last_peered":"2024-09-10T05:59:01.971162+0000","last_clean":"2024-09-10T05:59:01.971162+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:59:01.971162+0000","last_undegraded":"2024-09-10T05:59:01.971162+0000","last_fullsized":"2024-09-10T05:59:01.971162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812454+0000","last_change":"2024-09-10T05:58:36.065339+0000","last_active":"2024-09-10T05:59:01.812454+0000","last_peered":"2024-09-10T05:59:01.812454+0000","last_clean":"2024-09-10T05:59:01.812454+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:59:01.812454+0000","last_undegraded":"2024-09-10T05:59:01.812454+0000","last_fullsized":"2024-09-10T05:59:01.812454+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:58.311550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813201+0000","last_change":"2024-09-10T05:58:39.400842+0000","last_active":"2024-09-10T05:59:01.813201+0000","last_peered":"2024-09-10T05:59:01.813201+0000","last_clean":"2024-09-10T05:59:01.813201+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:59:01.813201+0000","last_undegraded":"2024-09-10T05:59:01.813201+0000","last_fullsized":"2024-09-10T05:59:01.813201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:57.886787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"131'142","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826043+0000","last_change":"2024-09-10T05:58:42.102476+0000","last_active":"2024-09-10T05:59:01.826043+0000","last_peered":"2024-09-10T05:59:01.826043+0000","last_clean":"2024-09-10T05:59:01.826043+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:59:01.826043+0000","last_undegraded":"2024-09-10T05:59:01.826043+0000","last_fullsized":"2024-09-10T05:59:01.826043+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:33.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814423+0000","last_change":"2024-09-10T05:58:36.071317+0000","last_active":"2024-09-10T05:59:01.814423+0000","last_peered":"2024-09-10T05:59:01.814423+0000","last_clean":"2024-09-10T05:59:01.814423+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:59:01.814423+0000","last_undegraded":"2024-09-10T05:59:01.814423+0000","last_fullsized":"2024-09-10T05:59:01.814423+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:36.078639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812728+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:59:01.812728+0000","last_peered":"2024-09-10T05:59:01.812728+0000","last_clean":"2024-09-10T05:59:01.812728+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:59:01.812728+0000","last_undegraded":"2024-09-10T05:59:01.812728+0000","last_fullsized":"2024-09-10T05:59:01.812728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'21","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816229+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:59:01.816229+0000","last_peered":"2024-09-10T05:59:01.816229+0000","last_clean":"2024-09-10T05:59:01.816229+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:59:01.816229+0000","last_undegraded":"2024-09-10T05:59:01.816229+0000","last_fullsized":"2024-09-10T05:59:01.816229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979439+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:59:01.979439+0000","last_peered":"2024-09-10T05:59:01.979439+0000","last_clean":"2024-09-10T05:59:01.979439+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:59:01.979439+0000","last_undegraded":"2024-09-10T05:59:01.979439+0000","last_fullsized":"2024-09-10T05:59:01.979439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824622+0000","last_change":"2024-09-10T05:58:36.083175+0000","last_active":"2024-09-10T05:59:01.824622+0000","last_peered":"2024-09-10T05:59:01.824622+0000","last_clean":"2024-09-10T05:59:01.824622+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:59:01.824622+0000","last_undegraded":"2024-09-10T05:59:01.824622+0000","last_fullsized":"2024-09-10T05:59:01.824622+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:50.357709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"111'50","reported_seq":289,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969479+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:59:01.969479+0000","last_peered":"2024-09-10T05:59:01.969479+0000","last_clean":"2024-09-10T05:59:01.969479+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:59:01.969479+0000","last_undegraded":"2024-09-10T05:59:01.969479+0000","last_fullsized":"2024-09-10T05:59:01.969479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823349+0000","last_change":"2024-09-10T05:58:36.068927+0000","last_active":"2024-09-10T05:59:01.823349+0000","last_peered":"2024-09-10T05:59:01.823349+0000","last_clean":"2024-09-10T05:59:01.823349+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:59:01.823349+0000","last_undegraded":"2024-09-10T05:59:01.823349+0000","last_fullsized":"2024-09-10T05:59:01.823349+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:34.118740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972639+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:59:01.972639+0000","last_peered":"2024-09-10T05:59:01.972639+0000","last_clean":"2024-09-10T05:59:01.972639+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:59:01.972639+0000","last_undegraded":"2024-09-10T05:59:01.972639+0000","last_fullsized":"2024-09-10T05:59:01.972639+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815536+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:59:01.815536+0000","last_peered":"2024-09-10T05:59:01.815536+0000","last_clean":"2024-09-10T05:59:01.815536+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:59:01.815536+0000","last_undegraded":"2024-09-10T05:59:01.815536+0000","last_fullsized":"2024-09-10T05:59:01.815536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813747+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:59:01.813747+0000","last_peered":"2024-09-10T05:59:01.813747+0000","last_clean":"2024-09-10T05:59:01.813747+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:59:01.813747+0000","last_undegraded":"2024-09-10T05:59:01.813747+0000","last_fullsized":"2024-09-10T05:59:01.813747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'26","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813964+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:59:01.813964+0000","last_peered":"2024-09-10T05:59:01.813964+0000","last_clean":"2024-09-10T05:59:01.813964+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:59:01.813964+0000","last_undegraded":"2024-09-10T05:59:01.813964+0000","last_fullsized":"2024-09-10T05:59:01.813964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969521+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:59:01.969521+0000","last_peered":"2024-09-10T05:59:01.969521+0000","last_clean":"2024-09-10T05:59:01.969521+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:59:01.969521+0000","last_undegraded":"2024-09-10T05:59:01.969521+0000","last_fullsized":"2024-09-10T05:59:01.969521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"111'26","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823152+0000","last_change":"2024-09-10T05:58:36.101085+0000","last_active":"2024-09-10T05:59:01.823152+0000","last_peered":"2024-09-10T05:59:01.823152+0000","last_clean":"2024-09-10T05:59:01.823152+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:59:01.823152+0000","last_undegraded":"2024-09-10T05:59:01.823152+0000","last_fullsized":"2024-09-10T05:59:01.823152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:36.463324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822640+0000","last_change":"2024-09-10T05:58:36.083554+0000","last_active":"2024-09-10T05:59:01.822640+0000","last_peered":"2024-09-10T05:59:01.822640+0000","last_clean":"2024-09-10T05:59:01.822640+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:59:01.822640+0000","last_undegraded":"2024-09-10T05:59:01.822640+0000","last_fullsized":"2024-09-10T05:59:01.822640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:47.211919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825582+0000","last_change":"2024-09-10T05:58:36.106761+0000","last_active":"2024-09-10T05:59:01.825582+0000","last_peered":"2024-09-10T05:59:01.825582+0000","last_clean":"2024-09-10T05:59:01.825582+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:59:01.825582+0000","last_undegraded":"2024-09-10T05:59:01.825582+0000","last_fullsized":"2024-09-10T05:59:01.825582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:44.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969400+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:59:01.969400+0000","last_peered":"2024-09-10T05:59:01.969400+0000","last_clean":"2024-09-10T05:59:01.969400+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:59:01.969400+0000","last_undegraded":"2024-09-10T05:59:01.969400+0000","last_fullsized":"2024-09-10T05:59:01.969400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'25","reported_seq":341,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971105+0000","last_change":"2024-09-10T05:58:36.704691+0000","last_active":"2024-09-10T05:59:01.971105+0000","last_peered":"2024-09-10T05:59:01.971105+0000","last_clean":"2024-09-10T05:59:01.971105+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:59:01.971105+0000","last_undegraded":"2024-09-10T05:59:01.971105+0000","last_fullsized":"2024-09-10T05:59:01.971105+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:15.480906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825072+0000","last_change":"2024-09-10T05:58:36.087688+0000","last_active":"2024-09-10T05:59:01.825072+0000","last_peered":"2024-09-10T05:59:01.825072+0000","last_clean":"2024-09-10T05:59:01.825072+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:59:01.825072+0000","last_undegraded":"2024-09-10T05:59:01.825072+0000","last_fullsized":"2024-09-10T05:59:01.825072+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:11.802961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'10","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812168+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:59:01.812168+0000","last_peered":"2024-09-10T05:59:01.812168+0000","last_clean":"2024-09-10T05:59:01.812168+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:59:01.812168+0000","last_undegraded":"2024-09-10T05:59:01.812168+0000","last_fullsized":"2024-09-10T05:59:01.812168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969302+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:59:01.969302+0000","last_peered":"2024-09-10T05:59:01.969302+0000","last_clean":"2024-09-10T05:59:01.969302+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:59:01.969302+0000","last_undegraded":"2024-09-10T05:59:01.969302+0000","last_fullsized":"2024-09-10T05:59:01.969302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814579+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:59:01.814579+0000","last_peered":"2024-09-10T05:59:01.814579+0000","last_clean":"2024-09-10T05:59:01.814579+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:59:01.814579+0000","last_undegraded":"2024-09-10T05:59:01.814579+0000","last_fullsized":"2024-09-10T05:59:01.814579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822857+0000","last_change":"2024-09-10T05:58:36.104832+0000","last_active":"2024-09-10T05:59:01.822857+0000","last_peered":"2024-09-10T05:59:01.822857+0000","last_clean":"2024-09-10T05:59:01.822857+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:59:01.822857+0000","last_undegraded":"2024-09-10T05:59:01.822857+0000","last_fullsized":"2024-09-10T05:59:01.822857+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:15.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976784+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:59:01.976784+0000","last_peered":"2024-09-10T05:59:01.976784+0000","last_clean":"2024-09-10T05:59:01.976784+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:59:01.976784+0000","last_undegraded":"2024-09-10T05:59:01.976784+0000","last_fullsized":"2024-09-10T05:59:01.976784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968619+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:59:01.968619+0000","last_peered":"2024-09-10T05:59:01.968619+0000","last_clean":"2024-09-10T05:59:01.968619+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:59:01.968619+0000","last_undegraded":"2024-09-10T05:59:01.968619+0000","last_fullsized":"2024-09-10T05:59:01.968619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"111'21","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825309+0000","last_change":"2024-09-10T05:58:41.135121+0000","last_active":"2024-09-10T05:59:01.825309+0000","last_peered":"2024-09-10T05:59:01.825309+0000","last_clean":"2024-09-10T05:59:01.825309+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:59:01.825309+0000","last_undegraded":"2024-09-10T05:59:01.825309+0000","last_fullsized":"2024-09-10T05:59:01.825309+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:59.259766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973584+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:59:01.973584+0000","last_peered":"2024-09-10T05:59:01.973584+0000","last_clean":"2024-09-10T05:59:01.973584+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:59:01.973584+0000","last_undegraded":"2024-09-10T05:59:01.973584+0000","last_fullsized":"2024-09-10T05:59:01.973584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974783+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:59:01.974783+0000","last_peered":"2024-09-10T05:59:01.974783+0000","last_clean":"2024-09-10T05:59:01.974783+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:59:01.974783+0000","last_undegraded":"2024-09-10T05:59:01.974783+0000","last_fullsized":"2024-09-10T05:59:01.974783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822940+0000","last_change":"2024-09-10T05:58:41.614433+0000","last_active":"2024-09-10T05:59:01.822940+0000","last_peered":"2024-09-10T05:59:01.822940+0000","last_clean":"2024-09-10T05:59:01.822940+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:59:01.822940+0000","last_undegraded":"2024-09-10T05:59:01.822940+0000","last_fullsized":"2024-09-10T05:59:01.822940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:59.859364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'30","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816052+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:59:01.816052+0000","last_peered":"2024-09-10T05:59:01.816052+0000","last_clean":"2024-09-10T05:59:01.816052+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:59:01.816052+0000","last_undegraded":"2024-09-10T05:59:01.816052+0000","last_fullsized":"2024-09-10T05:59:01.816052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978080+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:59:01.978080+0000","last_peered":"2024-09-10T05:59:01.978080+0000","last_clean":"2024-09-10T05:59:01.978080+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:59:01.978080+0000","last_undegraded":"2024-09-10T05:59:01.978080+0000","last_fullsized":"2024-09-10T05:59:01.978080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"111'17","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969261+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:59:01.969261+0000","last_peered":"2024-09-10T05:59:01.969261+0000","last_clean":"2024-09-10T05:59:01.969261+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:59:01.969261+0000","last_undegraded":"2024-09-10T05:59:01.969261+0000","last_fullsized":"2024-09-10T05:59:01.969261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813668+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:59:01.813668+0000","last_peered":"2024-09-10T05:59:01.813668+0000","last_clean":"2024-09-10T05:59:01.813668+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:59:01.813668+0000","last_undegraded":"2024-09-10T05:59:01.813668+0000","last_fullsized":"2024-09-10T05:59:01.813668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979090+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:59:01.979090+0000","last_peered":"2024-09-10T05:59:01.979090+0000","last_clean":"2024-09-10T05:59:01.979090+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:59:01.979090+0000","last_undegraded":"2024-09-10T05:59:01.979090+0000","last_fullsized":"2024-09-10T05:59:01.979090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":96,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823231+0000","last_change":"2024-09-10T05:58:39.178040+0000","last_active":"2024-09-10T05:59:01.823231+0000","last_peered":"2024-09-10T05:59:01.823231+0000","last_clean":"2024-09-10T05:59:01.823231+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:59:01.823231+0000","last_undegraded":"2024-09-10T05:59:01.823231+0000","last_fullsized":"2024-09-10T05:59:01.823231+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:03.677156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815572+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:59:01.815572+0000","last_peered":"2024-09-10T05:59:01.815572+0000","last_clean":"2024-09-10T05:59:01.815572+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:59:01.815572+0000","last_undegraded":"2024-09-10T05:59:01.815572+0000","last_fullsized":"2024-09-10T05:59:01.815572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"111'38","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970364+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:59:01.970364+0000","last_peered":"2024-09-10T05:59:01.970364+0000","last_clean":"2024-09-10T05:59:01.970364+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:59:01.970364+0000","last_undegraded":"2024-09-10T05:59:01.970364+0000","last_fullsized":"2024-09-10T05:59:01.970364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975447+0000","last_change":"2024-09-10T05:58:36.082148+0000","last_active":"2024-09-10T05:59:01.975447+0000","last_peered":"2024-09-10T05:59:01.975447+0000","last_clean":"2024-09-10T05:59:01.975447+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:59:01.975447+0000","last_undegraded":"2024-09-10T05:59:01.975447+0000","last_fullsized":"2024-09-10T05:59:01.975447+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:32.319630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824811+0000","last_change":"2024-09-10T05:58:36.090193+0000","last_active":"2024-09-10T05:59:01.824811+0000","last_peered":"2024-09-10T05:59:01.824811+0000","last_clean":"2024-09-10T05:59:01.824811+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:59:01.824811+0000","last_undegraded":"2024-09-10T05:59:01.824811+0000","last_fullsized":"2024-09-10T05:59:01.824811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:35.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815817+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:59:01.815817+0000","last_peered":"2024-09-10T05:59:01.815817+0000","last_clean":"2024-09-10T05:59:01.815817+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:59:01.815817+0000","last_undegraded":"2024-09-10T05:59:01.815817+0000","last_fullsized":"2024-09-10T05:59:01.815817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'25","reported_seq":345,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969953+0000","last_change":"2024-09-10T05:58:38.989267+0000","last_active":"2024-09-10T05:59:01.969953+0000","last_peered":"2024-09-10T05:59:01.969953+0000","last_clean":"2024-09-10T05:59:01.969953+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:59:01.969953+0000","last_undegraded":"2024-09-10T05:59:01.969953+0000","last_fullsized":"2024-09-10T05:59:01.969953+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:54.603097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978818+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:59:01.978818+0000","last_peered":"2024-09-10T05:59:01.978818+0000","last_clean":"2024-09-10T05:59:01.978818+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:59:01.978818+0000","last_undegraded":"2024-09-10T05:59:01.978818+0000","last_fullsized":"2024-09-10T05:59:01.978818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969860+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:59:01.969860+0000","last_peered":"2024-09-10T05:59:01.969860+0000","last_clean":"2024-09-10T05:59:01.969860+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:59:01.969860+0000","last_undegraded":"2024-09-10T05:59:01.969860+0000","last_fullsized":"2024-09-10T05:59:01.969860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970684+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:59:01.970684+0000","last_peered":"2024-09-10T05:59:01.970684+0000","last_clean":"2024-09-10T05:59:01.970684+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:59:01.970684+0000","last_undegraded":"2024-09-10T05:59:01.970684+0000","last_fullsized":"2024-09-10T05:59:01.970684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973068+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:59:01.973068+0000","last_peered":"2024-09-10T05:59:01.973068+0000","last_clean":"2024-09-10T05:59:01.973068+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:59:01.973068+0000","last_undegraded":"2024-09-10T05:59:01.973068+0000","last_fullsized":"2024-09-10T05:59:01.973068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824492+0000","last_change":"2024-09-10T05:58:36.755598+0000","last_active":"2024-09-10T05:59:01.824492+0000","last_peered":"2024-09-10T05:59:01.824492+0000","last_clean":"2024-09-10T05:59:01.824492+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:59:01.824492+0000","last_undegraded":"2024-09-10T05:59:01.824492+0000","last_fullsized":"2024-09-10T05:59:01.824492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:58.858812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'19","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813759+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:59:01.813759+0000","last_peered":"2024-09-10T05:59:01.813759+0000","last_clean":"2024-09-10T05:59:01.813759+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:59:01.813759+0000","last_undegraded":"2024-09-10T05:59:01.813759+0000","last_fullsized":"2024-09-10T05:59:01.813759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":348,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814989+0000","last_change":"2024-09-10T05:58:40.731017+0000","last_active":"2024-09-10T05:59:01.814989+0000","last_peered":"2024-09-10T05:59:01.814989+0000","last_clean":"2024-09-10T05:59:01.814989+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:59:01.814989+0000","last_undegraded":"2024-09-10T05:59:01.814989+0000","last_fullsized":"2024-09-10T05:59:01.814989+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:36.888425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"111'28","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825595+0000","last_change":"2024-09-10T05:58:41.114451+0000","last_active":"2024-09-10T05:59:01.825595+0000","last_peered":"2024-09-10T05:59:01.825595+0000","last_clean":"2024-09-10T05:59:01.825595+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:59:01.825595+0000","last_undegraded":"2024-09-10T05:59:01.825595+0000","last_fullsized":"2024-09-10T05:59:01.825595+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:53.586626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62802,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970582+0000","last_change":"2024-09-10T05:58:36.073669+0000","last_active":"2024-09-10T05:59:01.970582+0000","last_peered":"2024-09-10T05:59:01.970582+0000","last_clean":"2024-09-10T05:59:01.970582+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:59:01.970582+0000","last_undegraded":"2024-09-10T05:59:01.970582+0000","last_fullsized":"2024-09-10T05:59:01.970582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.770687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973043+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:59:01.973043+0000","last_peered":"2024-09-10T05:59:01.973043+0000","last_clean":"2024-09-10T05:59:01.973043+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:59:01.973043+0000","last_undegraded":"2024-09-10T05:59:01.973043+0000","last_fullsized":"2024-09-10T05:59:01.973043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818325+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:59:01.818325+0000","last_peered":"2024-09-10T05:59:01.818325+0000","last_clean":"2024-09-10T05:59:01.818325+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:59:01.818325+0000","last_undegraded":"2024-09-10T05:59:01.818325+0000","last_fullsized":"2024-09-10T05:59:01.818325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813863+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:59:01.813863+0000","last_peered":"2024-09-10T05:59:01.813863+0000","last_clean":"2024-09-10T05:59:01.813863+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:59:01.813863+0000","last_undegraded":"2024-09-10T05:59:01.813863+0000","last_fullsized":"2024-09-10T05:59:01.813863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970972+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:59:01.970972+0000","last_peered":"2024-09-10T05:59:01.970972+0000","last_clean":"2024-09-10T05:59:01.970972+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:59:01.970972+0000","last_undegraded":"2024-09-10T05:59:01.970972+0000","last_fullsized":"2024-09-10T05:59:01.970972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814598+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:59:01.814598+0000","last_peered":"2024-09-10T05:59:01.814598+0000","last_clean":"2024-09-10T05:59:01.814598+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:59:01.814598+0000","last_undegraded":"2024-09-10T05:59:01.814598+0000","last_fullsized":"2024-09-10T05:59:01.814598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"131'135","reported_seq":386,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978135+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:59:01.978135+0000","last_peered":"2024-09-10T05:59:01.978135+0000","last_clean":"2024-09-10T05:59:01.978135+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:59:01.978135+0000","last_undegraded":"2024-09-10T05:59:01.978135+0000","last_fullsized":"2024-09-10T05:59:01.978135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968551+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:59:01.968551+0000","last_peered":"2024-09-10T05:59:01.968551+0000","last_clean":"2024-09-10T05:59:01.968551+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:59:01.968551+0000","last_undegraded":"2024-09-10T05:59:01.968551+0000","last_fullsized":"2024-09-10T05:59:01.968551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813457+0000","last_change":"2024-09-10T05:58:40.129243+0000","last_active":"2024-09-10T05:59:01.813457+0000","last_peered":"2024-09-10T05:59:01.813457+0000","last_clean":"2024-09-10T05:59:01.813457+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:59:01.813457+0000","last_undegraded":"2024-09-10T05:59:01.813457+0000","last_fullsized":"2024-09-10T05:59:01.813457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:22.831721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'17","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975868+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:59:01.975868+0000","last_peered":"2024-09-10T05:59:01.975868+0000","last_clean":"2024-09-10T05:59:01.975868+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:59:01.975868+0000","last_undegraded":"2024-09-10T05:59:01.975868+0000","last_fullsized":"2024-09-10T05:59:01.975868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969585+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:59:01.969585+0000","last_peered":"2024-09-10T05:59:01.969585+0000","last_clean":"2024-09-10T05:59:01.969585+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:59:01.969585+0000","last_undegraded":"2024-09-10T05:59:01.969585+0000","last_fullsized":"2024-09-10T05:59:01.969585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"111'48","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973667+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:59:01.973667+0000","last_peered":"2024-09-10T05:59:01.973667+0000","last_clean":"2024-09-10T05:59:01.973667+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:59:01.973667+0000","last_undegraded":"2024-09-10T05:59:01.973667+0000","last_fullsized":"2024-09-10T05:59:01.973667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":64,"num_read_kb":51,"num_write":42,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811526+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:59:01.811526+0000","last_peered":"2024-09-10T05:59:01.811526+0000","last_clean":"2024-09-10T05:59:01.811526+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:59:01.811526+0000","last_undegraded":"2024-09-10T05:59:01.811526+0000","last_fullsized":"2024-09-10T05:59:01.811526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973463+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:59:01.973463+0000","last_peered":"2024-09-10T05:59:01.973463+0000","last_clean":"2024-09-10T05:59:01.973463+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:59:01.973463+0000","last_undegraded":"2024-09-10T05:59:01.973463+0000","last_fullsized":"2024-09-10T05:59:01.973463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":293,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813505+0000","last_change":"2024-09-10T05:58:37.200455+0000","last_active":"2024-09-10T05:59:01.813505+0000","last_peered":"2024-09-10T05:59:01.813505+0000","last_clean":"2024-09-10T05:59:01.813505+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:59:01.813505+0000","last_undegraded":"2024-09-10T05:59:01.813505+0000","last_fullsized":"2024-09-10T05:59:01.813505+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.815795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980118+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:59:01.980118+0000","last_peered":"2024-09-10T05:59:01.980118+0000","last_clean":"2024-09-10T05:59:01.980118+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:59:01.980118+0000","last_undegraded":"2024-09-10T05:59:01.980118+0000","last_fullsized":"2024-09-10T05:59:01.980118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973100+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:59:01.973100+0000","last_peered":"2024-09-10T05:59:01.973100+0000","last_clean":"2024-09-10T05:59:01.973100+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:59:01.973100+0000","last_undegraded":"2024-09-10T05:59:01.973100+0000","last_fullsized":"2024-09-10T05:59:01.973100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"111'23","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811678+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:59:01.811678+0000","last_peered":"2024-09-10T05:59:01.811678+0000","last_clean":"2024-09-10T05:59:01.811678+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:59:01.811678+0000","last_undegraded":"2024-09-10T05:59:01.811678+0000","last_fullsized":"2024-09-10T05:59:01.811678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978365+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:59:01.978365+0000","last_peered":"2024-09-10T05:59:01.978365+0000","last_clean":"2024-09-10T05:59:01.978365+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:59:01.978365+0000","last_undegraded":"2024-09-10T05:59:01.978365+0000","last_fullsized":"2024-09-10T05:59:01.978365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825337+0000","last_change":"2024-09-10T05:58:36.751943+0000","last_active":"2024-09-10T05:59:01.825337+0000","last_peered":"2024-09-10T05:59:01.825337+0000","last_clean":"2024-09-10T05:59:01.825337+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:59:01.825337+0000","last_undegraded":"2024-09-10T05:59:01.825337+0000","last_fullsized":"2024-09-10T05:59:01.825337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:52.279125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823701+0000","last_change":"2024-09-10T05:58:36.760284+0000","last_active":"2024-09-10T05:59:01.823701+0000","last_peered":"2024-09-10T05:59:01.823701+0000","last_clean":"2024-09-10T05:59:01.823701+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:59:01.823701+0000","last_undegraded":"2024-09-10T05:59:01.823701+0000","last_fullsized":"2024-09-10T05:59:01.823701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:27.695656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'30","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824955+0000","last_change":"2024-09-10T05:58:36.748201+0000","last_active":"2024-09-10T05:59:01.824955+0000","last_peered":"2024-09-10T05:59:01.824955+0000","last_clean":"2024-09-10T05:59:01.824955+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:59:01.824955+0000","last_undegraded":"2024-09-10T05:59:01.824955+0000","last_fullsized":"2024-09-10T05:59:01.824955+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.304252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811947+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:59:01.811947+0000","last_peered":"2024-09-10T05:59:01.811947+0000","last_clean":"2024-09-10T05:59:01.811947+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:59:01.811947+0000","last_undegraded":"2024-09-10T05:59:01.811947+0000","last_fullsized":"2024-09-10T05:59:01.811947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"111'19","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823948+0000","last_change":"2024-09-10T05:58:42.032681+0000","last_active":"2024-09-10T05:59:01.823948+0000","last_peered":"2024-09-10T05:59:01.823948+0000","last_clean":"2024-09-10T05:59:01.823948+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:59:01.823948+0000","last_undegraded":"2024-09-10T05:59:01.823948+0000","last_fullsized":"2024-09-10T05:59:01.823948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:11.388502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812414+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:59:01.812414+0000","last_peered":"2024-09-10T05:59:01.812414+0000","last_clean":"2024-09-10T05:59:01.812414+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:59:01.812414+0000","last_undegraded":"2024-09-10T05:59:01.812414+0000","last_fullsized":"2024-09-10T05:59:01.812414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970419+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:59:01.970419+0000","last_peered":"2024-09-10T05:59:01.970419+0000","last_clean":"2024-09-10T05:59:01.970419+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:59:01.970419+0000","last_undegraded":"2024-09-10T05:59:01.970419+0000","last_fullsized":"2024-09-10T05:59:01.970419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812442+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:59:01.812442+0000","last_peered":"2024-09-10T05:59:01.812442+0000","last_clean":"2024-09-10T05:59:01.812442+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:59:01.812442+0000","last_undegraded":"2024-09-10T05:59:01.812442+0000","last_fullsized":"2024-09-10T05:59:01.812442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'25","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817492+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:59:01.817492+0000","last_peered":"2024-09-10T05:59:01.817492+0000","last_clean":"2024-09-10T05:59:01.817492+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:59:01.817492+0000","last_undegraded":"2024-09-10T05:59:01.817492+0000","last_fullsized":"2024-09-10T05:59:01.817492+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968961+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:59:01.968961+0000","last_peered":"2024-09-10T05:59:01.968961+0000","last_clean":"2024-09-10T05:59:01.968961+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:59:01.968961+0000","last_undegraded":"2024-09-10T05:59:01.968961+0000","last_fullsized":"2024-09-10T05:59:01.968961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"111'30","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812862+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:59:01.812862+0000","last_peered":"2024-09-10T05:59:01.812862+0000","last_clean":"2024-09-10T05:59:01.812862+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:59:01.812862+0000","last_undegraded":"2024-09-10T05:59:01.812862+0000","last_fullsized":"2024-09-10T05:59:01.812862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813606+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:59:01.813606+0000","last_peered":"2024-09-10T05:59:01.813606+0000","last_clean":"2024-09-10T05:59:01.813606+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:59:01.813606+0000","last_undegraded":"2024-09-10T05:59:01.813606+0000","last_fullsized":"2024-09-10T05:59:01.813606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815081+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:59:01.815081+0000","last_peered":"2024-09-10T05:59:01.815081+0000","last_clean":"2024-09-10T05:59:01.815081+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:59:01.815081+0000","last_undegraded":"2024-09-10T05:59:01.815081+0000","last_fullsized":"2024-09-10T05:59:01.815081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971172+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:59:01.971172+0000","last_peered":"2024-09-10T05:59:01.971172+0000","last_clean":"2024-09-10T05:59:01.971172+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:59:01.971172+0000","last_undegraded":"2024-09-10T05:59:01.971172+0000","last_fullsized":"2024-09-10T05:59:01.971172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'30","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980571+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:59:01.980571+0000","last_peered":"2024-09-10T05:59:01.980571+0000","last_clean":"2024-09-10T05:59:01.980571+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:59:01.980571+0000","last_undegraded":"2024-09-10T05:59:01.980571+0000","last_fullsized":"2024-09-10T05:59:01.980571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970866+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:59:01.970866+0000","last_peered":"2024-09-10T05:59:01.970866+0000","last_clean":"2024-09-10T05:59:01.970866+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:59:01.970866+0000","last_undegraded":"2024-09-10T05:59:01.970866+0000","last_fullsized":"2024-09-10T05:59:01.970866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816382+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:59:01.816382+0000","last_peered":"2024-09-10T05:59:01.816382+0000","last_clean":"2024-09-10T05:59:01.816382+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:59:01.816382+0000","last_undegraded":"2024-09-10T05:59:01.816382+0000","last_fullsized":"2024-09-10T05:59:01.816382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976396+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:59:01.976396+0000","last_peered":"2024-09-10T05:59:01.976396+0000","last_clean":"2024-09-10T05:59:01.976396+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:59:01.976396+0000","last_undegraded":"2024-09-10T05:59:01.976396+0000","last_fullsized":"2024-09-10T05:59:01.976396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":320,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975064+0000","last_change":"2024-09-10T05:58:37.753575+0000","last_active":"2024-09-10T05:59:01.975064+0000","last_peered":"2024-09-10T05:59:01.975064+0000","last_clean":"2024-09-10T05:59:01.975064+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:59:01.975064+0000","last_undegraded":"2024-09-10T05:59:01.975064+0000","last_fullsized":"2024-09-10T05:59:01.975064+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:21.191915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970245+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:59:01.970245+0000","last_peered":"2024-09-10T05:59:01.970245+0000","last_clean":"2024-09-10T05:59:01.970245+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:59:01.970245+0000","last_undegraded":"2024-09-10T05:59:01.970245+0000","last_fullsized":"2024-09-10T05:59:01.970245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'22","reported_seq":329,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814122+0000","last_change":"2024-09-10T05:58:38.431996+0000","last_active":"2024-09-10T05:59:01.814122+0000","last_peered":"2024-09-10T05:59:01.814122+0000","last_clean":"2024-09-10T05:59:01.814122+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:59:01.814122+0000","last_undegraded":"2024-09-10T05:59:01.814122+0000","last_fullsized":"2024-09-10T05:59:01.814122+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.662612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813281+0000","last_change":"2024-09-10T05:58:40.123148+0000","last_active":"2024-09-10T05:59:01.813281+0000","last_peered":"2024-09-10T05:59:01.813281+0000","last_clean":"2024-09-10T05:59:01.813281+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:59:01.813281+0000","last_undegraded":"2024-09-10T05:59:01.813281+0000","last_fullsized":"2024-09-10T05:59:01.813281+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:28.445530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"111'30","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825927+0000","last_change":"2024-09-10T05:58:37.278065+0000","last_active":"2024-09-10T05:59:01.825927+0000","last_peered":"2024-09-10T05:59:01.825927+0000","last_clean":"2024-09-10T05:59:01.825927+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:59:01.825927+0000","last_undegraded":"2024-09-10T05:59:01.825927+0000","last_fullsized":"2024-09-10T05:59:01.825927+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:23.616575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813671+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:59:01.813671+0000","last_peered":"2024-09-10T05:59:01.813671+0000","last_clean":"2024-09-10T05:59:01.813671+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:59:01.813671+0000","last_undegraded":"2024-09-10T05:59:01.813671+0000","last_fullsized":"2024-09-10T05:59:01.813671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'28","reported_seq":352,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971390+0000","last_change":"2024-09-10T05:58:37.192873+0000","last_active":"2024-09-10T05:59:01.971390+0000","last_peered":"2024-09-10T05:59:01.971390+0000","last_clean":"2024-09-10T05:59:01.971390+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:59:01.971390+0000","last_undegraded":"2024-09-10T05:59:01.971390+0000","last_fullsized":"2024-09-10T05:59:01.971390+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.993383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823416+0000","last_change":"2024-09-10T05:58:36.076255+0000","last_active":"2024-09-10T05:59:01.823416+0000","last_peered":"2024-09-10T05:59:01.823416+0000","last_clean":"2024-09-10T05:59:01.823416+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:59:01.823416+0000","last_undegraded":"2024-09-10T05:59:01.823416+0000","last_fullsized":"2024-09-10T05:59:01.823416+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:20.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'19","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978448+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:59:01.978448+0000","last_peered":"2024-09-10T05:59:01.978448+0000","last_clean":"2024-09-10T05:59:01.978448+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:59:01.978448+0000","last_undegraded":"2024-09-10T05:59:01.978448+0000","last_fullsized":"2024-09-10T05:59:01.978448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980248+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:59:01.980248+0000","last_peered":"2024-09-10T05:59:01.980248+0000","last_clean":"2024-09-10T05:59:01.980248+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:59:01.980248+0000","last_undegraded":"2024-09-10T05:59:01.980248+0000","last_fullsized":"2024-09-10T05:59:01.980248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826148+0000","last_change":"2024-09-10T05:58:40.562955+0000","last_active":"2024-09-10T05:59:01.826148+0000","last_peered":"2024-09-10T05:59:01.826148+0000","last_clean":"2024-09-10T05:59:01.826148+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:59:01.826148+0000","last_undegraded":"2024-09-10T05:59:01.826148+0000","last_fullsized":"2024-09-10T05:59:01.826148+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:55.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815897+0000","last_change":"2024-09-10T05:58:40.787117+0000","last_active":"2024-09-10T05:59:01.815897+0000","last_peered":"2024-09-10T05:59:01.815897+0000","last_clean":"2024-09-10T05:59:01.815897+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:59:01.815897+0000","last_undegraded":"2024-09-10T05:59:01.815897+0000","last_fullsized":"2024-09-10T05:59:01.815897+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:06.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'28","reported_seq":343,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980220+0000","last_change":"2024-09-10T05:58:40.117727+0000","last_active":"2024-09-10T05:59:01.980220+0000","last_peered":"2024-09-10T05:59:01.980220+0000","last_clean":"2024-09-10T05:59:01.980220+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:59:01.980220+0000","last_undegraded":"2024-09-10T05:59:01.980220+0000","last_fullsized":"2024-09-10T05:59:01.980220+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:28.251854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814850+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:59:01.814850+0000","last_peered":"2024-09-10T05:59:01.814850+0000","last_clean":"2024-09-10T05:59:01.814850+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:59:01.814850+0000","last_undegraded":"2024-09-10T05:59:01.814850+0000","last_fullsized":"2024-09-10T05:59:01.814850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'21","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823684+0000","last_change":"2024-09-10T05:58:40.171208+0000","last_active":"2024-09-10T05:59:01.823684+0000","last_peered":"2024-09-10T05:59:01.823684+0000","last_clean":"2024-09-10T05:59:01.823684+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:59:01.823684+0000","last_undegraded":"2024-09-10T05:59:01.823684+0000","last_fullsized":"2024-09-10T05:59:01.823684+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:43.370109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":223,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817504+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:59:01.817504+0000","last_peered":"2024-09-10T05:59:01.817504+0000","last_clean":"2024-09-10T05:59:01.817504+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:59:01.817504+0000","last_undegraded":"2024-09-10T05:59:01.817504+0000","last_fullsized":"2024-09-10T05:59:01.817504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'33","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974919+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:59:01.974919+0000","last_peered":"2024-09-10T05:59:01.974919+0000","last_clean":"2024-09-10T05:59:01.974919+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:59:01.974919+0000","last_undegraded":"2024-09-10T05:59:01.974919+0000","last_fullsized":"2024-09-10T05:59:01.974919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814626+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:59:01.814626+0000","last_peered":"2024-09-10T05:59:01.814626+0000","last_clean":"2024-09-10T05:59:01.814626+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:59:01.814626+0000","last_undegraded":"2024-09-10T05:59:01.814626+0000","last_fullsized":"2024-09-10T05:59:01.814626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'18","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814398+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:59:01.814398+0000","last_peered":"2024-09-10T05:59:01.814398+0000","last_clean":"2024-09-10T05:59:01.814398+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:59:01.814398+0000","last_undegraded":"2024-09-10T05:59:01.814398+0000","last_fullsized":"2024-09-10T05:59:01.814398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970326+0000","last_change":"2024-09-10T05:58:38.090502+0000","last_active":"2024-09-10T05:59:01.970326+0000","last_peered":"2024-09-10T05:59:01.970326+0000","last_clean":"2024-09-10T05:59:01.970326+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:59:01.970326+0000","last_undegraded":"2024-09-10T05:59:01.970326+0000","last_fullsized":"2024-09-10T05:59:01.970326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:56.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'21","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976575+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:59:01.976575+0000","last_peered":"2024-09-10T05:59:01.976575+0000","last_clean":"2024-09-10T05:59:01.976575+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:59:01.976575+0000","last_undegraded":"2024-09-10T05:59:01.976575+0000","last_fullsized":"2024-09-10T05:59:01.976575+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812931+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:59:01.812931+0000","last_peered":"2024-09-10T05:59:01.812931+0000","last_clean":"2024-09-10T05:59:01.812931+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:59:01.812931+0000","last_undegraded":"2024-09-10T05:59:01.812931+0000","last_fullsized":"2024-09-10T05:59:01.812931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'24","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971973+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:59:01.971973+0000","last_peered":"2024-09-10T05:59:01.971973+0000","last_clean":"2024-09-10T05:59:01.971973+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:59:01.971973+0000","last_undegraded":"2024-09-10T05:59:01.971973+0000","last_fullsized":"2024-09-10T05:59:01.971973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824020+0000","last_change":"2024-09-10T05:58:36.090342+0000","last_active":"2024-09-10T05:59:01.824020+0000","last_peered":"2024-09-10T05:59:01.824020+0000","last_clean":"2024-09-10T05:59:01.824020+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:59:01.824020+0000","last_undegraded":"2024-09-10T05:59:01.824020+0000","last_fullsized":"2024-09-10T05:59:01.824020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:15.019257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"111'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817922+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:59:01.817922+0000","last_peered":"2024-09-10T05:59:01.817922+0000","last_clean":"2024-09-10T05:59:01.817922+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:59:01.817922+0000","last_undegraded":"2024-09-10T05:59:01.817922+0000","last_fullsized":"2024-09-10T05:59:01.817922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969117+0000","last_change":"2024-09-10T05:58:36.079403+0000","last_active":"2024-09-10T05:59:01.969117+0000","last_peered":"2024-09-10T05:59:01.969117+0000","last_clean":"2024-09-10T05:59:01.969117+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:59:01.969117+0000","last_undegraded":"2024-09-10T05:59:01.969117+0000","last_fullsized":"2024-09-10T05:59:01.969117+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.025854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980775+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:59:01.980775+0000","last_peered":"2024-09-10T05:59:01.980775+0000","last_clean":"2024-09-10T05:59:01.980775+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:59:01.980775+0000","last_undegraded":"2024-09-10T05:59:01.980775+0000","last_fullsized":"2024-09-10T05:59:01.980775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"111'24","reported_seq":159,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816009+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:59:01.816009+0000","last_peered":"2024-09-10T05:59:01.816009+0000","last_clean":"2024-09-10T05:59:01.816009+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:59:01.816009+0000","last_undegraded":"2024-09-10T05:59:01.816009+0000","last_fullsized":"2024-09-10T05:59:01.816009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815803+0000","last_change":"2024-09-10T05:58:40.744836+0000","last_active":"2024-09-10T05:59:01.815803+0000","last_peered":"2024-09-10T05:59:01.815803+0000","last_clean":"2024-09-10T05:59:01.815803+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:59:01.815803+0000","last_undegraded":"2024-09-10T05:59:01.815803+0000","last_fullsized":"2024-09-10T05:59:01.815803+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969764+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:59:01.969764+0000","last_peered":"2024-09-10T05:59:01.969764+0000","last_clean":"2024-09-10T05:59:01.969764+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:59:01.969764+0000","last_undegraded":"2024-09-10T05:59:01.969764+0000","last_fullsized":"2024-09-10T05:59:01.969764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976451+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:59:01.976451+0000","last_peered":"2024-09-10T05:59:01.976451+0000","last_clean":"2024-09-10T05:59:01.976451+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:59:01.976451+0000","last_undegraded":"2024-09-10T05:59:01.976451+0000","last_fullsized":"2024-09-10T05:59:01.976451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1094,"ondisk_log_size":1094,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382933,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1132,"num_read_kb":862,"num_write":655,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1856152,"kb_used_data":1820804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92515688,"statfs":{"total":96636764160,"available":94736064512,"internally_reserved":0,"allocated":1864503296,"data_stored":1863805989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163328,"kb_used_data":1132140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93208512,"statfs":{"total":96636764160,"available":95445516288,"internally_reserved":0,"allocated":1159311360,"data_stored":1158631588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1816876,"kb_used_data":1781528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92554964,"statfs":{"total":96636764160,"available":94776283136,"internally_reserved":0,"allocated":1824284672,"data_stored":1823545904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693872,"kb_used_data":1658520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677968,"statfs":{"total":96636764160,"available":94902239232,"internally_reserved":0,"allocated":1698324480,"data_stored":1697657651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1931348,"kb_used_data":1900160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92440492,"statfs":{"total":96636764160,"available":94659063808,"internally_reserved":0,"allocated":1945763840,"data_stored":1945064387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099892,"kb_used_data":1060380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93271948,"statfs":{"total":96636764160,"available":95510474752,"internally_reserved":0,"allocated":1085829120,"data_stored":1085171131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202624,"kb_used_data":1163112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93169216,"statfs":{"total":96636764160,"available":95405277184,"internally_reserved":0,"allocated":1191026688,"data_stored":1190321339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1841864,"kb_used_data":1802356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92529976,"statfs":{"total":96636764160,"available":94750695424,"internally_reserved":0,"allocated":1845612544,"data_stored":1844931463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1843396608,"data_stored":1843396608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1189085184,"data_stored":1189085184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1084227584,"data_stored":1084227584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1944059904,"data_stored":1944059904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1822425088,"data_stored":1822425088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1157627904,"data_stored":1157627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1862270976,"data_stored":1862270976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":59916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":117427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":177431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:59:09.853 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T05:59:09.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:59:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:59:10.232 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:59:10.243 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-10T05:59:09.736447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819944,"num_objects":1736,"num_object_clones":0,"num_object_copies":3472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1736,"num_whiteouts":0,"num_read":3465,"num_read_kb":3124,"num_write":2963,"num_write_kb":6187124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":853,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4066,"ondisk_log_size":4066,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":531,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12605956,"kb_used_data":12319000,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":742368764,"statfs":{"total":773094113280,"available":760185614336,"internally_reserved":0,"allocated":12614656000,"data_stored":12609129452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.937643"},"pg_stats":[{"pgid":"3.3f","version":"111'22","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972734+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:59:01.972734+0000","last_peered":"2024-09-10T05:59:01.972734+0000","last_clean":"2024-09-10T05:59:01.972734+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:59:01.972734+0000","last_undegraded":"2024-09-10T05:59:01.972734+0000","last_fullsized":"2024-09-10T05:59:01.972734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971871+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:59:01.971871+0000","last_peered":"2024-09-10T05:59:01.971871+0000","last_clean":"2024-09-10T05:59:01.971871+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:59:01.971871+0000","last_undegraded":"2024-09-10T05:59:01.971871+0000","last_fullsized":"2024-09-10T05:59:01.971871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'27","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971064+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:59:01.971064+0000","last_peered":"2024-09-10T05:59:01.971064+0000","last_clean":"2024-09-10T05:59:01.971064+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:59:01.971064+0000","last_undegraded":"2024-09-10T05:59:01.971064+0000","last_fullsized":"2024-09-10T05:59:01.971064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969559+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:59:01.969559+0000","last_peered":"2024-09-10T05:59:01.969559+0000","last_clean":"2024-09-10T05:59:01.969559+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:59:01.969559+0000","last_undegraded":"2024-09-10T05:59:01.969559+0000","last_fullsized":"2024-09-10T05:59:01.969559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'27","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815127+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:59:01.815127+0000","last_peered":"2024-09-10T05:59:01.815127+0000","last_clean":"2024-09-10T05:59:01.815127+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:59:01.815127+0000","last_undegraded":"2024-09-10T05:59:01.815127+0000","last_fullsized":"2024-09-10T05:59:01.815127+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813155+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:59:01.813155+0000","last_peered":"2024-09-10T05:59:01.813155+0000","last_clean":"2024-09-10T05:59:01.813155+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:59:01.813155+0000","last_undegraded":"2024-09-10T05:59:01.813155+0000","last_fullsized":"2024-09-10T05:59:01.813155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"111'21","reported_seq":323,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975785+0000","last_change":"2024-09-10T05:58:40.694618+0000","last_active":"2024-09-10T05:59:01.975785+0000","last_peered":"2024-09-10T05:59:01.975785+0000","last_clean":"2024-09-10T05:59:01.975785+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:59:01.975785+0000","last_undegraded":"2024-09-10T05:59:01.975785+0000","last_fullsized":"2024-09-10T05:59:01.975785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:55.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":310,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813864+0000","last_change":"2024-09-10T05:58:40.726727+0000","last_active":"2024-09-10T05:59:01.813864+0000","last_peered":"2024-09-10T05:59:01.813864+0000","last_clean":"2024-09-10T05:59:01.813864+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:59:01.813864+0000","last_undegraded":"2024-09-10T05:59:01.813864+0000","last_fullsized":"2024-09-10T05:59:01.813864+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:59.972041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"111'29","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969974+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:59:01.969974+0000","last_peered":"2024-09-10T05:59:01.969974+0000","last_clean":"2024-09-10T05:59:01.969974+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:59:01.969974+0000","last_undegraded":"2024-09-10T05:59:01.969974+0000","last_fullsized":"2024-09-10T05:59:01.969974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975880+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:59:01.975880+0000","last_peered":"2024-09-10T05:59:01.975880+0000","last_clean":"2024-09-10T05:59:01.975880+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:59:01.975880+0000","last_undegraded":"2024-09-10T05:59:01.975880+0000","last_fullsized":"2024-09-10T05:59:01.975880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973856+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:59:01.973856+0000","last_peered":"2024-09-10T05:59:01.973856+0000","last_clean":"2024-09-10T05:59:01.973856+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:59:01.973856+0000","last_undegraded":"2024-09-10T05:59:01.973856+0000","last_fullsized":"2024-09-10T05:59:01.973856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814413+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:59:01.814413+0000","last_peered":"2024-09-10T05:59:01.814413+0000","last_clean":"2024-09-10T05:59:01.814413+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:59:01.814413+0000","last_undegraded":"2024-09-10T05:59:01.814413+0000","last_fullsized":"2024-09-10T05:59:01.814413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"111'20","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970430+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:59:01.970430+0000","last_peered":"2024-09-10T05:59:01.970430+0000","last_clean":"2024-09-10T05:59:01.970430+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:59:01.970430+0000","last_undegraded":"2024-09-10T05:59:01.970430+0000","last_fullsized":"2024-09-10T05:59:01.970430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975884+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:59:01.975884+0000","last_peered":"2024-09-10T05:59:01.975884+0000","last_clean":"2024-09-10T05:59:01.975884+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:59:01.975884+0000","last_undegraded":"2024-09-10T05:59:01.975884+0000","last_fullsized":"2024-09-10T05:59:01.975884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'13","reported_seq":72,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822936+0000","last_change":"2024-09-10T05:58:42.015968+0000","last_active":"2024-09-10T05:59:01.822936+0000","last_peered":"2024-09-10T05:59:01.822936+0000","last_clean":"2024-09-10T05:59:01.822936+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:59:01.822936+0000","last_undegraded":"2024-09-10T05:59:01.822936+0000","last_fullsized":"2024-09-10T05:59:01.822936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:22.893621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.986778+0000","last_change":"2024-09-10T05:59:01.986479+0000","last_active":"2024-09-10T05:59:01.986778+0000","last_peered":"2024-09-10T05:59:01.986778+0000","last_clean":"2024-09-10T05:59:01.986778+0000","last_became_active":"2024-09-10T05:59:01.981080+0000","last_became_peered":"2024-09-10T05:59:01.981080+0000","last_unstale":"2024-09-10T05:59:01.986778+0000","last_undegraded":"2024-09-10T05:59:01.986778+0000","last_fullsized":"2024-09-10T05:59:01.986778+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:00.572672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812290+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:59:01.812290+0000","last_peered":"2024-09-10T05:59:01.812290+0000","last_clean":"2024-09-10T05:59:01.812290+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:59:01.812290+0000","last_undegraded":"2024-09-10T05:59:01.812290+0000","last_fullsized":"2024-09-10T05:59:01.812290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"111'19","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972982+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:59:01.972982+0000","last_peered":"2024-09-10T05:59:01.972982+0000","last_clean":"2024-09-10T05:59:01.972982+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:59:01.972982+0000","last_undegraded":"2024-09-10T05:59:01.972982+0000","last_fullsized":"2024-09-10T05:59:01.972982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969838+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:59:01.969838+0000","last_peered":"2024-09-10T05:59:01.969838+0000","last_clean":"2024-09-10T05:59:01.969838+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:59:01.969838+0000","last_undegraded":"2024-09-10T05:59:01.969838+0000","last_fullsized":"2024-09-10T05:59:01.969838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978182+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:59:01.978182+0000","last_peered":"2024-09-10T05:59:01.978182+0000","last_clean":"2024-09-10T05:59:01.978182+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:59:01.978182+0000","last_undegraded":"2024-09-10T05:59:01.978182+0000","last_fullsized":"2024-09-10T05:59:01.978182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974629+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:59:01.974629+0000","last_peered":"2024-09-10T05:59:01.974629+0000","last_clean":"2024-09-10T05:59:01.974629+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:59:01.974629+0000","last_undegraded":"2024-09-10T05:59:01.974629+0000","last_fullsized":"2024-09-10T05:59:01.974629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"111'18","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978095+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:59:01.978095+0000","last_peered":"2024-09-10T05:59:01.978095+0000","last_clean":"2024-09-10T05:59:01.978095+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:59:01.978095+0000","last_undegraded":"2024-09-10T05:59:01.978095+0000","last_fullsized":"2024-09-10T05:59:01.978095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":277,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816892+0000","last_change":"2024-09-10T05:58:39.367642+0000","last_active":"2024-09-10T05:59:01.816892+0000","last_peered":"2024-09-10T05:59:01.816892+0000","last_clean":"2024-09-10T05:59:01.816892+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:59:01.816892+0000","last_undegraded":"2024-09-10T05:59:01.816892+0000","last_fullsized":"2024-09-10T05:59:01.816892+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"111'28","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814125+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:59:01.814125+0000","last_peered":"2024-09-10T05:59:01.814125+0000","last_clean":"2024-09-10T05:59:01.814125+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:59:01.814125+0000","last_undegraded":"2024-09-10T05:59:01.814125+0000","last_fullsized":"2024-09-10T05:59:01.814125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818018+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:59:01.818018+0000","last_peered":"2024-09-10T05:59:01.818018+0000","last_clean":"2024-09-10T05:59:01.818018+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:59:01.818018+0000","last_undegraded":"2024-09-10T05:59:01.818018+0000","last_fullsized":"2024-09-10T05:59:01.818018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824233+0000","last_change":"2024-09-10T05:58:42.304778+0000","last_active":"2024-09-10T05:59:01.824233+0000","last_peered":"2024-09-10T05:59:01.824233+0000","last_clean":"2024-09-10T05:59:01.824233+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:59:01.824233+0000","last_undegraded":"2024-09-10T05:59:01.824233+0000","last_fullsized":"2024-09-10T05:59:01.824233+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:41.747059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814552+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:59:01.814552+0000","last_peered":"2024-09-10T05:59:01.814552+0000","last_clean":"2024-09-10T05:59:01.814552+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:59:01.814552+0000","last_undegraded":"2024-09-10T05:59:01.814552+0000","last_fullsized":"2024-09-10T05:59:01.814552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"111'24","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813423+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:59:01.813423+0000","last_peered":"2024-09-10T05:59:01.813423+0000","last_clean":"2024-09-10T05:59:01.813423+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:59:01.813423+0000","last_undegraded":"2024-09-10T05:59:01.813423+0000","last_fullsized":"2024-09-10T05:59:01.813423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811956+0000","last_change":"2024-09-10T05:58:38.995573+0000","last_active":"2024-09-10T05:59:01.811956+0000","last_peered":"2024-09-10T05:59:01.811956+0000","last_clean":"2024-09-10T05:59:01.811956+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:59:01.811956+0000","last_undegraded":"2024-09-10T05:59:01.811956+0000","last_fullsized":"2024-09-10T05:59:01.811956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":54,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825533+0000","last_change":"2024-09-10T05:58:37.289796+0000","last_active":"2024-09-10T05:59:01.825533+0000","last_peered":"2024-09-10T05:59:01.825533+0000","last_clean":"2024-09-10T05:59:01.825533+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:59:01.825533+0000","last_undegraded":"2024-09-10T05:59:01.825533+0000","last_fullsized":"2024-09-10T05:59:01.825533+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:13.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"111'19","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970418+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:59:01.970418+0000","last_peered":"2024-09-10T05:59:01.970418+0000","last_clean":"2024-09-10T05:59:01.970418+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:59:01.970418+0000","last_undegraded":"2024-09-10T05:59:01.970418+0000","last_fullsized":"2024-09-10T05:59:01.970418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976010+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:59:01.976010+0000","last_peered":"2024-09-10T05:59:01.976010+0000","last_clean":"2024-09-10T05:59:01.976010+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:59:01.976010+0000","last_undegraded":"2024-09-10T05:59:01.976010+0000","last_fullsized":"2024-09-10T05:59:01.976010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"111'30","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815225+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:59:01.815225+0000","last_peered":"2024-09-10T05:59:01.815225+0000","last_clean":"2024-09-10T05:59:01.815225+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:59:01.815225+0000","last_undegraded":"2024-09-10T05:59:01.815225+0000","last_fullsized":"2024-09-10T05:59:01.815225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972175+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:59:01.972175+0000","last_peered":"2024-09-10T05:59:01.972175+0000","last_clean":"2024-09-10T05:59:01.972175+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:59:01.972175+0000","last_undegraded":"2024-09-10T05:59:01.972175+0000","last_fullsized":"2024-09-10T05:59:01.972175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"111'48","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972638+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:59:01.972638+0000","last_peered":"2024-09-10T05:59:01.972638+0000","last_clean":"2024-09-10T05:59:01.972638+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:59:01.972638+0000","last_undegraded":"2024-09-10T05:59:01.972638+0000","last_fullsized":"2024-09-10T05:59:01.972638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980010+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:59:01.980010+0000","last_peered":"2024-09-10T05:59:01.980010+0000","last_clean":"2024-09-10T05:59:01.980010+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:59:01.980010+0000","last_undegraded":"2024-09-10T05:59:01.980010+0000","last_fullsized":"2024-09-10T05:59:01.980010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813555+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:59:01.813555+0000","last_peered":"2024-09-10T05:59:01.813555+0000","last_clean":"2024-09-10T05:59:01.813555+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:59:01.813555+0000","last_undegraded":"2024-09-10T05:59:01.813555+0000","last_fullsized":"2024-09-10T05:59:01.813555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825797+0000","last_change":"2024-09-10T05:58:36.074698+0000","last_active":"2024-09-10T05:59:01.825797+0000","last_peered":"2024-09-10T05:59:01.825797+0000","last_clean":"2024-09-10T05:59:01.825797+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:59:01.825797+0000","last_undegraded":"2024-09-10T05:59:01.825797+0000","last_fullsized":"2024-09-10T05:59:01.825797+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:37.044312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814922+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:59:01.814922+0000","last_peered":"2024-09-10T05:59:01.814922+0000","last_clean":"2024-09-10T05:59:01.814922+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:59:01.814922+0000","last_undegraded":"2024-09-10T05:59:01.814922+0000","last_fullsized":"2024-09-10T05:59:01.814922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814332+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:59:01.814332+0000","last_peered":"2024-09-10T05:59:01.814332+0000","last_clean":"2024-09-10T05:59:01.814332+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:59:01.814332+0000","last_undegraded":"2024-09-10T05:59:01.814332+0000","last_fullsized":"2024-09-10T05:59:01.814332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813141+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:59:01.813141+0000","last_peered":"2024-09-10T05:59:01.813141+0000","last_clean":"2024-09-10T05:59:01.813141+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:59:01.813141+0000","last_undegraded":"2024-09-10T05:59:01.813141+0000","last_fullsized":"2024-09-10T05:59:01.813141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816148+0000","last_change":"2024-09-10T05:58:36.709426+0000","last_active":"2024-09-10T05:59:01.816148+0000","last_peered":"2024-09-10T05:59:01.816148+0000","last_clean":"2024-09-10T05:59:01.816148+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:59:01.816148+0000","last_undegraded":"2024-09-10T05:59:01.816148+0000","last_fullsized":"2024-09-10T05:59:01.816148+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:16.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"111'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970499+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:59:01.970499+0000","last_peered":"2024-09-10T05:59:01.970499+0000","last_clean":"2024-09-10T05:59:01.970499+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:59:01.970499+0000","last_undegraded":"2024-09-10T05:59:01.970499+0000","last_fullsized":"2024-09-10T05:59:01.970499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825597+0000","last_change":"2024-09-10T05:58:36.086954+0000","last_active":"2024-09-10T05:59:01.825597+0000","last_peered":"2024-09-10T05:59:01.825597+0000","last_clean":"2024-09-10T05:59:01.825597+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:59:01.825597+0000","last_undegraded":"2024-09-10T05:59:01.825597+0000","last_fullsized":"2024-09-10T05:59:01.825597+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:57.423283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817459+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:59:01.817459+0000","last_peered":"2024-09-10T05:59:01.817459+0000","last_clean":"2024-09-10T05:59:01.817459+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:59:01.817459+0000","last_undegraded":"2024-09-10T05:59:01.817459+0000","last_fullsized":"2024-09-10T05:59:01.817459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"131'135","reported_seq":388,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969726+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:59:01.969726+0000","last_peered":"2024-09-10T05:59:01.969726+0000","last_clean":"2024-09-10T05:59:01.969726+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:59:01.969726+0000","last_undegraded":"2024-09-10T05:59:01.969726+0000","last_fullsized":"2024-09-10T05:59:01.969726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812887+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:59:01.812887+0000","last_peered":"2024-09-10T05:59:01.812887+0000","last_clean":"2024-09-10T05:59:01.812887+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:59:01.812887+0000","last_undegraded":"2024-09-10T05:59:01.812887+0000","last_fullsized":"2024-09-10T05:59:01.812887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825894+0000","last_change":"2024-09-10T05:58:39.658860+0000","last_active":"2024-09-10T05:59:01.825894+0000","last_peered":"2024-09-10T05:59:01.825894+0000","last_clean":"2024-09-10T05:59:01.825894+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:59:01.825894+0000","last_undegraded":"2024-09-10T05:59:01.825894+0000","last_fullsized":"2024-09-10T05:59:01.825894+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:22.522890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'18","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980852+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:59:01.980852+0000","last_peered":"2024-09-10T05:59:01.980852+0000","last_clean":"2024-09-10T05:59:01.980852+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:59:01.980852+0000","last_undegraded":"2024-09-10T05:59:01.980852+0000","last_fullsized":"2024-09-10T05:59:01.980852+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975529+0000","last_change":"2024-09-10T05:58:36.076514+0000","last_active":"2024-09-10T05:59:01.975529+0000","last_peered":"2024-09-10T05:59:01.975529+0000","last_clean":"2024-09-10T05:59:01.975529+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:59:01.975529+0000","last_undegraded":"2024-09-10T05:59:01.975529+0000","last_fullsized":"2024-09-10T05:59:01.975529+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:58.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"111'23","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970669+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:59:01.970669+0000","last_peered":"2024-09-10T05:59:01.970669+0000","last_clean":"2024-09-10T05:59:01.970669+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:59:01.970669+0000","last_undegraded":"2024-09-10T05:59:01.970669+0000","last_fullsized":"2024-09-10T05:59:01.970669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"131'142","reported_seq":348,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825244+0000","last_change":"2024-09-10T05:58:42.104842+0000","last_active":"2024-09-10T05:59:01.825244+0000","last_peered":"2024-09-10T05:59:01.825244+0000","last_clean":"2024-09-10T05:59:01.825244+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:59:01.825244+0000","last_undegraded":"2024-09-10T05:59:01.825244+0000","last_fullsized":"2024-09-10T05:59:01.825244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:06.712578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980182+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:59:01.980182+0000","last_peered":"2024-09-10T05:59:01.980182+0000","last_clean":"2024-09-10T05:59:01.980182+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:59:01.980182+0000","last_undegraded":"2024-09-10T05:59:01.980182+0000","last_fullsized":"2024-09-10T05:59:01.980182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973225+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:59:01.973225+0000","last_peered":"2024-09-10T05:59:01.973225+0000","last_clean":"2024-09-10T05:59:01.973225+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:59:01.973225+0000","last_undegraded":"2024-09-10T05:59:01.973225+0000","last_fullsized":"2024-09-10T05:59:01.973225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969010+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:59:01.969010+0000","last_peered":"2024-09-10T05:59:01.969010+0000","last_clean":"2024-09-10T05:59:01.969010+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:59:01.969010+0000","last_undegraded":"2024-09-10T05:59:01.969010+0000","last_fullsized":"2024-09-10T05:59:01.969010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"111'35","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973945+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:59:01.973945+0000","last_peered":"2024-09-10T05:59:01.973945+0000","last_clean":"2024-09-10T05:59:01.973945+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:59:01.973945+0000","last_undegraded":"2024-09-10T05:59:01.973945+0000","last_fullsized":"2024-09-10T05:59:01.973945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969386+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:59:01.969386+0000","last_peered":"2024-09-10T05:59:01.969386+0000","last_clean":"2024-09-10T05:59:01.969386+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:59:01.969386+0000","last_undegraded":"2024-09-10T05:59:01.969386+0000","last_fullsized":"2024-09-10T05:59:01.969386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975163+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:59:01.975163+0000","last_peered":"2024-09-10T05:59:01.975163+0000","last_clean":"2024-09-10T05:59:01.975163+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:59:01.975163+0000","last_undegraded":"2024-09-10T05:59:01.975163+0000","last_fullsized":"2024-09-10T05:59:01.975163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812553+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:59:01.812553+0000","last_peered":"2024-09-10T05:59:01.812553+0000","last_clean":"2024-09-10T05:59:01.812553+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:59:01.812553+0000","last_undegraded":"2024-09-10T05:59:01.812553+0000","last_fullsized":"2024-09-10T05:59:01.812553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"111'21","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972822+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:59:01.972822+0000","last_peered":"2024-09-10T05:59:01.972822+0000","last_clean":"2024-09-10T05:59:01.972822+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:59:01.972822+0000","last_undegraded":"2024-09-10T05:59:01.972822+0000","last_fullsized":"2024-09-10T05:59:01.972822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816319+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:59:01.816319+0000","last_peered":"2024-09-10T05:59:01.816319+0000","last_clean":"2024-09-10T05:59:01.816319+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:59:01.816319+0000","last_undegraded":"2024-09-10T05:59:01.816319+0000","last_fullsized":"2024-09-10T05:59:01.816319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"111'23","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824547+0000","last_change":"2024-09-10T05:58:41.124218+0000","last_active":"2024-09-10T05:59:01.824547+0000","last_peered":"2024-09-10T05:59:01.824547+0000","last_clean":"2024-09-10T05:59:01.824547+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:59:01.824547+0000","last_undegraded":"2024-09-10T05:59:01.824547+0000","last_fullsized":"2024-09-10T05:59:01.824547+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:13.232943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823296+0000","last_change":"2024-09-10T05:58:36.068634+0000","last_active":"2024-09-10T05:59:01.823296+0000","last_peered":"2024-09-10T05:59:01.823296+0000","last_clean":"2024-09-10T05:59:01.823296+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:59:01.823296+0000","last_undegraded":"2024-09-10T05:59:01.823296+0000","last_fullsized":"2024-09-10T05:59:01.823296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:54.848895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977060+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:59:01.977060+0000","last_peered":"2024-09-10T05:59:01.977060+0000","last_clean":"2024-09-10T05:59:01.977060+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:59:01.977060+0000","last_undegraded":"2024-09-10T05:59:01.977060+0000","last_fullsized":"2024-09-10T05:59:01.977060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974434+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:59:01.974434+0000","last_peered":"2024-09-10T05:59:01.974434+0000","last_clean":"2024-09-10T05:59:01.974434+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:59:01.974434+0000","last_undegraded":"2024-09-10T05:59:01.974434+0000","last_fullsized":"2024-09-10T05:59:01.974434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"111'23","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971267+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:59:01.971267+0000","last_peered":"2024-09-10T05:59:01.971267+0000","last_clean":"2024-09-10T05:59:01.971267+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:59:01.971267+0000","last_undegraded":"2024-09-10T05:59:01.971267+0000","last_fullsized":"2024-09-10T05:59:01.971267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818189+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:59:01.818189+0000","last_peered":"2024-09-10T05:59:01.818189+0000","last_clean":"2024-09-10T05:59:01.818189+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:59:01.818189+0000","last_undegraded":"2024-09-10T05:59:01.818189+0000","last_fullsized":"2024-09-10T05:59:01.818189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"111'35","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969535+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:59:01.969535+0000","last_peered":"2024-09-10T05:59:01.969535+0000","last_clean":"2024-09-10T05:59:01.969535+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:59:01.969535+0000","last_undegraded":"2024-09-10T05:59:01.969535+0000","last_fullsized":"2024-09-10T05:59:01.969535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"131'135","reported_seq":465,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812578+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:59:01.812578+0000","last_peered":"2024-09-10T05:59:01.812578+0000","last_clean":"2024-09-10T05:59:01.812578+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:59:01.812578+0000","last_undegraded":"2024-09-10T05:59:01.812578+0000","last_fullsized":"2024-09-10T05:59:01.812578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815295+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:59:01.815295+0000","last_peered":"2024-09-10T05:59:01.815295+0000","last_clean":"2024-09-10T05:59:01.815295+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:59:01.815295+0000","last_undegraded":"2024-09-10T05:59:01.815295+0000","last_fullsized":"2024-09-10T05:59:01.815295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814879+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:59:01.814879+0000","last_peered":"2024-09-10T05:59:01.814879+0000","last_clean":"2024-09-10T05:59:01.814879+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:59:01.814879+0000","last_undegraded":"2024-09-10T05:59:01.814879+0000","last_fullsized":"2024-09-10T05:59:01.814879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"111'12","reported_seq":190,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816872+0000","last_change":"2024-09-10T05:58:38.085546+0000","last_active":"2024-09-10T05:59:01.816872+0000","last_peered":"2024-09-10T05:59:01.816872+0000","last_clean":"2024-09-10T05:59:01.816872+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:59:01.816872+0000","last_undegraded":"2024-09-10T05:59:01.816872+0000","last_fullsized":"2024-09-10T05:59:01.816872+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:10.893758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817040+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:59:01.817040+0000","last_peered":"2024-09-10T05:59:01.817040+0000","last_clean":"2024-09-10T05:59:01.817040+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:59:01.817040+0000","last_undegraded":"2024-09-10T05:59:01.817040+0000","last_fullsized":"2024-09-10T05:59:01.817040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"111'40","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813070+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:59:01.813070+0000","last_peered":"2024-09-10T05:59:01.813070+0000","last_clean":"2024-09-10T05:59:01.813070+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:59:01.813070+0000","last_undegraded":"2024-09-10T05:59:01.813070+0000","last_fullsized":"2024-09-10T05:59:01.813070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816028+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:59:01.816028+0000","last_peered":"2024-09-10T05:59:01.816028+0000","last_clean":"2024-09-10T05:59:01.816028+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:59:01.816028+0000","last_undegraded":"2024-09-10T05:59:01.816028+0000","last_fullsized":"2024-09-10T05:59:01.816028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970802+0000","last_change":"2024-09-10T05:58:39.385287+0000","last_active":"2024-09-10T05:59:01.970802+0000","last_peered":"2024-09-10T05:59:01.970802+0000","last_clean":"2024-09-10T05:59:01.970802+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:59:01.970802+0000","last_undegraded":"2024-09-10T05:59:01.970802+0000","last_fullsized":"2024-09-10T05:59:01.970802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:27.225607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814320+0000","last_change":"2024-09-10T05:58:40.751831+0000","last_active":"2024-09-10T05:59:01.814320+0000","last_peered":"2024-09-10T05:59:01.814320+0000","last_clean":"2024-09-10T05:59:01.814320+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:59:01.814320+0000","last_undegraded":"2024-09-10T05:59:01.814320+0000","last_fullsized":"2024-09-10T05:59:01.814320+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:32.405571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"111'27","reported_seq":100,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826184+0000","last_change":"2024-09-10T05:58:38.720733+0000","last_active":"2024-09-10T05:59:01.826184+0000","last_peered":"2024-09-10T05:59:01.826184+0000","last_clean":"2024-09-10T05:59:01.826184+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:59:01.826184+0000","last_undegraded":"2024-09-10T05:59:01.826184+0000","last_fullsized":"2024-09-10T05:59:01.826184+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:07.402320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817160+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:59:01.817160+0000","last_peered":"2024-09-10T05:59:01.817160+0000","last_clean":"2024-09-10T05:59:01.817160+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:59:01.817160+0000","last_undegraded":"2024-09-10T05:59:01.817160+0000","last_fullsized":"2024-09-10T05:59:01.817160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"111'28","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814499+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:59:01.814499+0000","last_peered":"2024-09-10T05:59:01.814499+0000","last_clean":"2024-09-10T05:59:01.814499+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:59:01.814499+0000","last_undegraded":"2024-09-10T05:59:01.814499+0000","last_fullsized":"2024-09-10T05:59:01.814499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":23,"num_write":20,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815733+0000","last_change":"2024-09-10T05:58:36.081028+0000","last_active":"2024-09-10T05:59:01.815733+0000","last_peered":"2024-09-10T05:59:01.815733+0000","last_clean":"2024-09-10T05:59:01.815733+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:59:01.815733+0000","last_undegraded":"2024-09-10T05:59:01.815733+0000","last_fullsized":"2024-09-10T05:59:01.815733+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:17.752342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822644+0000","last_change":"2024-09-10T05:58:42.021549+0000","last_active":"2024-09-10T05:59:01.822644+0000","last_peered":"2024-09-10T05:59:01.822644+0000","last_clean":"2024-09-10T05:59:01.822644+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:59:01.822644+0000","last_undegraded":"2024-09-10T05:59:01.822644+0000","last_fullsized":"2024-09-10T05:59:01.822644+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:23.621053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814696+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:59:01.814696+0000","last_peered":"2024-09-10T05:59:01.814696+0000","last_clean":"2024-09-10T05:59:01.814696+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:59:01.814696+0000","last_undegraded":"2024-09-10T05:59:01.814696+0000","last_fullsized":"2024-09-10T05:59:01.814696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974982+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:59:01.974982+0000","last_peered":"2024-09-10T05:59:01.974982+0000","last_clean":"2024-09-10T05:59:01.974982+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:59:01.974982+0000","last_undegraded":"2024-09-10T05:59:01.974982+0000","last_fullsized":"2024-09-10T05:59:01.974982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969798+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:59:01.969798+0000","last_peered":"2024-09-10T05:59:01.969798+0000","last_clean":"2024-09-10T05:59:01.969798+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:59:01.969798+0000","last_undegraded":"2024-09-10T05:59:01.969798+0000","last_fullsized":"2024-09-10T05:59:01.969798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"111'23","reported_seq":336,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817802+0000","last_change":"2024-09-10T05:58:40.714764+0000","last_active":"2024-09-10T05:59:01.817802+0000","last_peered":"2024-09-10T05:59:01.817802+0000","last_clean":"2024-09-10T05:59:01.817802+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:59:01.817802+0000","last_undegraded":"2024-09-10T05:59:01.817802+0000","last_fullsized":"2024-09-10T05:59:01.817802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:27.289268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"131'135","reported_seq":402,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817330+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:59:01.817330+0000","last_peered":"2024-09-10T05:59:01.817330+0000","last_clean":"2024-09-10T05:59:01.817330+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:59:01.817330+0000","last_undegraded":"2024-09-10T05:59:01.817330+0000","last_fullsized":"2024-09-10T05:59:01.817330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969247+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:59:01.969247+0000","last_peered":"2024-09-10T05:59:01.969247+0000","last_clean":"2024-09-10T05:59:01.969247+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:59:01.969247+0000","last_undegraded":"2024-09-10T05:59:01.969247+0000","last_fullsized":"2024-09-10T05:59:01.969247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815015+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:59:01.815015+0000","last_peered":"2024-09-10T05:59:01.815015+0000","last_clean":"2024-09-10T05:59:01.815015+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:59:01.815015+0000","last_undegraded":"2024-09-10T05:59:01.815015+0000","last_fullsized":"2024-09-10T05:59:01.815015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813269+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:59:01.813269+0000","last_peered":"2024-09-10T05:59:01.813269+0000","last_clean":"2024-09-10T05:59:01.813269+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:59:01.813269+0000","last_undegraded":"2024-09-10T05:59:01.813269+0000","last_fullsized":"2024-09-10T05:59:01.813269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":398,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976555+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:59:01.976555+0000","last_peered":"2024-09-10T05:59:01.976555+0000","last_clean":"2024-09-10T05:59:01.976555+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:59:01.976555+0000","last_undegraded":"2024-09-10T05:59:01.976555+0000","last_fullsized":"2024-09-10T05:59:01.976555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824969+0000","last_change":"2024-09-10T05:58:37.286390+0000","last_active":"2024-09-10T05:59:01.824969+0000","last_peered":"2024-09-10T05:59:01.824969+0000","last_clean":"2024-09-10T05:59:01.824969+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:59:01.824969+0000","last_undegraded":"2024-09-10T05:59:01.824969+0000","last_fullsized":"2024-09-10T05:59:01.824969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:08.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"131'135","reported_seq":434,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977577+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:59:01.977577+0000","last_peered":"2024-09-10T05:59:01.977577+0000","last_clean":"2024-09-10T05:59:01.977577+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:59:01.977577+0000","last_undegraded":"2024-09-10T05:59:01.977577+0000","last_fullsized":"2024-09-10T05:59:01.977577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812864+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:59:01.812864+0000","last_peered":"2024-09-10T05:59:01.812864+0000","last_clean":"2024-09-10T05:59:01.812864+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:59:01.812864+0000","last_undegraded":"2024-09-10T05:59:01.812864+0000","last_fullsized":"2024-09-10T05:59:01.812864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976229+0000","last_change":"2024-09-10T05:58:40.805304+0000","last_active":"2024-09-10T05:59:01.976229+0000","last_peered":"2024-09-10T05:59:01.976229+0000","last_clean":"2024-09-10T05:59:01.976229+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:59:01.976229+0000","last_undegraded":"2024-09-10T05:59:01.976229+0000","last_fullsized":"2024-09-10T05:59:01.976229+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:26.888956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823741+0000","last_change":"2024-09-10T05:58:41.608913+0000","last_active":"2024-09-10T05:59:01.823741+0000","last_peered":"2024-09-10T05:59:01.823741+0000","last_clean":"2024-09-10T05:59:01.823741+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:59:01.823741+0000","last_undegraded":"2024-09-10T05:59:01.823741+0000","last_fullsized":"2024-09-10T05:59:01.823741+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:15.544218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814783+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:59:01.814783+0000","last_peered":"2024-09-10T05:59:01.814783+0000","last_clean":"2024-09-10T05:59:01.814783+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:59:01.814783+0000","last_undegraded":"2024-09-10T05:59:01.814783+0000","last_fullsized":"2024-09-10T05:59:01.814783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"111'25","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975641+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:59:01.975641+0000","last_peered":"2024-09-10T05:59:01.975641+0000","last_clean":"2024-09-10T05:59:01.975641+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:59:01.975641+0000","last_undegraded":"2024-09-10T05:59:01.975641+0000","last_fullsized":"2024-09-10T05:59:01.975641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975062+0000","last_change":"2024-09-10T05:58:36.080814+0000","last_active":"2024-09-10T05:59:01.975062+0000","last_peered":"2024-09-10T05:59:01.975062+0000","last_clean":"2024-09-10T05:59:01.975062+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:59:01.975062+0000","last_undegraded":"2024-09-10T05:59:01.975062+0000","last_fullsized":"2024-09-10T05:59:01.975062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:12.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969254+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:59:01.969254+0000","last_peered":"2024-09-10T05:59:01.969254+0000","last_clean":"2024-09-10T05:59:01.969254+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:59:01.969254+0000","last_undegraded":"2024-09-10T05:59:01.969254+0000","last_fullsized":"2024-09-10T05:59:01.969254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978032+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:59:01.978032+0000","last_peered":"2024-09-10T05:59:01.978032+0000","last_clean":"2024-09-10T05:59:01.978032+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:59:01.978032+0000","last_undegraded":"2024-09-10T05:59:01.978032+0000","last_fullsized":"2024-09-10T05:59:01.978032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969848+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:59:01.969848+0000","last_peered":"2024-09-10T05:59:01.969848+0000","last_clean":"2024-09-10T05:59:01.969848+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:59:01.969848+0000","last_undegraded":"2024-09-10T05:59:01.969848+0000","last_fullsized":"2024-09-10T05:59:01.969848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973650+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:59:01.973650+0000","last_peered":"2024-09-10T05:59:01.973650+0000","last_clean":"2024-09-10T05:59:01.973650+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:59:01.973650+0000","last_undegraded":"2024-09-10T05:59:01.973650+0000","last_fullsized":"2024-09-10T05:59:01.973650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"111'28","reported_seq":102,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822940+0000","last_change":"2024-09-10T05:58:38.110183+0000","last_active":"2024-09-10T05:59:01.822940+0000","last_peered":"2024-09-10T05:59:01.822940+0000","last_clean":"2024-09-10T05:59:01.822940+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:59:01.822940+0000","last_undegraded":"2024-09-10T05:59:01.822940+0000","last_fullsized":"2024-09-10T05:59:01.822940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.156258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970305+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:59:01.970305+0000","last_peered":"2024-09-10T05:59:01.970305+0000","last_clean":"2024-09-10T05:59:01.970305+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:59:01.970305+0000","last_undegraded":"2024-09-10T05:59:01.970305+0000","last_fullsized":"2024-09-10T05:59:01.970305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"111'43","reported_seq":357,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976753+0000","last_change":"2024-09-10T05:58:40.775802+0000","last_active":"2024-09-10T05:59:01.976753+0000","last_peered":"2024-09-10T05:59:01.976753+0000","last_clean":"2024-09-10T05:59:01.976753+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:59:01.976753+0000","last_undegraded":"2024-09-10T05:59:01.976753+0000","last_fullsized":"2024-09-10T05:59:01.976753+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.223922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815484+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:59:01.815484+0000","last_peered":"2024-09-10T05:59:01.815484+0000","last_clean":"2024-09-10T05:59:01.815484+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:59:01.815484+0000","last_undegraded":"2024-09-10T05:59:01.815484+0000","last_fullsized":"2024-09-10T05:59:01.815484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973038+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:59:01.973038+0000","last_peered":"2024-09-10T05:59:01.973038+0000","last_clean":"2024-09-10T05:59:01.973038+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:59:01.973038+0000","last_undegraded":"2024-09-10T05:59:01.973038+0000","last_fullsized":"2024-09-10T05:59:01.973038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815904+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:59:01.815904+0000","last_peered":"2024-09-10T05:59:01.815904+0000","last_clean":"2024-09-10T05:59:01.815904+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:59:01.815904+0000","last_undegraded":"2024-09-10T05:59:01.815904+0000","last_fullsized":"2024-09-10T05:59:01.815904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969288+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:59:01.969288+0000","last_peered":"2024-09-10T05:59:01.969288+0000","last_clean":"2024-09-10T05:59:01.969288+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:59:01.969288+0000","last_undegraded":"2024-09-10T05:59:01.969288+0000","last_fullsized":"2024-09-10T05:59:01.969288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"111'19","reported_seq":246,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813209+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:59:01.813209+0000","last_peered":"2024-09-10T05:59:01.813209+0000","last_clean":"2024-09-10T05:59:01.813209+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:59:01.813209+0000","last_undegraded":"2024-09-10T05:59:01.813209+0000","last_fullsized":"2024-09-10T05:59:01.813209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979956+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:59:01.979956+0000","last_peered":"2024-09-10T05:59:01.979956+0000","last_clean":"2024-09-10T05:59:01.979956+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:59:01.979956+0000","last_undegraded":"2024-09-10T05:59:01.979956+0000","last_fullsized":"2024-09-10T05:59:01.979956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"131'143","reported_seq":466,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969792+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:59:01.969792+0000","last_peered":"2024-09-10T05:59:01.969792+0000","last_clean":"2024-09-10T05:59:01.969792+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:59:01.969792+0000","last_undegraded":"2024-09-10T05:59:01.969792+0000","last_fullsized":"2024-09-10T05:59:01.969792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4900,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":185,"num_read_kb":169,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970038+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:59:01.970038+0000","last_peered":"2024-09-10T05:59:01.970038+0000","last_clean":"2024-09-10T05:59:01.970038+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:59:01.970038+0000","last_undegraded":"2024-09-10T05:59:01.970038+0000","last_fullsized":"2024-09-10T05:59:01.970038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969029+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:59:01.969029+0000","last_peered":"2024-09-10T05:59:01.969029+0000","last_clean":"2024-09-10T05:59:01.969029+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:59:01.969029+0000","last_undegraded":"2024-09-10T05:59:01.969029+0000","last_fullsized":"2024-09-10T05:59:01.969029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971269+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:59:01.971269+0000","last_peered":"2024-09-10T05:59:01.971269+0000","last_clean":"2024-09-10T05:59:01.971269+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:59:01.971269+0000","last_undegraded":"2024-09-10T05:59:01.971269+0000","last_fullsized":"2024-09-10T05:59:01.971269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816763+0000","last_change":"2024-09-10T05:58:36.063964+0000","last_active":"2024-09-10T05:59:01.816763+0000","last_peered":"2024-09-10T05:59:01.816763+0000","last_clean":"2024-09-10T05:59:01.816763+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:59:01.816763+0000","last_undegraded":"2024-09-10T05:59:01.816763+0000","last_fullsized":"2024-09-10T05:59:01.816763+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:53.613158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"111'22","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969020+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:59:01.969020+0000","last_peered":"2024-09-10T05:59:01.969020+0000","last_clean":"2024-09-10T05:59:01.969020+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:59:01.969020+0000","last_undegraded":"2024-09-10T05:59:01.969020+0000","last_fullsized":"2024-09-10T05:59:01.969020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817645+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:59:01.817645+0000","last_peered":"2024-09-10T05:59:01.817645+0000","last_clean":"2024-09-10T05:59:01.817645+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:59:01.817645+0000","last_undegraded":"2024-09-10T05:59:01.817645+0000","last_fullsized":"2024-09-10T05:59:01.817645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"131'16","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970890+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:59:01.970890+0000","last_peered":"2024-09-10T05:59:01.970890+0000","last_clean":"2024-09-10T05:59:01.970890+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:59:01.970890+0000","last_undegraded":"2024-09-10T05:59:01.970890+0000","last_fullsized":"2024-09-10T05:59:01.970890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814189+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:59:01.814189+0000","last_peered":"2024-09-10T05:59:01.814189+0000","last_clean":"2024-09-10T05:59:01.814189+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:59:01.814189+0000","last_undegraded":"2024-09-10T05:59:01.814189+0000","last_fullsized":"2024-09-10T05:59:01.814189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825738+0000","last_change":"2024-09-10T05:58:36.090394+0000","last_active":"2024-09-10T05:59:01.825738+0000","last_peered":"2024-09-10T05:59:01.825738+0000","last_clean":"2024-09-10T05:59:01.825738+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:59:01.825738+0000","last_undegraded":"2024-09-10T05:59:01.825738+0000","last_fullsized":"2024-09-10T05:59:01.825738+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:49.622437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970102+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:59:01.970102+0000","last_peered":"2024-09-10T05:59:01.970102+0000","last_clean":"2024-09-10T05:59:01.970102+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:59:01.970102+0000","last_undegraded":"2024-09-10T05:59:01.970102+0000","last_fullsized":"2024-09-10T05:59:01.970102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975334+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:59:01.975334+0000","last_peered":"2024-09-10T05:59:01.975334+0000","last_clean":"2024-09-10T05:59:01.975334+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:59:01.975334+0000","last_undegraded":"2024-09-10T05:59:01.975334+0000","last_fullsized":"2024-09-10T05:59:01.975334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'35","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814126+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:59:01.814126+0000","last_peered":"2024-09-10T05:59:01.814126+0000","last_clean":"2024-09-10T05:59:01.814126+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:59:01.814126+0000","last_undegraded":"2024-09-10T05:59:01.814126+0000","last_fullsized":"2024-09-10T05:59:01.814126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814731+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:59:01.814731+0000","last_peered":"2024-09-10T05:59:01.814731+0000","last_clean":"2024-09-10T05:59:01.814731+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:59:01.814731+0000","last_undegraded":"2024-09-10T05:59:01.814731+0000","last_fullsized":"2024-09-10T05:59:01.814731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825316+0000","last_change":"2024-09-10T05:58:37.301597+0000","last_active":"2024-09-10T05:59:01.825316+0000","last_peered":"2024-09-10T05:59:01.825316+0000","last_clean":"2024-09-10T05:59:01.825316+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:59:01.825316+0000","last_undegraded":"2024-09-10T05:59:01.825316+0000","last_fullsized":"2024-09-10T05:59:01.825316+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:30.282821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978658+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:59:01.978658+0000","last_peered":"2024-09-10T05:59:01.978658+0000","last_clean":"2024-09-10T05:59:01.978658+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:59:01.978658+0000","last_undegraded":"2024-09-10T05:59:01.978658+0000","last_fullsized":"2024-09-10T05:59:01.978658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971389+0000","last_change":"2024-09-10T05:58:40.735106+0000","last_active":"2024-09-10T05:59:01.971389+0000","last_peered":"2024-09-10T05:59:01.971389+0000","last_clean":"2024-09-10T05:59:01.971389+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:59:01.971389+0000","last_undegraded":"2024-09-10T05:59:01.971389+0000","last_fullsized":"2024-09-10T05:59:01.971389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:08.686783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":197,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816305+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:59:01.816305+0000","last_peered":"2024-09-10T05:59:01.816305+0000","last_clean":"2024-09-10T05:59:01.816305+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:59:01.816305+0000","last_undegraded":"2024-09-10T05:59:01.816305+0000","last_fullsized":"2024-09-10T05:59:01.816305+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"111'25","reported_seq":331,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980506+0000","last_change":"2024-09-10T05:58:39.363982+0000","last_active":"2024-09-10T05:59:01.980506+0000","last_peered":"2024-09-10T05:59:01.980506+0000","last_clean":"2024-09-10T05:59:01.980506+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:59:01.980506+0000","last_undegraded":"2024-09-10T05:59:01.980506+0000","last_fullsized":"2024-09-10T05:59:01.980506+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:12.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970391+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:59:01.970391+0000","last_peered":"2024-09-10T05:59:01.970391+0000","last_clean":"2024-09-10T05:59:01.970391+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:59:01.970391+0000","last_undegraded":"2024-09-10T05:59:01.970391+0000","last_fullsized":"2024-09-10T05:59:01.970391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":309,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814142+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:59:01.814142+0000","last_peered":"2024-09-10T05:59:01.814142+0000","last_clean":"2024-09-10T05:59:01.814142+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:59:01.814142+0000","last_undegraded":"2024-09-10T05:59:01.814142+0000","last_fullsized":"2024-09-10T05:59:01.814142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"111'47","reported_seq":400,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812698+0000","last_change":"2024-09-10T05:58:39.382781+0000","last_active":"2024-09-10T05:59:01.812698+0000","last_peered":"2024-09-10T05:59:01.812698+0000","last_clean":"2024-09-10T05:59:01.812698+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:59:01.812698+0000","last_undegraded":"2024-09-10T05:59:01.812698+0000","last_fullsized":"2024-09-10T05:59:01.812698+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:54.079756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812156+0000","last_change":"2024-09-10T05:58:36.065033+0000","last_active":"2024-09-10T05:59:01.812156+0000","last_peered":"2024-09-10T05:59:01.812156+0000","last_clean":"2024-09-10T05:59:01.812156+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:59:01.812156+0000","last_undegraded":"2024-09-10T05:59:01.812156+0000","last_fullsized":"2024-09-10T05:59:01.812156+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.563276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814898+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:59:01.814898+0000","last_peered":"2024-09-10T05:59:01.814898+0000","last_clean":"2024-09-10T05:59:01.814898+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:59:01.814898+0000","last_undegraded":"2024-09-10T05:59:01.814898+0000","last_fullsized":"2024-09-10T05:59:01.814898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":232,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814807+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:59:01.814807+0000","last_peered":"2024-09-10T05:59:01.814807+0000","last_clean":"2024-09-10T05:59:01.814807+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:59:01.814807+0000","last_undegraded":"2024-09-10T05:59:01.814807+0000","last_fullsized":"2024-09-10T05:59:01.814807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'31","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970197+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:59:01.970197+0000","last_peered":"2024-09-10T05:59:01.970197+0000","last_clean":"2024-09-10T05:59:01.970197+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:59:01.970197+0000","last_undegraded":"2024-09-10T05:59:01.970197+0000","last_fullsized":"2024-09-10T05:59:01.970197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972249+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:59:01.972249+0000","last_peered":"2024-09-10T05:59:01.972249+0000","last_clean":"2024-09-10T05:59:01.972249+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:59:01.972249+0000","last_undegraded":"2024-09-10T05:59:01.972249+0000","last_fullsized":"2024-09-10T05:59:01.972249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973885+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:59:01.973885+0000","last_peered":"2024-09-10T05:59:01.973885+0000","last_clean":"2024-09-10T05:59:01.973885+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:59:01.973885+0000","last_undegraded":"2024-09-10T05:59:01.973885+0000","last_fullsized":"2024-09-10T05:59:01.973885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968759+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:59:01.968759+0000","last_peered":"2024-09-10T05:59:01.968759+0000","last_clean":"2024-09-10T05:59:01.968759+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:59:01.968759+0000","last_undegraded":"2024-09-10T05:59:01.968759+0000","last_fullsized":"2024-09-10T05:59:01.968759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"131'135","reported_seq":386,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972261+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:59:01.972261+0000","last_peered":"2024-09-10T05:59:01.972261+0000","last_clean":"2024-09-10T05:59:01.972261+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:59:01.972261+0000","last_undegraded":"2024-09-10T05:59:01.972261+0000","last_fullsized":"2024-09-10T05:59:01.972261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825935+0000","last_change":"2024-09-10T05:58:40.566181+0000","last_active":"2024-09-10T05:59:01.825935+0000","last_peered":"2024-09-10T05:59:01.825935+0000","last_clean":"2024-09-10T05:59:01.825935+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:59:01.825935+0000","last_undegraded":"2024-09-10T05:59:01.825935+0000","last_fullsized":"2024-09-10T05:59:01.825935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.161299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823699+0000","last_change":"2024-09-10T05:58:38.725304+0000","last_active":"2024-09-10T05:59:01.823699+0000","last_peered":"2024-09-10T05:59:01.823699+0000","last_clean":"2024-09-10T05:59:01.823699+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:59:01.823699+0000","last_undegraded":"2024-09-10T05:59:01.823699+0000","last_fullsized":"2024-09-10T05:59:01.823699+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:37.191390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"111'22","reported_seq":90,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826198+0000","last_change":"2024-09-10T05:58:41.098579+0000","last_active":"2024-09-10T05:59:01.826198+0000","last_peered":"2024-09-10T05:59:01.826198+0000","last_clean":"2024-09-10T05:59:01.826198+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:59:01.826198+0000","last_undegraded":"2024-09-10T05:59:01.826198+0000","last_fullsized":"2024-09-10T05:59:01.826198+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:26.154411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971162+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:59:01.971162+0000","last_peered":"2024-09-10T05:59:01.971162+0000","last_clean":"2024-09-10T05:59:01.971162+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:59:01.971162+0000","last_undegraded":"2024-09-10T05:59:01.971162+0000","last_fullsized":"2024-09-10T05:59:01.971162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812454+0000","last_change":"2024-09-10T05:58:36.065339+0000","last_active":"2024-09-10T05:59:01.812454+0000","last_peered":"2024-09-10T05:59:01.812454+0000","last_clean":"2024-09-10T05:59:01.812454+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:59:01.812454+0000","last_undegraded":"2024-09-10T05:59:01.812454+0000","last_fullsized":"2024-09-10T05:59:01.812454+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:58.311550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813201+0000","last_change":"2024-09-10T05:58:39.400842+0000","last_active":"2024-09-10T05:59:01.813201+0000","last_peered":"2024-09-10T05:59:01.813201+0000","last_clean":"2024-09-10T05:59:01.813201+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:59:01.813201+0000","last_undegraded":"2024-09-10T05:59:01.813201+0000","last_fullsized":"2024-09-10T05:59:01.813201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:57.886787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"131'142","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826043+0000","last_change":"2024-09-10T05:58:42.102476+0000","last_active":"2024-09-10T05:59:01.826043+0000","last_peered":"2024-09-10T05:59:01.826043+0000","last_clean":"2024-09-10T05:59:01.826043+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:59:01.826043+0000","last_undegraded":"2024-09-10T05:59:01.826043+0000","last_fullsized":"2024-09-10T05:59:01.826043+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:33.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814423+0000","last_change":"2024-09-10T05:58:36.071317+0000","last_active":"2024-09-10T05:59:01.814423+0000","last_peered":"2024-09-10T05:59:01.814423+0000","last_clean":"2024-09-10T05:59:01.814423+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:59:01.814423+0000","last_undegraded":"2024-09-10T05:59:01.814423+0000","last_fullsized":"2024-09-10T05:59:01.814423+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:36.078639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812728+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:59:01.812728+0000","last_peered":"2024-09-10T05:59:01.812728+0000","last_clean":"2024-09-10T05:59:01.812728+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:59:01.812728+0000","last_undegraded":"2024-09-10T05:59:01.812728+0000","last_fullsized":"2024-09-10T05:59:01.812728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"111'21","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816229+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:59:01.816229+0000","last_peered":"2024-09-10T05:59:01.816229+0000","last_clean":"2024-09-10T05:59:01.816229+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:59:01.816229+0000","last_undegraded":"2024-09-10T05:59:01.816229+0000","last_fullsized":"2024-09-10T05:59:01.816229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979439+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:59:01.979439+0000","last_peered":"2024-09-10T05:59:01.979439+0000","last_clean":"2024-09-10T05:59:01.979439+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:59:01.979439+0000","last_undegraded":"2024-09-10T05:59:01.979439+0000","last_fullsized":"2024-09-10T05:59:01.979439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824622+0000","last_change":"2024-09-10T05:58:36.083175+0000","last_active":"2024-09-10T05:59:01.824622+0000","last_peered":"2024-09-10T05:59:01.824622+0000","last_clean":"2024-09-10T05:59:01.824622+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:59:01.824622+0000","last_undegraded":"2024-09-10T05:59:01.824622+0000","last_fullsized":"2024-09-10T05:59:01.824622+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:50.357709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"111'50","reported_seq":289,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969479+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:59:01.969479+0000","last_peered":"2024-09-10T05:59:01.969479+0000","last_clean":"2024-09-10T05:59:01.969479+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:59:01.969479+0000","last_undegraded":"2024-09-10T05:59:01.969479+0000","last_fullsized":"2024-09-10T05:59:01.969479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823349+0000","last_change":"2024-09-10T05:58:36.068927+0000","last_active":"2024-09-10T05:59:01.823349+0000","last_peered":"2024-09-10T05:59:01.823349+0000","last_clean":"2024-09-10T05:59:01.823349+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:59:01.823349+0000","last_undegraded":"2024-09-10T05:59:01.823349+0000","last_fullsized":"2024-09-10T05:59:01.823349+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:34.118740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972639+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:59:01.972639+0000","last_peered":"2024-09-10T05:59:01.972639+0000","last_clean":"2024-09-10T05:59:01.972639+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:59:01.972639+0000","last_undegraded":"2024-09-10T05:59:01.972639+0000","last_fullsized":"2024-09-10T05:59:01.972639+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815536+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:59:01.815536+0000","last_peered":"2024-09-10T05:59:01.815536+0000","last_clean":"2024-09-10T05:59:01.815536+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:59:01.815536+0000","last_undegraded":"2024-09-10T05:59:01.815536+0000","last_fullsized":"2024-09-10T05:59:01.815536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813747+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:59:01.813747+0000","last_peered":"2024-09-10T05:59:01.813747+0000","last_clean":"2024-09-10T05:59:01.813747+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:59:01.813747+0000","last_undegraded":"2024-09-10T05:59:01.813747+0000","last_fullsized":"2024-09-10T05:59:01.813747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"111'26","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813964+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:59:01.813964+0000","last_peered":"2024-09-10T05:59:01.813964+0000","last_clean":"2024-09-10T05:59:01.813964+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:59:01.813964+0000","last_undegraded":"2024-09-10T05:59:01.813964+0000","last_fullsized":"2024-09-10T05:59:01.813964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969521+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:59:01.969521+0000","last_peered":"2024-09-10T05:59:01.969521+0000","last_clean":"2024-09-10T05:59:01.969521+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:59:01.969521+0000","last_undegraded":"2024-09-10T05:59:01.969521+0000","last_fullsized":"2024-09-10T05:59:01.969521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"111'26","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823152+0000","last_change":"2024-09-10T05:58:36.101085+0000","last_active":"2024-09-10T05:59:01.823152+0000","last_peered":"2024-09-10T05:59:01.823152+0000","last_clean":"2024-09-10T05:59:01.823152+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:59:01.823152+0000","last_undegraded":"2024-09-10T05:59:01.823152+0000","last_fullsized":"2024-09-10T05:59:01.823152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:36.463324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":20,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822640+0000","last_change":"2024-09-10T05:58:36.083554+0000","last_active":"2024-09-10T05:59:01.822640+0000","last_peered":"2024-09-10T05:59:01.822640+0000","last_clean":"2024-09-10T05:59:01.822640+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:59:01.822640+0000","last_undegraded":"2024-09-10T05:59:01.822640+0000","last_fullsized":"2024-09-10T05:59:01.822640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:47.211919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825582+0000","last_change":"2024-09-10T05:58:36.106761+0000","last_active":"2024-09-10T05:59:01.825582+0000","last_peered":"2024-09-10T05:59:01.825582+0000","last_clean":"2024-09-10T05:59:01.825582+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:59:01.825582+0000","last_undegraded":"2024-09-10T05:59:01.825582+0000","last_fullsized":"2024-09-10T05:59:01.825582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:44.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969400+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:59:01.969400+0000","last_peered":"2024-09-10T05:59:01.969400+0000","last_clean":"2024-09-10T05:59:01.969400+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:59:01.969400+0000","last_undegraded":"2024-09-10T05:59:01.969400+0000","last_fullsized":"2024-09-10T05:59:01.969400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'25","reported_seq":341,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971105+0000","last_change":"2024-09-10T05:58:36.704691+0000","last_active":"2024-09-10T05:59:01.971105+0000","last_peered":"2024-09-10T05:59:01.971105+0000","last_clean":"2024-09-10T05:59:01.971105+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:59:01.971105+0000","last_undegraded":"2024-09-10T05:59:01.971105+0000","last_fullsized":"2024-09-10T05:59:01.971105+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:15.480906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825072+0000","last_change":"2024-09-10T05:58:36.087688+0000","last_active":"2024-09-10T05:59:01.825072+0000","last_peered":"2024-09-10T05:59:01.825072+0000","last_clean":"2024-09-10T05:59:01.825072+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:59:01.825072+0000","last_undegraded":"2024-09-10T05:59:01.825072+0000","last_fullsized":"2024-09-10T05:59:01.825072+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:11.802961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'10","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812168+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:59:01.812168+0000","last_peered":"2024-09-10T05:59:01.812168+0000","last_clean":"2024-09-10T05:59:01.812168+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:59:01.812168+0000","last_undegraded":"2024-09-10T05:59:01.812168+0000","last_fullsized":"2024-09-10T05:59:01.812168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969302+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:59:01.969302+0000","last_peered":"2024-09-10T05:59:01.969302+0000","last_clean":"2024-09-10T05:59:01.969302+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:59:01.969302+0000","last_undegraded":"2024-09-10T05:59:01.969302+0000","last_fullsized":"2024-09-10T05:59:01.969302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814579+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:59:01.814579+0000","last_peered":"2024-09-10T05:59:01.814579+0000","last_clean":"2024-09-10T05:59:01.814579+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:59:01.814579+0000","last_undegraded":"2024-09-10T05:59:01.814579+0000","last_fullsized":"2024-09-10T05:59:01.814579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822857+0000","last_change":"2024-09-10T05:58:36.104832+0000","last_active":"2024-09-10T05:59:01.822857+0000","last_peered":"2024-09-10T05:59:01.822857+0000","last_clean":"2024-09-10T05:59:01.822857+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:59:01.822857+0000","last_undegraded":"2024-09-10T05:59:01.822857+0000","last_fullsized":"2024-09-10T05:59:01.822857+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:15.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976784+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:59:01.976784+0000","last_peered":"2024-09-10T05:59:01.976784+0000","last_clean":"2024-09-10T05:59:01.976784+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:59:01.976784+0000","last_undegraded":"2024-09-10T05:59:01.976784+0000","last_fullsized":"2024-09-10T05:59:01.976784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968619+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:59:01.968619+0000","last_peered":"2024-09-10T05:59:01.968619+0000","last_clean":"2024-09-10T05:59:01.968619+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:59:01.968619+0000","last_undegraded":"2024-09-10T05:59:01.968619+0000","last_fullsized":"2024-09-10T05:59:01.968619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"111'21","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825309+0000","last_change":"2024-09-10T05:58:41.135121+0000","last_active":"2024-09-10T05:59:01.825309+0000","last_peered":"2024-09-10T05:59:01.825309+0000","last_clean":"2024-09-10T05:59:01.825309+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:59:01.825309+0000","last_undegraded":"2024-09-10T05:59:01.825309+0000","last_fullsized":"2024-09-10T05:59:01.825309+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:59.259766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973584+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:59:01.973584+0000","last_peered":"2024-09-10T05:59:01.973584+0000","last_clean":"2024-09-10T05:59:01.973584+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:59:01.973584+0000","last_undegraded":"2024-09-10T05:59:01.973584+0000","last_fullsized":"2024-09-10T05:59:01.973584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974783+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:59:01.974783+0000","last_peered":"2024-09-10T05:59:01.974783+0000","last_clean":"2024-09-10T05:59:01.974783+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:59:01.974783+0000","last_undegraded":"2024-09-10T05:59:01.974783+0000","last_fullsized":"2024-09-10T05:59:01.974783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822940+0000","last_change":"2024-09-10T05:58:41.614433+0000","last_active":"2024-09-10T05:59:01.822940+0000","last_peered":"2024-09-10T05:59:01.822940+0000","last_clean":"2024-09-10T05:59:01.822940+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:59:01.822940+0000","last_undegraded":"2024-09-10T05:59:01.822940+0000","last_fullsized":"2024-09-10T05:59:01.822940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:59.859364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'30","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816052+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:59:01.816052+0000","last_peered":"2024-09-10T05:59:01.816052+0000","last_clean":"2024-09-10T05:59:01.816052+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:59:01.816052+0000","last_undegraded":"2024-09-10T05:59:01.816052+0000","last_fullsized":"2024-09-10T05:59:01.816052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978080+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:59:01.978080+0000","last_peered":"2024-09-10T05:59:01.978080+0000","last_clean":"2024-09-10T05:59:01.978080+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:59:01.978080+0000","last_undegraded":"2024-09-10T05:59:01.978080+0000","last_fullsized":"2024-09-10T05:59:01.978080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"111'17","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969261+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:59:01.969261+0000","last_peered":"2024-09-10T05:59:01.969261+0000","last_clean":"2024-09-10T05:59:01.969261+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:59:01.969261+0000","last_undegraded":"2024-09-10T05:59:01.969261+0000","last_fullsized":"2024-09-10T05:59:01.969261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813668+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:59:01.813668+0000","last_peered":"2024-09-10T05:59:01.813668+0000","last_clean":"2024-09-10T05:59:01.813668+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:59:01.813668+0000","last_undegraded":"2024-09-10T05:59:01.813668+0000","last_fullsized":"2024-09-10T05:59:01.813668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979090+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:59:01.979090+0000","last_peered":"2024-09-10T05:59:01.979090+0000","last_clean":"2024-09-10T05:59:01.979090+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:59:01.979090+0000","last_undegraded":"2024-09-10T05:59:01.979090+0000","last_fullsized":"2024-09-10T05:59:01.979090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'25","reported_seq":96,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823231+0000","last_change":"2024-09-10T05:58:39.178040+0000","last_active":"2024-09-10T05:59:01.823231+0000","last_peered":"2024-09-10T05:59:01.823231+0000","last_clean":"2024-09-10T05:59:01.823231+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:59:01.823231+0000","last_undegraded":"2024-09-10T05:59:01.823231+0000","last_fullsized":"2024-09-10T05:59:01.823231+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:03.677156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815572+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:59:01.815572+0000","last_peered":"2024-09-10T05:59:01.815572+0000","last_clean":"2024-09-10T05:59:01.815572+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:59:01.815572+0000","last_undegraded":"2024-09-10T05:59:01.815572+0000","last_fullsized":"2024-09-10T05:59:01.815572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"111'38","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970364+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:59:01.970364+0000","last_peered":"2024-09-10T05:59:01.970364+0000","last_clean":"2024-09-10T05:59:01.970364+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:59:01.970364+0000","last_undegraded":"2024-09-10T05:59:01.970364+0000","last_fullsized":"2024-09-10T05:59:01.970364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":26,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975447+0000","last_change":"2024-09-10T05:58:36.082148+0000","last_active":"2024-09-10T05:59:01.975447+0000","last_peered":"2024-09-10T05:59:01.975447+0000","last_clean":"2024-09-10T05:59:01.975447+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:59:01.975447+0000","last_undegraded":"2024-09-10T05:59:01.975447+0000","last_fullsized":"2024-09-10T05:59:01.975447+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:32.319630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824811+0000","last_change":"2024-09-10T05:58:36.090193+0000","last_active":"2024-09-10T05:59:01.824811+0000","last_peered":"2024-09-10T05:59:01.824811+0000","last_clean":"2024-09-10T05:59:01.824811+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:59:01.824811+0000","last_undegraded":"2024-09-10T05:59:01.824811+0000","last_fullsized":"2024-09-10T05:59:01.824811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:35.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815817+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:59:01.815817+0000","last_peered":"2024-09-10T05:59:01.815817+0000","last_clean":"2024-09-10T05:59:01.815817+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:59:01.815817+0000","last_undegraded":"2024-09-10T05:59:01.815817+0000","last_fullsized":"2024-09-10T05:59:01.815817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'25","reported_seq":345,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969953+0000","last_change":"2024-09-10T05:58:38.989267+0000","last_active":"2024-09-10T05:59:01.969953+0000","last_peered":"2024-09-10T05:59:01.969953+0000","last_clean":"2024-09-10T05:59:01.969953+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:59:01.969953+0000","last_undegraded":"2024-09-10T05:59:01.969953+0000","last_fullsized":"2024-09-10T05:59:01.969953+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:54.603097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978818+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:59:01.978818+0000","last_peered":"2024-09-10T05:59:01.978818+0000","last_clean":"2024-09-10T05:59:01.978818+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:59:01.978818+0000","last_undegraded":"2024-09-10T05:59:01.978818+0000","last_fullsized":"2024-09-10T05:59:01.978818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969860+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:59:01.969860+0000","last_peered":"2024-09-10T05:59:01.969860+0000","last_clean":"2024-09-10T05:59:01.969860+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:59:01.969860+0000","last_undegraded":"2024-09-10T05:59:01.969860+0000","last_fullsized":"2024-09-10T05:59:01.969860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970684+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:59:01.970684+0000","last_peered":"2024-09-10T05:59:01.970684+0000","last_clean":"2024-09-10T05:59:01.970684+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:59:01.970684+0000","last_undegraded":"2024-09-10T05:59:01.970684+0000","last_fullsized":"2024-09-10T05:59:01.970684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973068+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:59:01.973068+0000","last_peered":"2024-09-10T05:59:01.973068+0000","last_clean":"2024-09-10T05:59:01.973068+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:59:01.973068+0000","last_undegraded":"2024-09-10T05:59:01.973068+0000","last_fullsized":"2024-09-10T05:59:01.973068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824492+0000","last_change":"2024-09-10T05:58:36.755598+0000","last_active":"2024-09-10T05:59:01.824492+0000","last_peered":"2024-09-10T05:59:01.824492+0000","last_clean":"2024-09-10T05:59:01.824492+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:59:01.824492+0000","last_undegraded":"2024-09-10T05:59:01.824492+0000","last_fullsized":"2024-09-10T05:59:01.824492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:58.858812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'19","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813759+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:59:01.813759+0000","last_peered":"2024-09-10T05:59:01.813759+0000","last_clean":"2024-09-10T05:59:01.813759+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:59:01.813759+0000","last_undegraded":"2024-09-10T05:59:01.813759+0000","last_fullsized":"2024-09-10T05:59:01.813759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":348,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814989+0000","last_change":"2024-09-10T05:58:40.731017+0000","last_active":"2024-09-10T05:59:01.814989+0000","last_peered":"2024-09-10T05:59:01.814989+0000","last_clean":"2024-09-10T05:59:01.814989+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:59:01.814989+0000","last_undegraded":"2024-09-10T05:59:01.814989+0000","last_fullsized":"2024-09-10T05:59:01.814989+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:36.888425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"111'28","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825595+0000","last_change":"2024-09-10T05:58:41.114451+0000","last_active":"2024-09-10T05:59:01.825595+0000","last_peered":"2024-09-10T05:59:01.825595+0000","last_clean":"2024-09-10T05:59:01.825595+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:59:01.825595+0000","last_undegraded":"2024-09-10T05:59:01.825595+0000","last_fullsized":"2024-09-10T05:59:01.825595+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:53.586626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62802,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970582+0000","last_change":"2024-09-10T05:58:36.073669+0000","last_active":"2024-09-10T05:59:01.970582+0000","last_peered":"2024-09-10T05:59:01.970582+0000","last_clean":"2024-09-10T05:59:01.970582+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:59:01.970582+0000","last_undegraded":"2024-09-10T05:59:01.970582+0000","last_fullsized":"2024-09-10T05:59:01.970582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.770687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973043+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:59:01.973043+0000","last_peered":"2024-09-10T05:59:01.973043+0000","last_clean":"2024-09-10T05:59:01.973043+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:59:01.973043+0000","last_undegraded":"2024-09-10T05:59:01.973043+0000","last_fullsized":"2024-09-10T05:59:01.973043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818325+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:59:01.818325+0000","last_peered":"2024-09-10T05:59:01.818325+0000","last_clean":"2024-09-10T05:59:01.818325+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:59:01.818325+0000","last_undegraded":"2024-09-10T05:59:01.818325+0000","last_fullsized":"2024-09-10T05:59:01.818325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'26","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813863+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:59:01.813863+0000","last_peered":"2024-09-10T05:59:01.813863+0000","last_clean":"2024-09-10T05:59:01.813863+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:59:01.813863+0000","last_undegraded":"2024-09-10T05:59:01.813863+0000","last_fullsized":"2024-09-10T05:59:01.813863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970972+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:59:01.970972+0000","last_peered":"2024-09-10T05:59:01.970972+0000","last_clean":"2024-09-10T05:59:01.970972+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:59:01.970972+0000","last_undegraded":"2024-09-10T05:59:01.970972+0000","last_fullsized":"2024-09-10T05:59:01.970972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814598+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:59:01.814598+0000","last_peered":"2024-09-10T05:59:01.814598+0000","last_clean":"2024-09-10T05:59:01.814598+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:59:01.814598+0000","last_undegraded":"2024-09-10T05:59:01.814598+0000","last_fullsized":"2024-09-10T05:59:01.814598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"131'135","reported_seq":386,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978135+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:59:01.978135+0000","last_peered":"2024-09-10T05:59:01.978135+0000","last_clean":"2024-09-10T05:59:01.978135+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:59:01.978135+0000","last_undegraded":"2024-09-10T05:59:01.978135+0000","last_fullsized":"2024-09-10T05:59:01.978135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968551+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:59:01.968551+0000","last_peered":"2024-09-10T05:59:01.968551+0000","last_clean":"2024-09-10T05:59:01.968551+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:59:01.968551+0000","last_undegraded":"2024-09-10T05:59:01.968551+0000","last_fullsized":"2024-09-10T05:59:01.968551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813457+0000","last_change":"2024-09-10T05:58:40.129243+0000","last_active":"2024-09-10T05:59:01.813457+0000","last_peered":"2024-09-10T05:59:01.813457+0000","last_clean":"2024-09-10T05:59:01.813457+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:59:01.813457+0000","last_undegraded":"2024-09-10T05:59:01.813457+0000","last_fullsized":"2024-09-10T05:59:01.813457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:22.831721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"111'17","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975868+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:59:01.975868+0000","last_peered":"2024-09-10T05:59:01.975868+0000","last_clean":"2024-09-10T05:59:01.975868+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:59:01.975868+0000","last_undegraded":"2024-09-10T05:59:01.975868+0000","last_fullsized":"2024-09-10T05:59:01.975868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969585+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:59:01.969585+0000","last_peered":"2024-09-10T05:59:01.969585+0000","last_clean":"2024-09-10T05:59:01.969585+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:59:01.969585+0000","last_undegraded":"2024-09-10T05:59:01.969585+0000","last_fullsized":"2024-09-10T05:59:01.969585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"111'48","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973667+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:59:01.973667+0000","last_peered":"2024-09-10T05:59:01.973667+0000","last_clean":"2024-09-10T05:59:01.973667+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:59:01.973667+0000","last_undegraded":"2024-09-10T05:59:01.973667+0000","last_fullsized":"2024-09-10T05:59:01.973667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120746,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":64,"num_read_kb":51,"num_write":42,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811526+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:59:01.811526+0000","last_peered":"2024-09-10T05:59:01.811526+0000","last_clean":"2024-09-10T05:59:01.811526+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:59:01.811526+0000","last_undegraded":"2024-09-10T05:59:01.811526+0000","last_fullsized":"2024-09-10T05:59:01.811526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973463+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:59:01.973463+0000","last_peered":"2024-09-10T05:59:01.973463+0000","last_clean":"2024-09-10T05:59:01.973463+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:59:01.973463+0000","last_undegraded":"2024-09-10T05:59:01.973463+0000","last_fullsized":"2024-09-10T05:59:01.973463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":293,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813505+0000","last_change":"2024-09-10T05:58:37.200455+0000","last_active":"2024-09-10T05:59:01.813505+0000","last_peered":"2024-09-10T05:59:01.813505+0000","last_clean":"2024-09-10T05:59:01.813505+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:59:01.813505+0000","last_undegraded":"2024-09-10T05:59:01.813505+0000","last_fullsized":"2024-09-10T05:59:01.813505+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.815795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980118+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:59:01.980118+0000","last_peered":"2024-09-10T05:59:01.980118+0000","last_clean":"2024-09-10T05:59:01.980118+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:59:01.980118+0000","last_undegraded":"2024-09-10T05:59:01.980118+0000","last_fullsized":"2024-09-10T05:59:01.980118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973100+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:59:01.973100+0000","last_peered":"2024-09-10T05:59:01.973100+0000","last_clean":"2024-09-10T05:59:01.973100+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:59:01.973100+0000","last_undegraded":"2024-09-10T05:59:01.973100+0000","last_fullsized":"2024-09-10T05:59:01.973100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"111'23","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811678+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:59:01.811678+0000","last_peered":"2024-09-10T05:59:01.811678+0000","last_clean":"2024-09-10T05:59:01.811678+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:59:01.811678+0000","last_undegraded":"2024-09-10T05:59:01.811678+0000","last_fullsized":"2024-09-10T05:59:01.811678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978365+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:59:01.978365+0000","last_peered":"2024-09-10T05:59:01.978365+0000","last_clean":"2024-09-10T05:59:01.978365+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:59:01.978365+0000","last_undegraded":"2024-09-10T05:59:01.978365+0000","last_fullsized":"2024-09-10T05:59:01.978365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825337+0000","last_change":"2024-09-10T05:58:36.751943+0000","last_active":"2024-09-10T05:59:01.825337+0000","last_peered":"2024-09-10T05:59:01.825337+0000","last_clean":"2024-09-10T05:59:01.825337+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:59:01.825337+0000","last_undegraded":"2024-09-10T05:59:01.825337+0000","last_fullsized":"2024-09-10T05:59:01.825337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:52.279125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823701+0000","last_change":"2024-09-10T05:58:36.760284+0000","last_active":"2024-09-10T05:59:01.823701+0000","last_peered":"2024-09-10T05:59:01.823701+0000","last_clean":"2024-09-10T05:59:01.823701+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:59:01.823701+0000","last_undegraded":"2024-09-10T05:59:01.823701+0000","last_fullsized":"2024-09-10T05:59:01.823701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:27.695656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'30","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824955+0000","last_change":"2024-09-10T05:58:36.748201+0000","last_active":"2024-09-10T05:59:01.824955+0000","last_peered":"2024-09-10T05:59:01.824955+0000","last_clean":"2024-09-10T05:59:01.824955+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:59:01.824955+0000","last_undegraded":"2024-09-10T05:59:01.824955+0000","last_fullsized":"2024-09-10T05:59:01.824955+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.304252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811947+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:59:01.811947+0000","last_peered":"2024-09-10T05:59:01.811947+0000","last_clean":"2024-09-10T05:59:01.811947+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:59:01.811947+0000","last_undegraded":"2024-09-10T05:59:01.811947+0000","last_fullsized":"2024-09-10T05:59:01.811947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"111'19","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823948+0000","last_change":"2024-09-10T05:58:42.032681+0000","last_active":"2024-09-10T05:59:01.823948+0000","last_peered":"2024-09-10T05:59:01.823948+0000","last_clean":"2024-09-10T05:59:01.823948+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:59:01.823948+0000","last_undegraded":"2024-09-10T05:59:01.823948+0000","last_fullsized":"2024-09-10T05:59:01.823948+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:11.388502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812414+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:59:01.812414+0000","last_peered":"2024-09-10T05:59:01.812414+0000","last_clean":"2024-09-10T05:59:01.812414+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:59:01.812414+0000","last_undegraded":"2024-09-10T05:59:01.812414+0000","last_fullsized":"2024-09-10T05:59:01.812414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970419+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:59:01.970419+0000","last_peered":"2024-09-10T05:59:01.970419+0000","last_clean":"2024-09-10T05:59:01.970419+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:59:01.970419+0000","last_undegraded":"2024-09-10T05:59:01.970419+0000","last_fullsized":"2024-09-10T05:59:01.970419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812442+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:59:01.812442+0000","last_peered":"2024-09-10T05:59:01.812442+0000","last_clean":"2024-09-10T05:59:01.812442+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:59:01.812442+0000","last_undegraded":"2024-09-10T05:59:01.812442+0000","last_fullsized":"2024-09-10T05:59:01.812442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"111'25","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817492+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:59:01.817492+0000","last_peered":"2024-09-10T05:59:01.817492+0000","last_clean":"2024-09-10T05:59:01.817492+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:59:01.817492+0000","last_undegraded":"2024-09-10T05:59:01.817492+0000","last_fullsized":"2024-09-10T05:59:01.817492+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968961+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:59:01.968961+0000","last_peered":"2024-09-10T05:59:01.968961+0000","last_clean":"2024-09-10T05:59:01.968961+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:59:01.968961+0000","last_undegraded":"2024-09-10T05:59:01.968961+0000","last_fullsized":"2024-09-10T05:59:01.968961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"111'30","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812862+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:59:01.812862+0000","last_peered":"2024-09-10T05:59:01.812862+0000","last_clean":"2024-09-10T05:59:01.812862+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:59:01.812862+0000","last_undegraded":"2024-09-10T05:59:01.812862+0000","last_fullsized":"2024-09-10T05:59:01.812862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813606+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:59:01.813606+0000","last_peered":"2024-09-10T05:59:01.813606+0000","last_clean":"2024-09-10T05:59:01.813606+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:59:01.813606+0000","last_undegraded":"2024-09-10T05:59:01.813606+0000","last_fullsized":"2024-09-10T05:59:01.813606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815081+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:59:01.815081+0000","last_peered":"2024-09-10T05:59:01.815081+0000","last_clean":"2024-09-10T05:59:01.815081+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:59:01.815081+0000","last_undegraded":"2024-09-10T05:59:01.815081+0000","last_fullsized":"2024-09-10T05:59:01.815081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971172+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:59:01.971172+0000","last_peered":"2024-09-10T05:59:01.971172+0000","last_clean":"2024-09-10T05:59:01.971172+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:59:01.971172+0000","last_undegraded":"2024-09-10T05:59:01.971172+0000","last_fullsized":"2024-09-10T05:59:01.971172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"111'30","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980571+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:59:01.980571+0000","last_peered":"2024-09-10T05:59:01.980571+0000","last_clean":"2024-09-10T05:59:01.980571+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:59:01.980571+0000","last_undegraded":"2024-09-10T05:59:01.980571+0000","last_fullsized":"2024-09-10T05:59:01.980571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970866+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:59:01.970866+0000","last_peered":"2024-09-10T05:59:01.970866+0000","last_clean":"2024-09-10T05:59:01.970866+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:59:01.970866+0000","last_undegraded":"2024-09-10T05:59:01.970866+0000","last_fullsized":"2024-09-10T05:59:01.970866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"111'22","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816382+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:59:01.816382+0000","last_peered":"2024-09-10T05:59:01.816382+0000","last_clean":"2024-09-10T05:59:01.816382+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:59:01.816382+0000","last_undegraded":"2024-09-10T05:59:01.816382+0000","last_fullsized":"2024-09-10T05:59:01.816382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976396+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:59:01.976396+0000","last_peered":"2024-09-10T05:59:01.976396+0000","last_clean":"2024-09-10T05:59:01.976396+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:59:01.976396+0000","last_undegraded":"2024-09-10T05:59:01.976396+0000","last_fullsized":"2024-09-10T05:59:01.976396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'21","reported_seq":320,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975064+0000","last_change":"2024-09-10T05:58:37.753575+0000","last_active":"2024-09-10T05:59:01.975064+0000","last_peered":"2024-09-10T05:59:01.975064+0000","last_clean":"2024-09-10T05:59:01.975064+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:59:01.975064+0000","last_undegraded":"2024-09-10T05:59:01.975064+0000","last_fullsized":"2024-09-10T05:59:01.975064+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:21.191915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970245+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:59:01.970245+0000","last_peered":"2024-09-10T05:59:01.970245+0000","last_clean":"2024-09-10T05:59:01.970245+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:59:01.970245+0000","last_undegraded":"2024-09-10T05:59:01.970245+0000","last_fullsized":"2024-09-10T05:59:01.970245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"111'22","reported_seq":329,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814122+0000","last_change":"2024-09-10T05:58:38.431996+0000","last_active":"2024-09-10T05:59:01.814122+0000","last_peered":"2024-09-10T05:59:01.814122+0000","last_clean":"2024-09-10T05:59:01.814122+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:59:01.814122+0000","last_undegraded":"2024-09-10T05:59:01.814122+0000","last_fullsized":"2024-09-10T05:59:01.814122+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.662612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813281+0000","last_change":"2024-09-10T05:58:40.123148+0000","last_active":"2024-09-10T05:59:01.813281+0000","last_peered":"2024-09-10T05:59:01.813281+0000","last_clean":"2024-09-10T05:59:01.813281+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:59:01.813281+0000","last_undegraded":"2024-09-10T05:59:01.813281+0000","last_fullsized":"2024-09-10T05:59:01.813281+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:28.445530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"111'30","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825927+0000","last_change":"2024-09-10T05:58:37.278065+0000","last_active":"2024-09-10T05:59:01.825927+0000","last_peered":"2024-09-10T05:59:01.825927+0000","last_clean":"2024-09-10T05:59:01.825927+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:59:01.825927+0000","last_undegraded":"2024-09-10T05:59:01.825927+0000","last_fullsized":"2024-09-10T05:59:01.825927+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:23.616575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813671+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:59:01.813671+0000","last_peered":"2024-09-10T05:59:01.813671+0000","last_clean":"2024-09-10T05:59:01.813671+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:59:01.813671+0000","last_undegraded":"2024-09-10T05:59:01.813671+0000","last_fullsized":"2024-09-10T05:59:01.813671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"111'28","reported_seq":352,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971390+0000","last_change":"2024-09-10T05:58:37.192873+0000","last_active":"2024-09-10T05:59:01.971390+0000","last_peered":"2024-09-10T05:59:01.971390+0000","last_clean":"2024-09-10T05:59:01.971390+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:59:01.971390+0000","last_undegraded":"2024-09-10T05:59:01.971390+0000","last_fullsized":"2024-09-10T05:59:01.971390+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.993383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823416+0000","last_change":"2024-09-10T05:58:36.076255+0000","last_active":"2024-09-10T05:59:01.823416+0000","last_peered":"2024-09-10T05:59:01.823416+0000","last_clean":"2024-09-10T05:59:01.823416+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:59:01.823416+0000","last_undegraded":"2024-09-10T05:59:01.823416+0000","last_fullsized":"2024-09-10T05:59:01.823416+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:20.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"111'19","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978448+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:59:01.978448+0000","last_peered":"2024-09-10T05:59:01.978448+0000","last_clean":"2024-09-10T05:59:01.978448+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:59:01.978448+0000","last_undegraded":"2024-09-10T05:59:01.978448+0000","last_fullsized":"2024-09-10T05:59:01.978448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980248+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:59:01.980248+0000","last_peered":"2024-09-10T05:59:01.980248+0000","last_clean":"2024-09-10T05:59:01.980248+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:59:01.980248+0000","last_undegraded":"2024-09-10T05:59:01.980248+0000","last_fullsized":"2024-09-10T05:59:01.980248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.826148+0000","last_change":"2024-09-10T05:58:40.562955+0000","last_active":"2024-09-10T05:59:01.826148+0000","last_peered":"2024-09-10T05:59:01.826148+0000","last_clean":"2024-09-10T05:59:01.826148+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:59:01.826148+0000","last_undegraded":"2024-09-10T05:59:01.826148+0000","last_fullsized":"2024-09-10T05:59:01.826148+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:55.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815897+0000","last_change":"2024-09-10T05:58:40.787117+0000","last_active":"2024-09-10T05:59:01.815897+0000","last_peered":"2024-09-10T05:59:01.815897+0000","last_clean":"2024-09-10T05:59:01.815897+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:59:01.815897+0000","last_undegraded":"2024-09-10T05:59:01.815897+0000","last_fullsized":"2024-09-10T05:59:01.815897+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:06.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"111'28","reported_seq":343,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980220+0000","last_change":"2024-09-10T05:58:40.117727+0000","last_active":"2024-09-10T05:59:01.980220+0000","last_peered":"2024-09-10T05:59:01.980220+0000","last_clean":"2024-09-10T05:59:01.980220+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:59:01.980220+0000","last_undegraded":"2024-09-10T05:59:01.980220+0000","last_fullsized":"2024-09-10T05:59:01.980220+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:28.251854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814850+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:59:01.814850+0000","last_peered":"2024-09-10T05:59:01.814850+0000","last_clean":"2024-09-10T05:59:01.814850+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:59:01.814850+0000","last_undegraded":"2024-09-10T05:59:01.814850+0000","last_fullsized":"2024-09-10T05:59:01.814850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'21","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823684+0000","last_change":"2024-09-10T05:58:40.171208+0000","last_active":"2024-09-10T05:59:01.823684+0000","last_peered":"2024-09-10T05:59:01.823684+0000","last_clean":"2024-09-10T05:59:01.823684+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:59:01.823684+0000","last_undegraded":"2024-09-10T05:59:01.823684+0000","last_fullsized":"2024-09-10T05:59:01.823684+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:43.370109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":223,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817504+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:59:01.817504+0000","last_peered":"2024-09-10T05:59:01.817504+0000","last_clean":"2024-09-10T05:59:01.817504+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:59:01.817504+0000","last_undegraded":"2024-09-10T05:59:01.817504+0000","last_fullsized":"2024-09-10T05:59:01.817504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"111'33","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974919+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:59:01.974919+0000","last_peered":"2024-09-10T05:59:01.974919+0000","last_clean":"2024-09-10T05:59:01.974919+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:59:01.974919+0000","last_undegraded":"2024-09-10T05:59:01.974919+0000","last_fullsized":"2024-09-10T05:59:01.974919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814626+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:59:01.814626+0000","last_peered":"2024-09-10T05:59:01.814626+0000","last_clean":"2024-09-10T05:59:01.814626+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:59:01.814626+0000","last_undegraded":"2024-09-10T05:59:01.814626+0000","last_fullsized":"2024-09-10T05:59:01.814626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"111'18","reported_seq":245,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814398+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:59:01.814398+0000","last_peered":"2024-09-10T05:59:01.814398+0000","last_clean":"2024-09-10T05:59:01.814398+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:59:01.814398+0000","last_undegraded":"2024-09-10T05:59:01.814398+0000","last_fullsized":"2024-09-10T05:59:01.814398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970326+0000","last_change":"2024-09-10T05:58:38.090502+0000","last_active":"2024-09-10T05:59:01.970326+0000","last_peered":"2024-09-10T05:59:01.970326+0000","last_clean":"2024-09-10T05:59:01.970326+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:59:01.970326+0000","last_undegraded":"2024-09-10T05:59:01.970326+0000","last_fullsized":"2024-09-10T05:59:01.970326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:56.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'21","reported_seq":253,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976575+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:59:01.976575+0000","last_peered":"2024-09-10T05:59:01.976575+0000","last_clean":"2024-09-10T05:59:01.976575+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:59:01.976575+0000","last_undegraded":"2024-09-10T05:59:01.976575+0000","last_fullsized":"2024-09-10T05:59:01.976575+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812931+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:59:01.812931+0000","last_peered":"2024-09-10T05:59:01.812931+0000","last_clean":"2024-09-10T05:59:01.812931+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:59:01.812931+0000","last_undegraded":"2024-09-10T05:59:01.812931+0000","last_fullsized":"2024-09-10T05:59:01.812931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'24","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971973+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:59:01.971973+0000","last_peered":"2024-09-10T05:59:01.971973+0000","last_clean":"2024-09-10T05:59:01.971973+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:59:01.971973+0000","last_undegraded":"2024-09-10T05:59:01.971973+0000","last_fullsized":"2024-09-10T05:59:01.971973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824020+0000","last_change":"2024-09-10T05:58:36.090342+0000","last_active":"2024-09-10T05:59:01.824020+0000","last_peered":"2024-09-10T05:59:01.824020+0000","last_clean":"2024-09-10T05:59:01.824020+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:59:01.824020+0000","last_undegraded":"2024-09-10T05:59:01.824020+0000","last_fullsized":"2024-09-10T05:59:01.824020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:15.019257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"111'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817922+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:59:01.817922+0000","last_peered":"2024-09-10T05:59:01.817922+0000","last_clean":"2024-09-10T05:59:01.817922+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:59:01.817922+0000","last_undegraded":"2024-09-10T05:59:01.817922+0000","last_fullsized":"2024-09-10T05:59:01.817922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969117+0000","last_change":"2024-09-10T05:58:36.079403+0000","last_active":"2024-09-10T05:59:01.969117+0000","last_peered":"2024-09-10T05:59:01.969117+0000","last_clean":"2024-09-10T05:59:01.969117+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:59:01.969117+0000","last_undegraded":"2024-09-10T05:59:01.969117+0000","last_fullsized":"2024-09-10T05:59:01.969117+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.025854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'25","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980775+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:59:01.980775+0000","last_peered":"2024-09-10T05:59:01.980775+0000","last_clean":"2024-09-10T05:59:01.980775+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:59:01.980775+0000","last_undegraded":"2024-09-10T05:59:01.980775+0000","last_fullsized":"2024-09-10T05:59:01.980775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"111'24","reported_seq":159,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816009+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:59:01.816009+0000","last_peered":"2024-09-10T05:59:01.816009+0000","last_clean":"2024-09-10T05:59:01.816009+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:59:01.816009+0000","last_undegraded":"2024-09-10T05:59:01.816009+0000","last_fullsized":"2024-09-10T05:59:01.816009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815803+0000","last_change":"2024-09-10T05:58:40.744836+0000","last_active":"2024-09-10T05:59:01.815803+0000","last_peered":"2024-09-10T05:59:01.815803+0000","last_clean":"2024-09-10T05:59:01.815803+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:59:01.815803+0000","last_undegraded":"2024-09-10T05:59:01.815803+0000","last_fullsized":"2024-09-10T05:59:01.815803+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"111'23","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969764+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:59:01.969764+0000","last_peered":"2024-09-10T05:59:01.969764+0000","last_clean":"2024-09-10T05:59:01.969764+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:59:01.969764+0000","last_undegraded":"2024-09-10T05:59:01.969764+0000","last_fullsized":"2024-09-10T05:59:01.969764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976451+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:59:01.976451+0000","last_peered":"2024-09-10T05:59:01.976451+0000","last_clean":"2024-09-10T05:59:01.976451+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:59:01.976451+0000","last_undegraded":"2024-09-10T05:59:01.976451+0000","last_fullsized":"2024-09-10T05:59:01.976451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1094,"ondisk_log_size":1094,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382933,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1132,"num_read_kb":862,"num_write":655,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":953,"ondisk_log_size":953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1584,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1856152,"kb_used_data":1820804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92515688,"statfs":{"total":96636764160,"available":94736064512,"internally_reserved":0,"allocated":1864503296,"data_stored":1863805989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163328,"kb_used_data":1132140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93208512,"statfs":{"total":96636764160,"available":95445516288,"internally_reserved":0,"allocated":1159311360,"data_stored":1158631588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1816876,"kb_used_data":1781528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92554964,"statfs":{"total":96636764160,"available":94776283136,"internally_reserved":0,"allocated":1824284672,"data_stored":1823545904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1693872,"kb_used_data":1658520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92677968,"statfs":{"total":96636764160,"available":94902239232,"internally_reserved":0,"allocated":1698324480,"data_stored":1697657651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1931348,"kb_used_data":1900160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92440492,"statfs":{"total":96636764160,"available":94659063808,"internally_reserved":0,"allocated":1945763840,"data_stored":1945064387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099892,"kb_used_data":1060380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93271948,"statfs":{"total":96636764160,"available":95510474752,"internally_reserved":0,"allocated":1085829120,"data_stored":1085171131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1202624,"kb_used_data":1163112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93169216,"statfs":{"total":96636764160,"available":95405277184,"internally_reserved":0,"allocated":1191026688,"data_stored":1190321339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1841864,"kb_used_data":1802356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":92529976,"statfs":{"total":96636764160,"available":94750695424,"internally_reserved":0,"allocated":1845612544,"data_stored":1844931463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1843396608,"data_stored":1843396608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1189085184,"data_stored":1189085184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1084227584,"data_stored":1084227584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1944059904,"data_stored":1944059904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1696595968,"data_stored":1696595968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1822425088,"data_stored":1822425088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1157627904,"data_stored":1157627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1862270976,"data_stored":1862270976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":292527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":59916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":117427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":177431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:59:10.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T05:59:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:59:10.595 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":133,"fsid":"64591990-2498-4479-bfa8-9a8cb8fcb29f","created":"2024-09-10T05:54:52.845539+0000","modified":"2024-09-10T05:59:01.798975+0000","last_up_change":"2024-09-10T05:55:04.950402+0000","last_in_change":"2024-09-10T05:58:34.994738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T05:55:05.674567+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T05:55:11.127613+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T05:55:21.036897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T05:55:22.887571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T05:55:25.018914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T05:55:26.694534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T05:55:28.604339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T05:55:30.741862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7de4b4d6-bddb-415b-ac33-62eda22b0fc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6801","nonce":3378450542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6803","nonce":3378450542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6807","nonce":3378450542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":3378450542},{"type":"v1","addr":"172.21.15.70:6805","nonce":3378450542}]},"public_addr":"172.21.15.70:6801/3378450542","cluster_addr":"172.21.15.70:6803/3378450542","heartbeat_back_addr":"172.21.15.70:6807/3378450542","heartbeat_front_addr":"172.21.15.70:6805/3378450542","state":["exists","up"]},{"osd":1,"uuid":"e1d81852-e81f-4738-bc5c-acf3a2a5b5de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6809","nonce":841653474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6811","nonce":841653474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6815","nonce":841653474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":841653474},{"type":"v1","addr":"172.21.15.70:6813","nonce":841653474}]},"public_addr":"172.21.15.70:6809/841653474","cluster_addr":"172.21.15.70:6811/841653474","heartbeat_back_addr":"172.21.15.70:6815/841653474","heartbeat_front_addr":"172.21.15.70:6813/841653474","state":["exists","up"]},{"osd":2,"uuid":"405e0867-aba2-42fe-bdf6-4be0de0860d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6817","nonce":2429334233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6819","nonce":2429334233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6823","nonce":2429334233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2429334233},{"type":"v1","addr":"172.21.15.70:6821","nonce":2429334233}]},"public_addr":"172.21.15.70:6817/2429334233","cluster_addr":"172.21.15.70:6819/2429334233","heartbeat_back_addr":"172.21.15.70:6823/2429334233","heartbeat_front_addr":"172.21.15.70:6821/2429334233","state":["exists","up"]},{"osd":3,"uuid":"d57b60c0-744b-4d58-bb15-b3cffc9083bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6825","nonce":128774917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6827","nonce":128774917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6831","nonce":128774917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":128774917},{"type":"v1","addr":"172.21.15.70:6829","nonce":128774917}]},"public_addr":"172.21.15.70:6825/128774917","cluster_addr":"172.21.15.70:6827/128774917","heartbeat_back_addr":"172.21.15.70:6831/128774917","heartbeat_front_addr":"172.21.15.70:6829/128774917","state":["exists","up"]},{"osd":4,"uuid":"b6988baa-4417-4899-9adf-7832c70b4eb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6801","nonce":2565298170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6803","nonce":2565298170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6807","nonce":2565298170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2565298170},{"type":"v1","addr":"172.21.15.98:6805","nonce":2565298170}]},"public_addr":"172.21.15.98:6801/2565298170","cluster_addr":"172.21.15.98:6803/2565298170","heartbeat_back_addr":"172.21.15.98:6807/2565298170","heartbeat_front_addr":"172.21.15.98:6805/2565298170","state":["exists","up"]},{"osd":5,"uuid":"f215d032-5868-49d0-8238-19a0c9476b4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6825","nonce":1681543764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6827","nonce":1681543764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6831","nonce":1681543764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1681543764},{"type":"v1","addr":"172.21.15.98:6829","nonce":1681543764}]},"public_addr":"172.21.15.98:6825/1681543764","cluster_addr":"172.21.15.98:6827/1681543764","heartbeat_back_addr":"172.21.15.98:6831/1681543764","heartbeat_front_addr":"172.21.15.98:6829/1681543764","state":["exists","up"]},{"osd":6,"uuid":"878c5865-fed4-48f5-8b7c-c4ca199a2737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6817","nonce":2743355861}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6819","nonce":2743355861}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6823","nonce":2743355861}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2743355861},{"type":"v1","addr":"172.21.15.98:6821","nonce":2743355861}]},"public_addr":"172.21.15.98:6817/2743355861","cluster_addr":"172.21.15.98:6819/2743355861","heartbeat_back_addr":"172.21.15.98:6823/2743355861","heartbeat_front_addr":"172.21.15.98:6821/2743355861","state":["exists","up"]},{"osd":7,"uuid":"b98908e9-8169-41e3-8239-ea1d729d36af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6809","nonce":134608104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6811","nonce":134608104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6815","nonce":134608104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":134608104},{"type":"v1","addr":"172.21.15.98:6813","nonce":134608104}]},"public_addr":"172.21.15.98:6809/134608104","cluster_addr":"172.21.15.98:6811/134608104","heartbeat_back_addr":"172.21.15.98:6815/134608104","heartbeat_front_addr":"172.21.15.98:6813/134608104","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.657166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.779551+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.757932+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.247018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.648338+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:02.605178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.839697+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T05:55:01.929351+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.23","osds":[0,3]}],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.27","mappings":[{"from":4,"to":1}]},{"pgid":"3.2c","mappings":[{"from":4,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.3f","mappings":[{"from":3,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T05:59:11.614 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T05:59:11.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:11.777 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:11.777 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:11.777 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:11.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T05:59:12.081 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T05:59:12.099 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T05:59:12.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:12.246 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:12.246 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:12.247 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:12.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T05:59:12.555 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T05:59:12.573 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T05:59:12.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:12.720 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:12.720 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:12.720 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:12.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T05:59:13.016 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T05:59:13.034 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T05:59:13.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:13.168 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:13.168 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:13.168 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:13.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T05:59:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T05:59:13.476 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T05:59:13.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:13.627 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:13.627 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:13.627 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:13.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T05:59:13.936 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T05:59:13.955 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T05:59:13.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:14.099 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:14.099 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:14.099 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:14.117 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T05:59:14.408 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T05:59:14.428 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T05:59:14.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:14.572 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:14.573 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:14.573 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:14.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T05:59:14.863 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T05:59:14.881 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T05:59:14.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T05:59:15.018 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-10T05:59:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T05:59:15.018 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-10T05:59:15.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T05:59:15.321 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T05:59:15.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:59:15.673 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:59:15.679 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:59:15.695 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-10T05:59:13.738842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624007,"num_objects":232,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":5195,"num_read_kb":4070,"num_write":4545,"num_write_kb":6187131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":853,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5699,"ondisk_log_size":5699,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":305688,"kb_used_data":13892,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754669032,"statfs":{"total":773094113280,"available":772781088768,"internally_reserved":0,"allocated":14225408,"data_stored":8738134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195937,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1730,"num_read_kb":946,"num_write":1582,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.932011"},"pg_stats":[{"pgid":"3.3f","version":"133'44","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.987008+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:59:08.987008+0000","last_peered":"2024-09-10T05:59:08.987008+0000","last_clean":"2024-09-10T05:59:08.987008+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:59:08.987008+0000","last_undegraded":"2024-09-10T05:59:08.987008+0000","last_fullsized":"2024-09-10T05:59:08.987008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971871+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:59:01.971871+0000","last_peered":"2024-09-10T05:59:01.971871+0000","last_clean":"2024-09-10T05:59:01.971871+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:59:01.971871+0000","last_undegraded":"2024-09-10T05:59:01.971871+0000","last_fullsized":"2024-09-10T05:59:01.971871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"133'54","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.956239+0000","last_change":"2024-09-10T05:55:22.543660+0000","last_active":"2024-09-10T05:59:08.956239+0000","last_peered":"2024-09-10T05:59:08.956239+0000","last_clean":"2024-09-10T05:59:08.956239+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:59:08.956239+0000","last_undegraded":"2024-09-10T05:59:08.956239+0000","last_fullsized":"2024-09-10T05:59:08.956239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:42.147403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969559+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:59:01.969559+0000","last_peered":"2024-09-10T05:59:01.969559+0000","last_clean":"2024-09-10T05:59:01.969559+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:59:01.969559+0000","last_undegraded":"2024-09-10T05:59:01.969559+0000","last_fullsized":"2024-09-10T05:59:01.969559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"133'54","reported_seq":281,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.947096+0000","last_change":"2024-09-10T05:55:22.550558+0000","last_active":"2024-09-10T05:59:08.947096+0000","last_peered":"2024-09-10T05:59:08.947096+0000","last_clean":"2024-09-10T05:59:08.947096+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:59:08.947096+0000","last_undegraded":"2024-09-10T05:59:08.947096+0000","last_fullsized":"2024-09-10T05:59:08.947096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:57.088674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813155+0000","last_change":"2024-09-10T05:55:24.583070+0000","last_active":"2024-09-10T05:59:01.813155+0000","last_peered":"2024-09-10T05:59:01.813155+0000","last_clean":"2024-09-10T05:59:01.813155+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:59:01.813155+0000","last_undegraded":"2024-09-10T05:59:01.813155+0000","last_fullsized":"2024-09-10T05:59:01.813155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"133'42","reported_seq":344,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.951298+0000","last_change":"2024-09-10T05:58:40.694618+0000","last_active":"2024-09-10T05:59:08.951298+0000","last_peered":"2024-09-10T05:59:08.951298+0000","last_clean":"2024-09-10T05:59:08.951298+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:59:08.951298+0000","last_undegraded":"2024-09-10T05:59:08.951298+0000","last_fullsized":"2024-09-10T05:59:08.951298+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:55.266467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":310,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813864+0000","last_change":"2024-09-10T05:58:40.726727+0000","last_active":"2024-09-10T05:59:01.813864+0000","last_peered":"2024-09-10T05:59:01.813864+0000","last_clean":"2024-09-10T05:59:01.813864+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:59:01.813864+0000","last_undegraded":"2024-09-10T05:59:01.813864+0000","last_fullsized":"2024-09-10T05:59:01.813864+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:59.972041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"133'58","reported_seq":286,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.958602+0000","last_change":"2024-09-10T05:55:22.557151+0000","last_active":"2024-09-10T05:59:08.958602+0000","last_peered":"2024-09-10T05:59:08.958602+0000","last_clean":"2024-09-10T05:59:08.958602+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:59:08.958602+0000","last_undegraded":"2024-09-10T05:59:08.958602+0000","last_fullsized":"2024-09-10T05:59:08.958602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:36.463289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975880+0000","last_change":"2024-09-10T05:55:24.580080+0000","last_active":"2024-09-10T05:59:01.975880+0000","last_peered":"2024-09-10T05:59:01.975880+0000","last_clean":"2024-09-10T05:59:01.975880+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:59:01.975880+0000","last_undegraded":"2024-09-10T05:59:01.975880+0000","last_fullsized":"2024-09-10T05:59:01.975880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:40.524028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"133'50","reported_seq":277,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.942351+0000","last_change":"2024-09-10T05:55:22.566494+0000","last_active":"2024-09-10T05:59:08.942351+0000","last_peered":"2024-09-10T05:59:08.942351+0000","last_clean":"2024-09-10T05:59:08.942351+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:59:08.942351+0000","last_undegraded":"2024-09-10T05:59:08.942351+0000","last_fullsized":"2024-09-10T05:59:08.942351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":58,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814413+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:59:01.814413+0000","last_peered":"2024-09-10T05:59:01.814413+0000","last_clean":"2024-09-10T05:59:01.814413+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:59:01.814413+0000","last_undegraded":"2024-09-10T05:59:01.814413+0000","last_fullsized":"2024-09-10T05:59:01.814413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:53.102102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"133'38","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.942520+0000","last_change":"2024-09-10T05:55:22.569350+0000","last_active":"2024-09-10T05:59:08.942520+0000","last_peered":"2024-09-10T05:59:08.942520+0000","last_clean":"2024-09-10T05:59:08.942520+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:59:08.942520+0000","last_undegraded":"2024-09-10T05:59:08.942520+0000","last_fullsized":"2024-09-10T05:59:08.942520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:22.468533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":46,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975884+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:59:01.975884+0000","last_peered":"2024-09-10T05:59:01.975884+0000","last_clean":"2024-09-10T05:59:01.975884+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:59:01.975884+0000","last_undegraded":"2024-09-10T05:59:01.975884+0000","last_fullsized":"2024-09-10T05:59:01.975884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"133'26","reported_seq":85,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.789862+0000","last_change":"2024-09-10T05:58:42.015968+0000","last_active":"2024-09-10T05:59:08.789862+0000","last_peered":"2024-09-10T05:59:08.789862+0000","last_clean":"2024-09-10T05:59:08.789862+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:59:08.789862+0000","last_undegraded":"2024-09-10T05:59:08.789862+0000","last_fullsized":"2024-09-10T05:59:08.789862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:57:22.893621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.986778+0000","last_change":"2024-09-10T05:59:01.986479+0000","last_active":"2024-09-10T05:59:01.986778+0000","last_peered":"2024-09-10T05:59:01.986778+0000","last_clean":"2024-09-10T05:59:01.986778+0000","last_became_active":"2024-09-10T05:59:01.981080+0000","last_became_peered":"2024-09-10T05:59:01.981080+0000","last_unstale":"2024-09-10T05:59:01.986778+0000","last_undegraded":"2024-09-10T05:59:01.986778+0000","last_fullsized":"2024-09-10T05:59:01.986778+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:00.572672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":222,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812290+0000","last_change":"2024-09-10T05:55:24.568300+0000","last_active":"2024-09-10T05:59:01.812290+0000","last_peered":"2024-09-10T05:59:01.812290+0000","last_clean":"2024-09-10T05:59:01.812290+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:59:01.812290+0000","last_undegraded":"2024-09-10T05:59:01.812290+0000","last_fullsized":"2024-09-10T05:59:01.812290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:17.419351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"133'38","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.978955+0000","last_change":"2024-09-10T05:55:22.584525+0000","last_active":"2024-09-10T05:59:08.978955+0000","last_peered":"2024-09-10T05:59:08.978955+0000","last_clean":"2024-09-10T05:59:08.978955+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:59:08.978955+0000","last_undegraded":"2024-09-10T05:59:08.978955+0000","last_fullsized":"2024-09-10T05:59:08.978955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:38.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969838+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:59:01.969838+0000","last_peered":"2024-09-10T05:59:01.969838+0000","last_clean":"2024-09-10T05:59:01.969838+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:59:01.969838+0000","last_undegraded":"2024-09-10T05:59:01.969838+0000","last_fullsized":"2024-09-10T05:59:01.969838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"133'50","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.953381+0000","last_change":"2024-09-10T05:55:22.562600+0000","last_active":"2024-09-10T05:59:08.953381+0000","last_peered":"2024-09-10T05:59:08.953381+0000","last_clean":"2024-09-10T05:59:08.953381+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:59:08.953381+0000","last_undegraded":"2024-09-10T05:59:08.953381+0000","last_fullsized":"2024-09-10T05:59:08.953381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:02.673479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974629+0000","last_change":"2024-09-10T05:55:24.554045+0000","last_active":"2024-09-10T05:59:01.974629+0000","last_peered":"2024-09-10T05:59:01.974629+0000","last_clean":"2024-09-10T05:59:01.974629+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:59:01.974629+0000","last_undegraded":"2024-09-10T05:59:01.974629+0000","last_fullsized":"2024-09-10T05:59:01.974629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:08.343783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"133'34","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.829657+0000","last_change":"2024-09-10T05:55:22.574682+0000","last_active":"2024-09-10T05:59:08.829657+0000","last_peered":"2024-09-10T05:59:08.829657+0000","last_clean":"2024-09-10T05:59:08.829657+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:59:08.829657+0000","last_undegraded":"2024-09-10T05:59:08.829657+0000","last_fullsized":"2024-09-10T05:59:08.829657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:20.508638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":42,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":277,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816892+0000","last_change":"2024-09-10T05:58:39.367642+0000","last_active":"2024-09-10T05:59:01.816892+0000","last_peered":"2024-09-10T05:59:01.816892+0000","last_clean":"2024-09-10T05:59:01.816892+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:59:01.816892+0000","last_undegraded":"2024-09-10T05:59:01.816892+0000","last_fullsized":"2024-09-10T05:59:01.816892+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:38.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"133'56","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.961416+0000","last_change":"2024-09-10T05:55:22.562792+0000","last_active":"2024-09-10T05:59:08.961416+0000","last_peered":"2024-09-10T05:59:08.961416+0000","last_clean":"2024-09-10T05:59:08.961416+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:59:08.961416+0000","last_undegraded":"2024-09-10T05:59:08.961416+0000","last_fullsized":"2024-09-10T05:59:08.961416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:19.282804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818018+0000","last_change":"2024-09-10T05:55:24.567323+0000","last_active":"2024-09-10T05:59:01.818018+0000","last_peered":"2024-09-10T05:59:01.818018+0000","last_clean":"2024-09-10T05:59:01.818018+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:59:01.818018+0000","last_undegraded":"2024-09-10T05:59:01.818018+0000","last_fullsized":"2024-09-10T05:59:01.818018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:41.512190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"133'44","reported_seq":112,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.914293+0000","last_change":"2024-09-10T05:58:42.304778+0000","last_active":"2024-09-10T05:59:08.914293+0000","last_peered":"2024-09-10T05:59:08.914293+0000","last_clean":"2024-09-10T05:59:08.914293+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:59:08.914293+0000","last_undegraded":"2024-09-10T05:59:08.914293+0000","last_fullsized":"2024-09-10T05:59:08.914293+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:41.747059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814552+0000","last_change":"2024-09-10T05:55:24.568704+0000","last_active":"2024-09-10T05:59:01.814552+0000","last_peered":"2024-09-10T05:59:01.814552+0000","last_clean":"2024-09-10T05:59:01.814552+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:59:01.814552+0000","last_undegraded":"2024-09-10T05:59:01.814552+0000","last_fullsized":"2024-09-10T05:59:01.814552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:05.182831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"133'48","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.798529+0000","last_change":"2024-09-10T05:55:22.543385+0000","last_active":"2024-09-10T05:59:08.798529+0000","last_peered":"2024-09-10T05:59:08.798529+0000","last_clean":"2024-09-10T05:59:08.798529+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:59:08.798529+0000","last_undegraded":"2024-09-10T05:59:08.798529+0000","last_fullsized":"2024-09-10T05:59:08.798529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:51.120491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811956+0000","last_change":"2024-09-10T05:58:38.995573+0000","last_active":"2024-09-10T05:59:01.811956+0000","last_peered":"2024-09-10T05:59:01.811956+0000","last_clean":"2024-09-10T05:59:01.811956+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:59:01.811956+0000","last_undegraded":"2024-09-10T05:59:01.811956+0000","last_fullsized":"2024-09-10T05:59:01.811956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":54,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825533+0000","last_change":"2024-09-10T05:58:37.289796+0000","last_active":"2024-09-10T05:59:01.825533+0000","last_peered":"2024-09-10T05:59:01.825533+0000","last_clean":"2024-09-10T05:59:01.825533+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:59:01.825533+0000","last_undegraded":"2024-09-10T05:59:01.825533+0000","last_fullsized":"2024-09-10T05:59:01.825533+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:13.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"133'38","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.898470+0000","last_change":"2024-09-10T05:55:22.571493+0000","last_active":"2024-09-10T05:59:08.898470+0000","last_peered":"2024-09-10T05:59:08.898470+0000","last_clean":"2024-09-10T05:59:08.898470+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:59:08.898470+0000","last_undegraded":"2024-09-10T05:59:08.898470+0000","last_fullsized":"2024-09-10T05:59:08.898470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976010+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:59:01.976010+0000","last_peered":"2024-09-10T05:59:01.976010+0000","last_clean":"2024-09-10T05:59:01.976010+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:59:01.976010+0000","last_undegraded":"2024-09-10T05:59:01.976010+0000","last_fullsized":"2024-09-10T05:59:01.976010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"133'33","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.029815+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:59:09.029815+0000","last_peered":"2024-09-10T05:59:09.029815+0000","last_clean":"2024-09-10T05:59:09.029815+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:59:09.029815+0000","last_undegraded":"2024-09-10T05:59:09.029815+0000","last_fullsized":"2024-09-10T05:59:09.029815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972175+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:59:01.972175+0000","last_peered":"2024-09-10T05:59:01.972175+0000","last_clean":"2024-09-10T05:59:01.972175+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:59:01.972175+0000","last_undegraded":"2024-09-10T05:59:01.972175+0000","last_fullsized":"2024-09-10T05:59:01.972175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"111'48","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972638+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:59:01.972638+0000","last_peered":"2024-09-10T05:59:01.972638+0000","last_clean":"2024-09-10T05:59:01.972638+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:59:01.972638+0000","last_undegraded":"2024-09-10T05:59:01.972638+0000","last_fullsized":"2024-09-10T05:59:01.972638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980010+0000","last_change":"2024-09-10T05:55:24.555259+0000","last_active":"2024-09-10T05:59:01.980010+0000","last_peered":"2024-09-10T05:59:01.980010+0000","last_clean":"2024-09-10T05:59:01.980010+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:59:01.980010+0000","last_undegraded":"2024-09-10T05:59:01.980010+0000","last_fullsized":"2024-09-10T05:59:01.980010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:19.426941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"133'52","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.965077+0000","last_change":"2024-09-10T05:55:22.573249+0000","last_active":"2024-09-10T05:59:08.965077+0000","last_peered":"2024-09-10T05:59:08.965077+0000","last_clean":"2024-09-10T05:59:08.965077+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:59:08.965077+0000","last_undegraded":"2024-09-10T05:59:08.965077+0000","last_fullsized":"2024-09-10T05:59:08.965077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:08:22.362348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825797+0000","last_change":"2024-09-10T05:58:36.074698+0000","last_active":"2024-09-10T05:59:01.825797+0000","last_peered":"2024-09-10T05:59:01.825797+0000","last_clean":"2024-09-10T05:59:01.825797+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:59:01.825797+0000","last_undegraded":"2024-09-10T05:59:01.825797+0000","last_fullsized":"2024-09-10T05:59:01.825797+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:37.044312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814922+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:59:01.814922+0000","last_peered":"2024-09-10T05:59:01.814922+0000","last_clean":"2024-09-10T05:59:01.814922+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:59:01.814922+0000","last_undegraded":"2024-09-10T05:59:01.814922+0000","last_fullsized":"2024-09-10T05:59:01.814922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814332+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:59:01.814332+0000","last_peered":"2024-09-10T05:59:01.814332+0000","last_clean":"2024-09-10T05:59:01.814332+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:59:01.814332+0000","last_undegraded":"2024-09-10T05:59:01.814332+0000","last_fullsized":"2024-09-10T05:59:01.814332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813141+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:59:01.813141+0000","last_peered":"2024-09-10T05:59:01.813141+0000","last_clean":"2024-09-10T05:59:01.813141+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:59:01.813141+0000","last_undegraded":"2024-09-10T05:59:01.813141+0000","last_fullsized":"2024-09-10T05:59:01.813141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816148+0000","last_change":"2024-09-10T05:58:36.709426+0000","last_active":"2024-09-10T05:59:01.816148+0000","last_peered":"2024-09-10T05:59:01.816148+0000","last_clean":"2024-09-10T05:59:01.816148+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:59:01.816148+0000","last_undegraded":"2024-09-10T05:59:01.816148+0000","last_fullsized":"2024-09-10T05:59:01.816148+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:16.494329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"133'54","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.933987+0000","last_change":"2024-09-10T05:55:22.571467+0000","last_active":"2024-09-10T05:59:08.933987+0000","last_peered":"2024-09-10T05:59:08.933987+0000","last_clean":"2024-09-10T05:59:08.933987+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:59:08.933987+0000","last_undegraded":"2024-09-10T05:59:08.933987+0000","last_fullsized":"2024-09-10T05:59:08.933987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:08.176099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825597+0000","last_change":"2024-09-10T05:58:36.086954+0000","last_active":"2024-09-10T05:59:01.825597+0000","last_peered":"2024-09-10T05:59:01.825597+0000","last_clean":"2024-09-10T05:59:01.825597+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:59:01.825597+0000","last_undegraded":"2024-09-10T05:59:01.825597+0000","last_fullsized":"2024-09-10T05:59:01.825597+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:57.423283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"67'23","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817459+0000","last_change":"2024-09-10T05:55:28.580420+0000","last_active":"2024-09-10T05:59:01.817459+0000","last_peered":"2024-09-10T05:59:01.817459+0000","last_clean":"2024-09-10T05:59:01.817459+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:59:01.817459+0000","last_undegraded":"2024-09-10T05:59:01.817459+0000","last_fullsized":"2024-09-10T05:59:01.817459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:37.229119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"133'138","reported_seq":391,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.968635+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:59:07.968635+0000","last_peered":"2024-09-10T05:59:07.968635+0000","last_clean":"2024-09-10T05:59:07.968635+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:59:07.968635+0000","last_undegraded":"2024-09-10T05:59:07.968635+0000","last_fullsized":"2024-09-10T05:59:07.968635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812887+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:59:01.812887+0000","last_peered":"2024-09-10T05:59:01.812887+0000","last_clean":"2024-09-10T05:59:01.812887+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:59:01.812887+0000","last_undegraded":"2024-09-10T05:59:01.812887+0000","last_fullsized":"2024-09-10T05:59:01.812887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825894+0000","last_change":"2024-09-10T05:58:39.658860+0000","last_active":"2024-09-10T05:59:01.825894+0000","last_peered":"2024-09-10T05:59:01.825894+0000","last_clean":"2024-09-10T05:59:01.825894+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:59:01.825894+0000","last_undegraded":"2024-09-10T05:59:01.825894+0000","last_fullsized":"2024-09-10T05:59:01.825894+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:22.522890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"133'36","reported_seq":262,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.928822+0000","last_change":"2024-09-10T05:55:22.556711+0000","last_active":"2024-09-10T05:59:08.928822+0000","last_peered":"2024-09-10T05:59:08.928822+0000","last_clean":"2024-09-10T05:59:08.928822+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:59:08.928822+0000","last_undegraded":"2024-09-10T05:59:08.928822+0000","last_fullsized":"2024-09-10T05:59:08.928822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:44:15.787027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975529+0000","last_change":"2024-09-10T05:58:36.076514+0000","last_active":"2024-09-10T05:59:01.975529+0000","last_peered":"2024-09-10T05:59:01.975529+0000","last_clean":"2024-09-10T05:59:01.975529+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:59:01.975529+0000","last_undegraded":"2024-09-10T05:59:01.975529+0000","last_fullsized":"2024-09-10T05:59:01.975529+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:58.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"133'26","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.008675+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:59:09.008675+0000","last_peered":"2024-09-10T05:59:09.008675+0000","last_clean":"2024-09-10T05:59:09.008675+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:59:09.008675+0000","last_undegraded":"2024-09-10T05:59:09.008675+0000","last_fullsized":"2024-09-10T05:59:09.008675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"133'145","reported_seq":351,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.974998+0000","last_change":"2024-09-10T05:58:42.104842+0000","last_active":"2024-09-10T05:59:07.974998+0000","last_peered":"2024-09-10T05:59:07.974998+0000","last_clean":"2024-09-10T05:59:07.974998+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:59:07.974998+0000","last_undegraded":"2024-09-10T05:59:07.974998+0000","last_fullsized":"2024-09-10T05:59:07.974998+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:06.712578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980182+0000","last_change":"2024-09-10T05:55:24.555752+0000","last_active":"2024-09-10T05:59:01.980182+0000","last_peered":"2024-09-10T05:59:01.980182+0000","last_clean":"2024-09-10T05:59:01.980182+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:59:01.980182+0000","last_undegraded":"2024-09-10T05:59:01.980182+0000","last_fullsized":"2024-09-10T05:59:01.980182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:44.192933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"133'54","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.886373+0000","last_change":"2024-09-10T05:55:22.574518+0000","last_active":"2024-09-10T05:59:08.886373+0000","last_peered":"2024-09-10T05:59:08.886373+0000","last_clean":"2024-09-10T05:59:08.886373+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:59:08.886373+0000","last_undegraded":"2024-09-10T05:59:08.886373+0000","last_fullsized":"2024-09-10T05:59:08.886373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:44.979803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969010+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:59:01.969010+0000","last_peered":"2024-09-10T05:59:01.969010+0000","last_clean":"2024-09-10T05:59:01.969010+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:59:01.969010+0000","last_undegraded":"2024-09-10T05:59:01.969010+0000","last_fullsized":"2024-09-10T05:59:01.969010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"133'39","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.048271+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:59:09.048271+0000","last_peered":"2024-09-10T05:59:09.048271+0000","last_clean":"2024-09-10T05:59:09.048271+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:59:09.048271+0000","last_undegraded":"2024-09-10T05:59:09.048271+0000","last_fullsized":"2024-09-10T05:59:09.048271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969386+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:59:01.969386+0000","last_peered":"2024-09-10T05:59:01.969386+0000","last_clean":"2024-09-10T05:59:01.969386+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:59:01.969386+0000","last_undegraded":"2024-09-10T05:59:01.969386+0000","last_fullsized":"2024-09-10T05:59:01.969386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975163+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:59:01.975163+0000","last_peered":"2024-09-10T05:59:01.975163+0000","last_clean":"2024-09-10T05:59:01.975163+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:59:01.975163+0000","last_undegraded":"2024-09-10T05:59:01.975163+0000","last_fullsized":"2024-09-10T05:59:01.975163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812553+0000","last_change":"2024-09-10T05:55:24.578622+0000","last_active":"2024-09-10T05:59:01.812553+0000","last_peered":"2024-09-10T05:59:01.812553+0000","last_clean":"2024-09-10T05:59:01.812553+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:59:01.812553+0000","last_undegraded":"2024-09-10T05:59:01.812553+0000","last_fullsized":"2024-09-10T05:59:01.812553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:01.434349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"133'42","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.966429+0000","last_change":"2024-09-10T05:55:22.571486+0000","last_active":"2024-09-10T05:59:08.966429+0000","last_peered":"2024-09-10T05:59:08.966429+0000","last_clean":"2024-09-10T05:59:08.966429+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:59:08.966429+0000","last_undegraded":"2024-09-10T05:59:08.966429+0000","last_fullsized":"2024-09-10T05:59:08.966429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816319+0000","last_change":"2024-09-10T05:55:26.566141+0000","last_active":"2024-09-10T05:59:01.816319+0000","last_peered":"2024-09-10T05:59:01.816319+0000","last_clean":"2024-09-10T05:59:01.816319+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:59:01.816319+0000","last_undegraded":"2024-09-10T05:59:01.816319+0000","last_fullsized":"2024-09-10T05:59:01.816319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:37.613897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"133'26","reported_seq":63,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.564810+0000","last_change":"2024-09-10T05:58:41.124218+0000","last_active":"2024-09-10T05:59:08.564810+0000","last_peered":"2024-09-10T05:59:08.564810+0000","last_clean":"2024-09-10T05:59:08.564810+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:59:08.564810+0000","last_undegraded":"2024-09-10T05:59:08.564810+0000","last_fullsized":"2024-09-10T05:59:08.564810+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:13.232943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823296+0000","last_change":"2024-09-10T05:58:36.068634+0000","last_active":"2024-09-10T05:59:01.823296+0000","last_peered":"2024-09-10T05:59:01.823296+0000","last_clean":"2024-09-10T05:59:01.823296+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:59:01.823296+0000","last_undegraded":"2024-09-10T05:59:01.823296+0000","last_fullsized":"2024-09-10T05:59:01.823296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:54.848895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977060+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:59:01.977060+0000","last_peered":"2024-09-10T05:59:01.977060+0000","last_clean":"2024-09-10T05:59:01.977060+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:59:01.977060+0000","last_undegraded":"2024-09-10T05:59:01.977060+0000","last_fullsized":"2024-09-10T05:59:01.977060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974434+0000","last_change":"2024-09-10T05:55:24.572147+0000","last_active":"2024-09-10T05:59:01.974434+0000","last_peered":"2024-09-10T05:59:01.974434+0000","last_clean":"2024-09-10T05:59:01.974434+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:59:01.974434+0000","last_undegraded":"2024-09-10T05:59:01.974434+0000","last_fullsized":"2024-09-10T05:59:01.974434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:51.634599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"133'46","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.945045+0000","last_change":"2024-09-10T05:55:22.573532+0000","last_active":"2024-09-10T05:59:08.945045+0000","last_peered":"2024-09-10T05:59:08.945045+0000","last_clean":"2024-09-10T05:59:08.945045+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:59:08.945045+0000","last_undegraded":"2024-09-10T05:59:08.945045+0000","last_fullsized":"2024-09-10T05:59:08.945045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818189+0000","last_change":"2024-09-10T05:55:26.570136+0000","last_active":"2024-09-10T05:59:01.818189+0000","last_peered":"2024-09-10T05:59:01.818189+0000","last_clean":"2024-09-10T05:59:01.818189+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:59:01.818189+0000","last_undegraded":"2024-09-10T05:59:01.818189+0000","last_fullsized":"2024-09-10T05:59:01.818189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:18.975159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"133'38","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.065568+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:59:08.065568+0000","last_peered":"2024-09-10T05:59:08.065568+0000","last_clean":"2024-09-10T05:59:08.065568+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:59:08.065568+0000","last_undegraded":"2024-09-10T05:59:08.065568+0000","last_fullsized":"2024-09-10T05:59:08.065568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"133'138","reported_seq":468,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.976502+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:59:07.976502+0000","last_peered":"2024-09-10T05:59:07.976502+0000","last_clean":"2024-09-10T05:59:07.976502+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:59:07.976502+0000","last_undegraded":"2024-09-10T05:59:07.976502+0000","last_fullsized":"2024-09-10T05:59:07.976502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815295+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:59:01.815295+0000","last_peered":"2024-09-10T05:59:01.815295+0000","last_clean":"2024-09-10T05:59:01.815295+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:59:01.815295+0000","last_undegraded":"2024-09-10T05:59:01.815295+0000","last_fullsized":"2024-09-10T05:59:01.815295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814879+0000","last_change":"2024-09-10T05:55:24.580620+0000","last_active":"2024-09-10T05:59:01.814879+0000","last_peered":"2024-09-10T05:59:01.814879+0000","last_clean":"2024-09-10T05:59:01.814879+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:59:01.814879+0000","last_undegraded":"2024-09-10T05:59:01.814879+0000","last_fullsized":"2024-09-10T05:59:01.814879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"133'24","reported_seq":202,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.859929+0000","last_change":"2024-09-10T05:58:38.085546+0000","last_active":"2024-09-10T05:59:08.859929+0000","last_peered":"2024-09-10T05:59:08.859929+0000","last_clean":"2024-09-10T05:59:08.859929+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:59:08.859929+0000","last_undegraded":"2024-09-10T05:59:08.859929+0000","last_fullsized":"2024-09-10T05:59:08.859929+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:10.893758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817040+0000","last_change":"2024-09-10T05:55:26.572296+0000","last_active":"2024-09-10T05:59:01.817040+0000","last_peered":"2024-09-10T05:59:01.817040+0000","last_clean":"2024-09-10T05:59:01.817040+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:59:01.817040+0000","last_undegraded":"2024-09-10T05:59:01.817040+0000","last_fullsized":"2024-09-10T05:59:01.817040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:56.937618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"133'46","reported_seq":292,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.576565+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:59:08.576565+0000","last_peered":"2024-09-10T05:59:08.576565+0000","last_clean":"2024-09-10T05:59:08.576565+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:59:08.576565+0000","last_undegraded":"2024-09-10T05:59:08.576565+0000","last_fullsized":"2024-09-10T05:59:08.576565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816028+0000","last_change":"2024-09-10T05:55:30.608409+0000","last_active":"2024-09-10T05:59:01.816028+0000","last_peered":"2024-09-10T05:59:01.816028+0000","last_clean":"2024-09-10T05:59:01.816028+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:59:01.816028+0000","last_undegraded":"2024-09-10T05:59:01.816028+0000","last_fullsized":"2024-09-10T05:59:01.816028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:36.900678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970802+0000","last_change":"2024-09-10T05:58:39.385287+0000","last_active":"2024-09-10T05:59:01.970802+0000","last_peered":"2024-09-10T05:59:01.970802+0000","last_clean":"2024-09-10T05:59:01.970802+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:59:01.970802+0000","last_undegraded":"2024-09-10T05:59:01.970802+0000","last_fullsized":"2024-09-10T05:59:01.970802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:27.225607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814320+0000","last_change":"2024-09-10T05:58:40.751831+0000","last_active":"2024-09-10T05:59:01.814320+0000","last_peered":"2024-09-10T05:59:01.814320+0000","last_clean":"2024-09-10T05:59:01.814320+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:59:01.814320+0000","last_undegraded":"2024-09-10T05:59:01.814320+0000","last_fullsized":"2024-09-10T05:59:01.814320+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:32.405571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"133'54","reported_seq":127,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.820994+0000","last_change":"2024-09-10T05:58:38.720733+0000","last_active":"2024-09-10T05:59:08.820994+0000","last_peered":"2024-09-10T05:59:08.820994+0000","last_clean":"2024-09-10T05:59:08.820994+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:59:08.820994+0000","last_undegraded":"2024-09-10T05:59:08.820994+0000","last_fullsized":"2024-09-10T05:59:08.820994+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:07.402320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817160+0000","last_change":"2024-09-10T05:55:26.578260+0000","last_active":"2024-09-10T05:59:01.817160+0000","last_peered":"2024-09-10T05:59:01.817160+0000","last_clean":"2024-09-10T05:59:01.817160+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:59:01.817160+0000","last_undegraded":"2024-09-10T05:59:01.817160+0000","last_fullsized":"2024-09-10T05:59:01.817160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:35.824993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"133'32","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.847554+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:59:08.847554+0000","last_peered":"2024-09-10T05:59:08.847554+0000","last_clean":"2024-09-10T05:59:08.847554+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:59:08.847554+0000","last_undegraded":"2024-09-10T05:59:08.847554+0000","last_fullsized":"2024-09-10T05:59:08.847554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":264,"num_write":24,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815733+0000","last_change":"2024-09-10T05:58:36.081028+0000","last_active":"2024-09-10T05:59:01.815733+0000","last_peered":"2024-09-10T05:59:01.815733+0000","last_clean":"2024-09-10T05:59:01.815733+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:59:01.815733+0000","last_undegraded":"2024-09-10T05:59:01.815733+0000","last_fullsized":"2024-09-10T05:59:01.815733+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:17.752342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822644+0000","last_change":"2024-09-10T05:58:42.021549+0000","last_active":"2024-09-10T05:59:01.822644+0000","last_peered":"2024-09-10T05:59:01.822644+0000","last_clean":"2024-09-10T05:59:01.822644+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:59:01.822644+0000","last_undegraded":"2024-09-10T05:59:01.822644+0000","last_fullsized":"2024-09-10T05:59:01.822644+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:23.621053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814696+0000","last_change":"2024-09-10T05:55:24.556055+0000","last_active":"2024-09-10T05:59:01.814696+0000","last_peered":"2024-09-10T05:59:01.814696+0000","last_clean":"2024-09-10T05:59:01.814696+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:59:01.814696+0000","last_undegraded":"2024-09-10T05:59:01.814696+0000","last_fullsized":"2024-09-10T05:59:01.814696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:17.191564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"133'50","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.984303+0000","last_change":"2024-09-10T05:55:22.548559+0000","last_active":"2024-09-10T05:59:08.984303+0000","last_peered":"2024-09-10T05:59:08.984303+0000","last_clean":"2024-09-10T05:59:08.984303+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:59:08.984303+0000","last_undegraded":"2024-09-10T05:59:08.984303+0000","last_fullsized":"2024-09-10T05:59:08.984303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.777607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969798+0000","last_change":"2024-09-10T05:55:26.578689+0000","last_active":"2024-09-10T05:59:01.969798+0000","last_peered":"2024-09-10T05:59:01.969798+0000","last_clean":"2024-09-10T05:59:01.969798+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:59:01.969798+0000","last_undegraded":"2024-09-10T05:59:01.969798+0000","last_fullsized":"2024-09-10T05:59:01.969798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:08.810748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"133'26","reported_seq":343,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.275256+0000","last_change":"2024-09-10T05:58:40.714764+0000","last_active":"2024-09-10T05:59:08.275256+0000","last_peered":"2024-09-10T05:59:08.275256+0000","last_clean":"2024-09-10T05:59:08.275256+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:59:08.275256+0000","last_undegraded":"2024-09-10T05:59:08.275256+0000","last_fullsized":"2024-09-10T05:59:08.275256+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:22:27.289268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"133'138","reported_seq":405,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.971060+0000","last_change":"2024-09-10T05:55:30.621878+0000","last_active":"2024-09-10T05:59:07.971060+0000","last_peered":"2024-09-10T05:59:07.971060+0000","last_clean":"2024-09-10T05:59:07.971060+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:59:07.971060+0000","last_undegraded":"2024-09-10T05:59:07.971060+0000","last_fullsized":"2024-09-10T05:59:07.971060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:46.804589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969247+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:59:01.969247+0000","last_peered":"2024-09-10T05:59:01.969247+0000","last_clean":"2024-09-10T05:59:01.969247+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:59:01.969247+0000","last_undegraded":"2024-09-10T05:59:01.969247+0000","last_fullsized":"2024-09-10T05:59:01.969247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815015+0000","last_change":"2024-09-10T05:55:24.579510+0000","last_active":"2024-09-10T05:59:01.815015+0000","last_peered":"2024-09-10T05:59:01.815015+0000","last_clean":"2024-09-10T05:59:01.815015+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:59:01.815015+0000","last_undegraded":"2024-09-10T05:59:01.815015+0000","last_fullsized":"2024-09-10T05:59:01.815015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:11.186472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"133'46","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.956891+0000","last_change":"2024-09-10T05:55:22.528803+0000","last_active":"2024-09-10T05:59:08.956891+0000","last_peered":"2024-09-10T05:59:08.956891+0000","last_clean":"2024-09-10T05:59:08.956891+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:59:08.956891+0000","last_undegraded":"2024-09-10T05:59:08.956891+0000","last_fullsized":"2024-09-10T05:59:08.956891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:17.632753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":402,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.934237+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:59:07.934237+0000","last_peered":"2024-09-10T05:59:07.934237+0000","last_clean":"2024-09-10T05:59:07.934237+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:59:07.934237+0000","last_undegraded":"2024-09-10T05:59:07.934237+0000","last_fullsized":"2024-09-10T05:59:07.934237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824969+0000","last_change":"2024-09-10T05:58:37.286390+0000","last_active":"2024-09-10T05:59:01.824969+0000","last_peered":"2024-09-10T05:59:01.824969+0000","last_clean":"2024-09-10T05:59:01.824969+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:59:01.824969+0000","last_undegraded":"2024-09-10T05:59:01.824969+0000","last_fullsized":"2024-09-10T05:59:01.824969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:08.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"133'138","reported_seq":437,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.972499+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:59:07.972499+0000","last_peered":"2024-09-10T05:59:07.972499+0000","last_clean":"2024-09-10T05:59:07.972499+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:59:07.972499+0000","last_undegraded":"2024-09-10T05:59:07.972499+0000","last_fullsized":"2024-09-10T05:59:07.972499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812864+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:59:01.812864+0000","last_peered":"2024-09-10T05:59:01.812864+0000","last_clean":"2024-09-10T05:59:01.812864+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:59:01.812864+0000","last_undegraded":"2024-09-10T05:59:01.812864+0000","last_fullsized":"2024-09-10T05:59:01.812864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":88,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976229+0000","last_change":"2024-09-10T05:58:40.805304+0000","last_active":"2024-09-10T05:59:01.976229+0000","last_peered":"2024-09-10T05:59:01.976229+0000","last_clean":"2024-09-10T05:59:01.976229+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:59:01.976229+0000","last_undegraded":"2024-09-10T05:59:01.976229+0000","last_fullsized":"2024-09-10T05:59:01.976229+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:26.888956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"133'44","reported_seq":112,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.913522+0000","last_change":"2024-09-10T05:58:41.608913+0000","last_active":"2024-09-10T05:59:08.913522+0000","last_peered":"2024-09-10T05:59:08.913522+0000","last_clean":"2024-09-10T05:59:08.913522+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:59:08.913522+0000","last_undegraded":"2024-09-10T05:59:08.913522+0000","last_fullsized":"2024-09-10T05:59:08.913522+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:15.544218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814783+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:59:01.814783+0000","last_peered":"2024-09-10T05:59:01.814783+0000","last_clean":"2024-09-10T05:59:01.814783+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:59:01.814783+0000","last_undegraded":"2024-09-10T05:59:01.814783+0000","last_fullsized":"2024-09-10T05:59:01.814783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"133'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.033186+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:59:09.033186+0000","last_peered":"2024-09-10T05:59:09.033186+0000","last_clean":"2024-09-10T05:59:09.033186+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:59:09.033186+0000","last_undegraded":"2024-09-10T05:59:09.033186+0000","last_fullsized":"2024-09-10T05:59:09.033186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975062+0000","last_change":"2024-09-10T05:58:36.080814+0000","last_active":"2024-09-10T05:59:01.975062+0000","last_peered":"2024-09-10T05:59:01.975062+0000","last_clean":"2024-09-10T05:59:01.975062+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:59:01.975062+0000","last_undegraded":"2024-09-10T05:59:01.975062+0000","last_fullsized":"2024-09-10T05:59:01.975062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:12.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969254+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:59:01.969254+0000","last_peered":"2024-09-10T05:59:01.969254+0000","last_clean":"2024-09-10T05:59:01.969254+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:59:01.969254+0000","last_undegraded":"2024-09-10T05:59:01.969254+0000","last_fullsized":"2024-09-10T05:59:01.969254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978032+0000","last_change":"2024-09-10T05:55:24.584530+0000","last_active":"2024-09-10T05:59:01.978032+0000","last_peered":"2024-09-10T05:59:01.978032+0000","last_clean":"2024-09-10T05:59:01.978032+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:59:01.978032+0000","last_undegraded":"2024-09-10T05:59:01.978032+0000","last_fullsized":"2024-09-10T05:59:01.978032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:34.553980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":334,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970038+0000","last_change":"2024-09-10T05:55:08.800557+0000","last_active":"2024-09-10T05:59:01.970038+0000","last_peered":"2024-09-10T05:59:01.970038+0000","last_clean":"2024-09-10T05:59:01.970038+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:59:01.970038+0000","last_undegraded":"2024-09-10T05:59:01.970038+0000","last_fullsized":"2024-09-10T05:59:01.970038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:05.959922+0000","last_clean_scrub_stamp":"2024-09-10T05:55:05.959922+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:04.040009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973650+0000","last_change":"2024-09-10T05:55:14.260381+0000","last_active":"2024-09-10T05:59:01.973650+0000","last_peered":"2024-09-10T05:59:01.973650+0000","last_clean":"2024-09-10T05:59:01.973650+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:59:01.973650+0000","last_undegraded":"2024-09-10T05:59:01.973650+0000","last_fullsized":"2024-09-10T05:59:01.973650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:00.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"133'56","reported_seq":130,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.890114+0000","last_change":"2024-09-10T05:58:38.110183+0000","last_active":"2024-09-10T05:59:08.890114+0000","last_peered":"2024-09-10T05:59:08.890114+0000","last_clean":"2024-09-10T05:59:08.890114+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:59:08.890114+0000","last_undegraded":"2024-09-10T05:59:08.890114+0000","last_fullsized":"2024-09-10T05:59:08.890114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:21.156258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970305+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:59:01.970305+0000","last_peered":"2024-09-10T05:59:01.970305+0000","last_clean":"2024-09-10T05:59:01.970305+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:59:01.970305+0000","last_undegraded":"2024-09-10T05:59:01.970305+0000","last_fullsized":"2024-09-10T05:59:01.970305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"133'52","reported_seq":378,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.040306+0000","last_change":"2024-09-10T05:58:40.775802+0000","last_active":"2024-09-10T05:59:09.040306+0000","last_peered":"2024-09-10T05:59:09.040306+0000","last_clean":"2024-09-10T05:59:09.040306+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:59:09.040306+0000","last_undegraded":"2024-09-10T05:59:09.040306+0000","last_fullsized":"2024-09-10T05:59:09.040306+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.223922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815484+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:59:01.815484+0000","last_peered":"2024-09-10T05:59:01.815484+0000","last_clean":"2024-09-10T05:59:01.815484+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:59:01.815484+0000","last_undegraded":"2024-09-10T05:59:01.815484+0000","last_fullsized":"2024-09-10T05:59:01.815484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973038+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:59:01.973038+0000","last_peered":"2024-09-10T05:59:01.973038+0000","last_clean":"2024-09-10T05:59:01.973038+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:59:01.973038+0000","last_undegraded":"2024-09-10T05:59:01.973038+0000","last_fullsized":"2024-09-10T05:59:01.973038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815904+0000","last_change":"2024-09-10T05:55:24.565408+0000","last_active":"2024-09-10T05:59:01.815904+0000","last_peered":"2024-09-10T05:59:01.815904+0000","last_clean":"2024-09-10T05:59:01.815904+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:59:01.815904+0000","last_undegraded":"2024-09-10T05:59:01.815904+0000","last_fullsized":"2024-09-10T05:59:01.815904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:53.289482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969288+0000","last_change":"2024-09-10T05:55:14.909715+0000","last_active":"2024-09-10T05:59:01.969288+0000","last_peered":"2024-09-10T05:59:01.969288+0000","last_clean":"2024-09-10T05:59:01.969288+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:59:01.969288+0000","last_undegraded":"2024-09-10T05:59:01.969288+0000","last_fullsized":"2024-09-10T05:59:01.969288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:32.395483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"133'38","reported_seq":265,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.931842+0000","last_change":"2024-09-10T05:55:22.566543+0000","last_active":"2024-09-10T05:59:08.931842+0000","last_peered":"2024-09-10T05:59:08.931842+0000","last_clean":"2024-09-10T05:59:08.931842+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:59:08.931842+0000","last_undegraded":"2024-09-10T05:59:08.931842+0000","last_fullsized":"2024-09-10T05:59:08.931842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:40.620851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979956+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:59:01.979956+0000","last_peered":"2024-09-10T05:59:01.979956+0000","last_clean":"2024-09-10T05:59:01.979956+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:59:01.979956+0000","last_undegraded":"2024-09-10T05:59:01.979956+0000","last_fullsized":"2024-09-10T05:59:01.979956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"133'155","reported_seq":491,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.038047+0000","last_change":"2024-09-10T05:55:28.586086+0000","last_active":"2024-09-10T05:59:09.038047+0000","last_peered":"2024-09-10T05:59:09.038047+0000","last_clean":"2024-09-10T05:59:09.038047+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:59:09.038047+0000","last_undegraded":"2024-09-10T05:59:09.038047+0000","last_fullsized":"2024-09-10T05:59:09.038047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:58.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":209,"num_read_kb":199,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970038+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:59:01.970038+0000","last_peered":"2024-09-10T05:59:01.970038+0000","last_clean":"2024-09-10T05:59:01.970038+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:59:01.970038+0000","last_undegraded":"2024-09-10T05:59:01.970038+0000","last_fullsized":"2024-09-10T05:59:01.970038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969029+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:59:01.969029+0000","last_peered":"2024-09-10T05:59:01.969029+0000","last_clean":"2024-09-10T05:59:01.969029+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:59:01.969029+0000","last_undegraded":"2024-09-10T05:59:01.969029+0000","last_fullsized":"2024-09-10T05:59:01.969029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971269+0000","last_change":"2024-09-10T05:55:24.561246+0000","last_active":"2024-09-10T05:59:01.971269+0000","last_peered":"2024-09-10T05:59:01.971269+0000","last_clean":"2024-09-10T05:59:01.971269+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:59:01.971269+0000","last_undegraded":"2024-09-10T05:59:01.971269+0000","last_fullsized":"2024-09-10T05:59:01.971269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816763+0000","last_change":"2024-09-10T05:58:36.063964+0000","last_active":"2024-09-10T05:59:01.816763+0000","last_peered":"2024-09-10T05:59:01.816763+0000","last_clean":"2024-09-10T05:59:01.816763+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:59:01.816763+0000","last_undegraded":"2024-09-10T05:59:01.816763+0000","last_fullsized":"2024-09-10T05:59:01.816763+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:53.613158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"133'44","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.964102+0000","last_change":"2024-09-10T05:55:22.555314+0000","last_active":"2024-09-10T05:59:08.964102+0000","last_peered":"2024-09-10T05:59:08.964102+0000","last_clean":"2024-09-10T05:59:08.964102+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:59:08.964102+0000","last_undegraded":"2024-09-10T05:59:08.964102+0000","last_fullsized":"2024-09-10T05:59:08.964102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:49.537730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817645+0000","last_change":"2024-09-10T05:55:26.578067+0000","last_active":"2024-09-10T05:59:01.817645+0000","last_peered":"2024-09-10T05:59:01.817645+0000","last_clean":"2024-09-10T05:59:01.817645+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:59:01.817645+0000","last_undegraded":"2024-09-10T05:59:01.817645+0000","last_fullsized":"2024-09-10T05:59:01.817645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:19.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"131'16","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970890+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:59:01.970890+0000","last_peered":"2024-09-10T05:59:01.970890+0000","last_clean":"2024-09-10T05:59:01.970890+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:59:01.970890+0000","last_undegraded":"2024-09-10T05:59:01.970890+0000","last_fullsized":"2024-09-10T05:59:01.970890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814189+0000","last_change":"2024-09-10T05:55:30.618053+0000","last_active":"2024-09-10T05:59:01.814189+0000","last_peered":"2024-09-10T05:59:01.814189+0000","last_clean":"2024-09-10T05:59:01.814189+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:59:01.814189+0000","last_undegraded":"2024-09-10T05:59:01.814189+0000","last_fullsized":"2024-09-10T05:59:01.814189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:30.667865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825738+0000","last_change":"2024-09-10T05:58:36.090394+0000","last_active":"2024-09-10T05:59:01.825738+0000","last_peered":"2024-09-10T05:59:01.825738+0000","last_clean":"2024-09-10T05:59:01.825738+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:59:01.825738+0000","last_undegraded":"2024-09-10T05:59:01.825738+0000","last_fullsized":"2024-09-10T05:59:01.825738+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:49.622437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970102+0000","last_change":"2024-09-10T05:55:24.582397+0000","last_active":"2024-09-10T05:59:01.970102+0000","last_peered":"2024-09-10T05:59:01.970102+0000","last_clean":"2024-09-10T05:59:01.970102+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:59:01.970102+0000","last_undegraded":"2024-09-10T05:59:01.970102+0000","last_fullsized":"2024-09-10T05:59:01.970102+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:34.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975334+0000","last_change":"2024-09-10T05:55:14.261442+0000","last_active":"2024-09-10T05:59:01.975334+0000","last_peered":"2024-09-10T05:59:01.975334+0000","last_clean":"2024-09-10T05:59:01.975334+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:59:01.975334+0000","last_undegraded":"2024-09-10T05:59:01.975334+0000","last_fullsized":"2024-09-10T05:59:01.975334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:52.039169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"133'70","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.961435+0000","last_change":"2024-09-10T05:55:22.544853+0000","last_active":"2024-09-10T05:59:08.961435+0000","last_peered":"2024-09-10T05:59:08.961435+0000","last_clean":"2024-09-10T05:59:08.961435+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:59:08.961435+0000","last_undegraded":"2024-09-10T05:59:08.961435+0000","last_fullsized":"2024-09-10T05:59:08.961435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:07.190028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814731+0000","last_change":"2024-09-10T05:55:26.567183+0000","last_active":"2024-09-10T05:59:01.814731+0000","last_peered":"2024-09-10T05:59:01.814731+0000","last_clean":"2024-09-10T05:59:01.814731+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:59:01.814731+0000","last_undegraded":"2024-09-10T05:59:01.814731+0000","last_fullsized":"2024-09-10T05:59:01.814731+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:13.199200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825316+0000","last_change":"2024-09-10T05:58:37.301597+0000","last_active":"2024-09-10T05:59:01.825316+0000","last_peered":"2024-09-10T05:59:01.825316+0000","last_clean":"2024-09-10T05:59:01.825316+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:59:01.825316+0000","last_undegraded":"2024-09-10T05:59:01.825316+0000","last_fullsized":"2024-09-10T05:59:01.825316+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:30.282821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978658+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:59:01.978658+0000","last_peered":"2024-09-10T05:59:01.978658+0000","last_clean":"2024-09-10T05:59:01.978658+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:59:01.978658+0000","last_undegraded":"2024-09-10T05:59:01.978658+0000","last_fullsized":"2024-09-10T05:59:01.978658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971389+0000","last_change":"2024-09-10T05:58:40.735106+0000","last_active":"2024-09-10T05:59:01.971389+0000","last_peered":"2024-09-10T05:59:01.971389+0000","last_clean":"2024-09-10T05:59:01.971389+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:59:01.971389+0000","last_undegraded":"2024-09-10T05:59:01.971389+0000","last_fullsized":"2024-09-10T05:59:01.971389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:08.686783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":197,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.816305+0000","last_change":"2024-09-10T05:55:59.081902+0000","last_active":"2024-09-10T05:59:01.816305+0000","last_peered":"2024-09-10T05:59:01.816305+0000","last_clean":"2024-09-10T05:59:01.816305+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:59:01.816305+0000","last_undegraded":"2024-09-10T05:59:01.816305+0000","last_fullsized":"2024-09-10T05:59:01.816305+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:17.852810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"133'50","reported_seq":356,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.841600+0000","last_change":"2024-09-10T05:58:39.363982+0000","last_active":"2024-09-10T05:59:08.841600+0000","last_peered":"2024-09-10T05:59:08.841600+0000","last_clean":"2024-09-10T05:59:08.841600+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:59:08.841600+0000","last_undegraded":"2024-09-10T05:59:08.841600+0000","last_fullsized":"2024-09-10T05:59:08.841600+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:12.162443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970391+0000","last_change":"2024-09-10T05:55:14.267290+0000","last_active":"2024-09-10T05:59:01.970391+0000","last_peered":"2024-09-10T05:59:01.970391+0000","last_clean":"2024-09-10T05:59:01.970391+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:59:01.970391+0000","last_undegraded":"2024-09-10T05:59:01.970391+0000","last_fullsized":"2024-09-10T05:59:01.970391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:28.288331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":311,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.921867+0000","last_change":"2024-09-10T05:55:26.570539+0000","last_active":"2024-09-10T05:59:07.921867+0000","last_peered":"2024-09-10T05:59:07.921867+0000","last_clean":"2024-09-10T05:59:07.921867+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:59:07.921867+0000","last_undegraded":"2024-09-10T05:59:07.921867+0000","last_fullsized":"2024-09-10T05:59:07.921867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:57.409691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"133'53","reported_seq":414,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.011961+0000","last_change":"2024-09-10T05:58:39.382781+0000","last_active":"2024-09-10T05:59:09.011961+0000","last_peered":"2024-09-10T05:59:09.011961+0000","last_clean":"2024-09-10T05:59:09.011961+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:59:09.011961+0000","last_undegraded":"2024-09-10T05:59:09.011961+0000","last_fullsized":"2024-09-10T05:59:09.011961+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:54.079756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":50,"num_write":36,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812156+0000","last_change":"2024-09-10T05:58:36.065033+0000","last_active":"2024-09-10T05:59:01.812156+0000","last_peered":"2024-09-10T05:59:01.812156+0000","last_clean":"2024-09-10T05:59:01.812156+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:59:01.812156+0000","last_undegraded":"2024-09-10T05:59:01.812156+0000","last_fullsized":"2024-09-10T05:59:01.812156+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.563276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814898+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:59:01.814898+0000","last_peered":"2024-09-10T05:59:01.814898+0000","last_clean":"2024-09-10T05:59:01.814898+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:59:01.814898+0000","last_undegraded":"2024-09-10T05:59:01.814898+0000","last_fullsized":"2024-09-10T05:59:01.814898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":232,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814807+0000","last_change":"2024-09-10T05:55:24.562196+0000","last_active":"2024-09-10T05:59:01.814807+0000","last_peered":"2024-09-10T05:59:01.814807+0000","last_clean":"2024-09-10T05:59:01.814807+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:59:01.814807+0000","last_undegraded":"2024-09-10T05:59:01.814807+0000","last_fullsized":"2024-09-10T05:59:01.814807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:33:03.507189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"133'62","reported_seq":288,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.964608+0000","last_change":"2024-09-10T05:55:22.554969+0000","last_active":"2024-09-10T05:59:08.964608+0000","last_peered":"2024-09-10T05:59:08.964608+0000","last_clean":"2024-09-10T05:59:08.964608+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:59:08.964608+0000","last_undegraded":"2024-09-10T05:59:08.964608+0000","last_fullsized":"2024-09-10T05:59:08.964608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:08.469677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972249+0000","last_change":"2024-09-10T05:55:14.909663+0000","last_active":"2024-09-10T05:59:01.972249+0000","last_peered":"2024-09-10T05:59:01.972249+0000","last_clean":"2024-09-10T05:59:01.972249+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:59:01.972249+0000","last_undegraded":"2024-09-10T05:59:01.972249+0000","last_fullsized":"2024-09-10T05:59:01.972249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:53:57.106928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973885+0000","last_change":"2024-09-10T05:55:26.570288+0000","last_active":"2024-09-10T05:59:01.973885+0000","last_peered":"2024-09-10T05:59:01.973885+0000","last_clean":"2024-09-10T05:59:01.973885+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:59:01.973885+0000","last_undegraded":"2024-09-10T05:59:01.973885+0000","last_fullsized":"2024-09-10T05:59:01.973885+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:03.248205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968759+0000","last_change":"2024-09-10T05:55:28.614945+0000","last_active":"2024-09-10T05:59:01.968759+0000","last_peered":"2024-09-10T05:59:01.968759+0000","last_clean":"2024-09-10T05:59:01.968759+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:59:01.968759+0000","last_undegraded":"2024-09-10T05:59:01.968759+0000","last_fullsized":"2024-09-10T05:59:01.968759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:18.157579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"133'138","reported_seq":389,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.966027+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:59:07.966027+0000","last_peered":"2024-09-10T05:59:07.966027+0000","last_clean":"2024-09-10T05:59:07.966027+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:59:07.966027+0000","last_undegraded":"2024-09-10T05:59:07.966027+0000","last_fullsized":"2024-09-10T05:59:07.966027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:15.754213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825935+0000","last_change":"2024-09-10T05:58:40.566181+0000","last_active":"2024-09-10T05:59:01.825935+0000","last_peered":"2024-09-10T05:59:01.825935+0000","last_clean":"2024-09-10T05:59:01.825935+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:59:01.825935+0000","last_undegraded":"2024-09-10T05:59:01.825935+0000","last_fullsized":"2024-09-10T05:59:01.825935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.161299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823699+0000","last_change":"2024-09-10T05:58:38.725304+0000","last_active":"2024-09-10T05:59:01.823699+0000","last_peered":"2024-09-10T05:59:01.823699+0000","last_clean":"2024-09-10T05:59:01.823699+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:59:01.823699+0000","last_undegraded":"2024-09-10T05:59:01.823699+0000","last_fullsized":"2024-09-10T05:59:01.823699+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:37.191390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"133'44","reported_seq":112,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.857077+0000","last_change":"2024-09-10T05:58:41.098579+0000","last_active":"2024-09-10T05:59:08.857077+0000","last_peered":"2024-09-10T05:59:08.857077+0000","last_clean":"2024-09-10T05:59:08.857077+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:59:08.857077+0000","last_undegraded":"2024-09-10T05:59:08.857077+0000","last_fullsized":"2024-09-10T05:59:08.857077+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:26.154411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971162+0000","last_change":"2024-09-10T05:55:14.267516+0000","last_active":"2024-09-10T05:59:01.971162+0000","last_peered":"2024-09-10T05:59:01.971162+0000","last_clean":"2024-09-10T05:59:01.971162+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:59:01.971162+0000","last_undegraded":"2024-09-10T05:59:01.971162+0000","last_fullsized":"2024-09-10T05:59:01.971162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:22:01.244375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812454+0000","last_change":"2024-09-10T05:58:36.065339+0000","last_active":"2024-09-10T05:59:01.812454+0000","last_peered":"2024-09-10T05:59:01.812454+0000","last_clean":"2024-09-10T05:59:01.812454+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:59:01.812454+0000","last_undegraded":"2024-09-10T05:59:01.812454+0000","last_fullsized":"2024-09-10T05:59:01.812454+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:58.311550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813201+0000","last_change":"2024-09-10T05:58:39.400842+0000","last_active":"2024-09-10T05:59:01.813201+0000","last_peered":"2024-09-10T05:59:01.813201+0000","last_clean":"2024-09-10T05:59:01.813201+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:59:01.813201+0000","last_undegraded":"2024-09-10T05:59:01.813201+0000","last_fullsized":"2024-09-10T05:59:01.813201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:57.886787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"133'145","reported_seq":324,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.973482+0000","last_change":"2024-09-10T05:58:42.102476+0000","last_active":"2024-09-10T05:59:07.973482+0000","last_peered":"2024-09-10T05:59:07.973482+0000","last_clean":"2024-09-10T05:59:07.973482+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:59:07.973482+0000","last_undegraded":"2024-09-10T05:59:07.973482+0000","last_fullsized":"2024-09-10T05:59:07.973482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:33.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814423+0000","last_change":"2024-09-10T05:58:36.071317+0000","last_active":"2024-09-10T05:59:01.814423+0000","last_peered":"2024-09-10T05:59:01.814423+0000","last_clean":"2024-09-10T05:59:01.814423+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:59:01.814423+0000","last_undegraded":"2024-09-10T05:59:01.814423+0000","last_fullsized":"2024-09-10T05:59:01.814423+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:36.078639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812728+0000","last_change":"2024-09-10T05:55:24.576781+0000","last_active":"2024-09-10T05:59:01.812728+0000","last_peered":"2024-09-10T05:59:01.812728+0000","last_clean":"2024-09-10T05:59:01.812728+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:59:01.812728+0000","last_undegraded":"2024-09-10T05:59:01.812728+0000","last_fullsized":"2024-09-10T05:59:01.812728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:30.852811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"133'42","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.910283+0000","last_change":"2024-09-10T05:55:22.549441+0000","last_active":"2024-09-10T05:59:08.910283+0000","last_peered":"2024-09-10T05:59:08.910283+0000","last_clean":"2024-09-10T05:59:08.910283+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:59:08.910283+0000","last_undegraded":"2024-09-10T05:59:08.910283+0000","last_fullsized":"2024-09-10T05:59:08.910283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.205648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979439+0000","last_change":"2024-09-10T05:55:14.287785+0000","last_active":"2024-09-10T05:59:01.979439+0000","last_peered":"2024-09-10T05:59:01.979439+0000","last_clean":"2024-09-10T05:59:01.979439+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:59:01.979439+0000","last_undegraded":"2024-09-10T05:59:01.979439+0000","last_fullsized":"2024-09-10T05:59:01.979439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:11.220017+0000","last_clean_scrub_stamp":"2024-09-10T05:55:11.220017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:12.055963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824622+0000","last_change":"2024-09-10T05:58:36.083175+0000","last_active":"2024-09-10T05:59:01.824622+0000","last_peered":"2024-09-10T05:59:01.824622+0000","last_clean":"2024-09-10T05:59:01.824622+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:59:01.824622+0000","last_undegraded":"2024-09-10T05:59:01.824622+0000","last_fullsized":"2024-09-10T05:59:01.824622+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:50.357709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"133'59","reported_seq":310,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.026102+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:59:09.026102+0000","last_peered":"2024-09-10T05:59:09.026102+0000","last_clean":"2024-09-10T05:59:09.026102+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:59:09.026102+0000","last_undegraded":"2024-09-10T05:59:09.026102+0000","last_fullsized":"2024-09-10T05:59:09.026102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823349+0000","last_change":"2024-09-10T05:58:36.068927+0000","last_active":"2024-09-10T05:59:01.823349+0000","last_peered":"2024-09-10T05:59:01.823349+0000","last_clean":"2024-09-10T05:59:01.823349+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:59:01.823349+0000","last_undegraded":"2024-09-10T05:59:01.823349+0000","last_fullsized":"2024-09-10T05:59:01.823349+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:34.118740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972639+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:59:01.972639+0000","last_peered":"2024-09-10T05:59:01.972639+0000","last_clean":"2024-09-10T05:59:01.972639+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:59:01.972639+0000","last_undegraded":"2024-09-10T05:59:01.972639+0000","last_fullsized":"2024-09-10T05:59:01.972639+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815536+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:59:01.815536+0000","last_peered":"2024-09-10T05:59:01.815536+0000","last_clean":"2024-09-10T05:59:01.815536+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:59:01.815536+0000","last_undegraded":"2024-09-10T05:59:01.815536+0000","last_fullsized":"2024-09-10T05:59:01.815536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813747+0000","last_change":"2024-09-10T05:55:24.577507+0000","last_active":"2024-09-10T05:59:01.813747+0000","last_peered":"2024-09-10T05:59:01.813747+0000","last_clean":"2024-09-10T05:59:01.813747+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:59:01.813747+0000","last_undegraded":"2024-09-10T05:59:01.813747+0000","last_fullsized":"2024-09-10T05:59:01.813747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:07.558232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"133'52","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.919443+0000","last_change":"2024-09-10T05:55:22.535907+0000","last_active":"2024-09-10T05:59:08.919443+0000","last_peered":"2024-09-10T05:59:08.919443+0000","last_clean":"2024-09-10T05:59:08.919443+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:59:08.919443+0000","last_undegraded":"2024-09-10T05:59:08.919443+0000","last_fullsized":"2024-09-10T05:59:08.919443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:30:05.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969521+0000","last_change":"2024-09-10T05:55:26.576250+0000","last_active":"2024-09-10T05:59:01.969521+0000","last_peered":"2024-09-10T05:59:01.969521+0000","last_clean":"2024-09-10T05:59:01.969521+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:59:01.969521+0000","last_undegraded":"2024-09-10T05:59:01.969521+0000","last_fullsized":"2024-09-10T05:59:01.969521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:54.773484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"133'29","reported_seq":65,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.052372+0000","last_change":"2024-09-10T05:58:36.101085+0000","last_active":"2024-09-10T05:59:09.052372+0000","last_peered":"2024-09-10T05:59:09.052372+0000","last_clean":"2024-09-10T05:59:09.052372+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:59:09.052372+0000","last_undegraded":"2024-09-10T05:59:09.052372+0000","last_fullsized":"2024-09-10T05:59:09.052372+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:36.463324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822640+0000","last_change":"2024-09-10T05:58:36.083554+0000","last_active":"2024-09-10T05:59:01.822640+0000","last_peered":"2024-09-10T05:59:01.822640+0000","last_clean":"2024-09-10T05:59:01.822640+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:59:01.822640+0000","last_undegraded":"2024-09-10T05:59:01.822640+0000","last_fullsized":"2024-09-10T05:59:01.822640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:47.211919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825582+0000","last_change":"2024-09-10T05:58:36.106761+0000","last_active":"2024-09-10T05:59:01.825582+0000","last_peered":"2024-09-10T05:59:01.825582+0000","last_clean":"2024-09-10T05:59:01.825582+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:59:01.825582+0000","last_undegraded":"2024-09-10T05:59:01.825582+0000","last_fullsized":"2024-09-10T05:59:01.825582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:44.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":244,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969400+0000","last_change":"2024-09-10T05:55:24.571102+0000","last_active":"2024-09-10T05:59:01.969400+0000","last_peered":"2024-09-10T05:59:01.969400+0000","last_clean":"2024-09-10T05:59:01.969400+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:59:01.969400+0000","last_undegraded":"2024-09-10T05:59:01.969400+0000","last_fullsized":"2024-09-10T05:59:01.969400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:04.689469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"133'50","reported_seq":366,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.989661+0000","last_change":"2024-09-10T05:58:36.704691+0000","last_active":"2024-09-10T05:59:08.989661+0000","last_peered":"2024-09-10T05:59:08.989661+0000","last_clean":"2024-09-10T05:59:08.989661+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:59:08.989661+0000","last_undegraded":"2024-09-10T05:59:08.989661+0000","last_fullsized":"2024-09-10T05:59:08.989661+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:00:15.480906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825072+0000","last_change":"2024-09-10T05:58:36.087688+0000","last_active":"2024-09-10T05:59:01.825072+0000","last_peered":"2024-09-10T05:59:01.825072+0000","last_clean":"2024-09-10T05:59:01.825072+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:59:01.825072+0000","last_undegraded":"2024-09-10T05:59:01.825072+0000","last_fullsized":"2024-09-10T05:59:01.825072+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:11.802961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'10","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812168+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:59:01.812168+0000","last_peered":"2024-09-10T05:59:01.812168+0000","last_clean":"2024-09-10T05:59:01.812168+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:59:01.812168+0000","last_undegraded":"2024-09-10T05:59:01.812168+0000","last_fullsized":"2024-09-10T05:59:01.812168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969302+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:59:01.969302+0000","last_peered":"2024-09-10T05:59:01.969302+0000","last_clean":"2024-09-10T05:59:01.969302+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:59:01.969302+0000","last_undegraded":"2024-09-10T05:59:01.969302+0000","last_fullsized":"2024-09-10T05:59:01.969302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814579+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:59:01.814579+0000","last_peered":"2024-09-10T05:59:01.814579+0000","last_clean":"2024-09-10T05:59:01.814579+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:59:01.814579+0000","last_undegraded":"2024-09-10T05:59:01.814579+0000","last_fullsized":"2024-09-10T05:59:01.814579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822857+0000","last_change":"2024-09-10T05:58:36.104832+0000","last_active":"2024-09-10T05:59:01.822857+0000","last_peered":"2024-09-10T05:59:01.822857+0000","last_clean":"2024-09-10T05:59:01.822857+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:59:01.822857+0000","last_undegraded":"2024-09-10T05:59:01.822857+0000","last_fullsized":"2024-09-10T05:59:01.822857+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:15.068548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"133'46","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.951467+0000","last_change":"2024-09-10T05:55:22.568349+0000","last_active":"2024-09-10T05:59:08.951467+0000","last_peered":"2024-09-10T05:59:08.951467+0000","last_clean":"2024-09-10T05:59:08.951467+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:59:08.951467+0000","last_undegraded":"2024-09-10T05:59:08.951467+0000","last_fullsized":"2024-09-10T05:59:08.951467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:49.766547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968619+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:59:01.968619+0000","last_peered":"2024-09-10T05:59:01.968619+0000","last_clean":"2024-09-10T05:59:01.968619+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:59:01.968619+0000","last_undegraded":"2024-09-10T05:59:01.968619+0000","last_fullsized":"2024-09-10T05:59:01.968619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"133'24","reported_seq":63,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.005972+0000","last_change":"2024-09-10T05:58:41.135121+0000","last_active":"2024-09-10T05:59:09.005972+0000","last_peered":"2024-09-10T05:59:09.005972+0000","last_clean":"2024-09-10T05:59:09.005972+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:59:09.005972+0000","last_undegraded":"2024-09-10T05:59:09.005972+0000","last_fullsized":"2024-09-10T05:59:09.005972+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:59.259766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973584+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:59:01.973584+0000","last_peered":"2024-09-10T05:59:01.973584+0000","last_clean":"2024-09-10T05:59:01.973584+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:59:01.973584+0000","last_undegraded":"2024-09-10T05:59:01.973584+0000","last_fullsized":"2024-09-10T05:59:01.973584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974783+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:59:01.974783+0000","last_peered":"2024-09-10T05:59:01.974783+0000","last_clean":"2024-09-10T05:59:01.974783+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:59:01.974783+0000","last_undegraded":"2024-09-10T05:59:01.974783+0000","last_fullsized":"2024-09-10T05:59:01.974783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822940+0000","last_change":"2024-09-10T05:58:41.614433+0000","last_active":"2024-09-10T05:59:01.822940+0000","last_peered":"2024-09-10T05:59:01.822940+0000","last_clean":"2024-09-10T05:59:01.822940+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:59:01.822940+0000","last_undegraded":"2024-09-10T05:59:01.822940+0000","last_fullsized":"2024-09-10T05:59:01.822940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:59.859364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"133'60","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.907830+0000","last_change":"2024-09-10T05:55:22.561607+0000","last_active":"2024-09-10T05:59:08.907830+0000","last_peered":"2024-09-10T05:59:08.907830+0000","last_clean":"2024-09-10T05:59:08.907830+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:59:08.907830+0000","last_undegraded":"2024-09-10T05:59:08.907830+0000","last_fullsized":"2024-09-10T05:59:08.907830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:59.215717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978080+0000","last_change":"2024-09-10T05:55:26.576571+0000","last_active":"2024-09-10T05:59:01.978080+0000","last_peered":"2024-09-10T05:59:01.978080+0000","last_clean":"2024-09-10T05:59:01.978080+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:59:01.978080+0000","last_undegraded":"2024-09-10T05:59:01.978080+0000","last_fullsized":"2024-09-10T05:59:01.978080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:09.094027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"133'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.995088+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:59:08.995088+0000","last_peered":"2024-09-10T05:59:08.995088+0000","last_clean":"2024-09-10T05:59:08.995088+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:59:08.995088+0000","last_undegraded":"2024-09-10T05:59:08.995088+0000","last_fullsized":"2024-09-10T05:59:08.995088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813668+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:59:01.813668+0000","last_peered":"2024-09-10T05:59:01.813668+0000","last_clean":"2024-09-10T05:59:01.813668+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:59:01.813668+0000","last_undegraded":"2024-09-10T05:59:01.813668+0000","last_fullsized":"2024-09-10T05:59:01.813668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979090+0000","last_change":"2024-09-10T05:55:24.569087+0000","last_active":"2024-09-10T05:59:01.979090+0000","last_peered":"2024-09-10T05:59:01.979090+0000","last_clean":"2024-09-10T05:59:01.979090+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:59:01.979090+0000","last_undegraded":"2024-09-10T05:59:01.979090+0000","last_fullsized":"2024-09-10T05:59:01.979090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:56.909237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"133'50","reported_seq":121,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.978191+0000","last_change":"2024-09-10T05:58:39.178040+0000","last_active":"2024-09-10T05:59:08.978191+0000","last_peered":"2024-09-10T05:59:08.978191+0000","last_clean":"2024-09-10T05:59:08.978191+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:59:08.978191+0000","last_undegraded":"2024-09-10T05:59:08.978191+0000","last_fullsized":"2024-09-10T05:59:08.978191+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:03.677156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815572+0000","last_change":"2024-09-10T05:55:26.578845+0000","last_active":"2024-09-10T05:59:01.815572+0000","last_peered":"2024-09-10T05:59:01.815572+0000","last_clean":"2024-09-10T05:59:01.815572+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:59:01.815572+0000","last_undegraded":"2024-09-10T05:59:01.815572+0000","last_fullsized":"2024-09-10T05:59:01.815572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:38:34.887419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"133'45","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.992330+0000","last_change":"2024-09-10T05:55:28.583706+0000","last_active":"2024-09-10T05:59:08.992330+0000","last_peered":"2024-09-10T05:59:08.992330+0000","last_clean":"2024-09-10T05:59:08.992330+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:59:08.992330+0000","last_undegraded":"2024-09-10T05:59:08.992330+0000","last_fullsized":"2024-09-10T05:59:08.992330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:02.440510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":159,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975447+0000","last_change":"2024-09-10T05:58:36.082148+0000","last_active":"2024-09-10T05:59:01.975447+0000","last_peered":"2024-09-10T05:59:01.975447+0000","last_clean":"2024-09-10T05:59:01.975447+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:59:01.975447+0000","last_undegraded":"2024-09-10T05:59:01.975447+0000","last_fullsized":"2024-09-10T05:59:01.975447+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:32.319630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824811+0000","last_change":"2024-09-10T05:58:36.090193+0000","last_active":"2024-09-10T05:59:01.824811+0000","last_peered":"2024-09-10T05:59:01.824811+0000","last_clean":"2024-09-10T05:59:01.824811+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:59:01.824811+0000","last_undegraded":"2024-09-10T05:59:01.824811+0000","last_fullsized":"2024-09-10T05:59:01.824811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:35.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815817+0000","last_change":"2024-09-10T05:55:24.573569+0000","last_active":"2024-09-10T05:59:01.815817+0000","last_peered":"2024-09-10T05:59:01.815817+0000","last_clean":"2024-09-10T05:59:01.815817+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:59:01.815817+0000","last_undegraded":"2024-09-10T05:59:01.815817+0000","last_fullsized":"2024-09-10T05:59:01.815817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:37.746896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"133'50","reported_seq":370,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.961346+0000","last_change":"2024-09-10T05:58:38.989267+0000","last_active":"2024-09-10T05:59:08.961346+0000","last_peered":"2024-09-10T05:59:08.961346+0000","last_clean":"2024-09-10T05:59:08.961346+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:59:08.961346+0000","last_undegraded":"2024-09-10T05:59:08.961346+0000","last_fullsized":"2024-09-10T05:59:08.961346+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:54.603097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978818+0000","last_change":"2024-09-10T05:55:26.578539+0000","last_active":"2024-09-10T05:59:01.978818+0000","last_peered":"2024-09-10T05:59:01.978818+0000","last_clean":"2024-09-10T05:59:01.978818+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:59:01.978818+0000","last_undegraded":"2024-09-10T05:59:01.978818+0000","last_fullsized":"2024-09-10T05:59:01.978818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T05:56:28.435501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"133'26","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.998644+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:59:08.998644+0000","last_peered":"2024-09-10T05:59:08.998644+0000","last_clean":"2024-09-10T05:59:08.998644+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:59:08.998644+0000","last_undegraded":"2024-09-10T05:59:08.998644+0000","last_fullsized":"2024-09-10T05:59:08.998644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970684+0000","last_change":"2024-09-10T05:55:30.622965+0000","last_active":"2024-09-10T05:59:01.970684+0000","last_peered":"2024-09-10T05:59:01.970684+0000","last_clean":"2024-09-10T05:59:01.970684+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:59:01.970684+0000","last_undegraded":"2024-09-10T05:59:01.970684+0000","last_fullsized":"2024-09-10T05:59:01.970684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:29.646037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973068+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:59:01.973068+0000","last_peered":"2024-09-10T05:59:01.973068+0000","last_clean":"2024-09-10T05:59:01.973068+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:59:01.973068+0000","last_undegraded":"2024-09-10T05:59:01.973068+0000","last_fullsized":"2024-09-10T05:59:01.973068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824492+0000","last_change":"2024-09-10T05:58:36.755598+0000","last_active":"2024-09-10T05:59:01.824492+0000","last_peered":"2024-09-10T05:59:01.824492+0000","last_clean":"2024-09-10T05:59:01.824492+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:59:01.824492+0000","last_undegraded":"2024-09-10T05:59:01.824492+0000","last_fullsized":"2024-09-10T05:59:01.824492+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:58.858812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"133'38","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.891290+0000","last_change":"2024-09-10T05:55:22.540786+0000","last_active":"2024-09-10T05:59:08.891290+0000","last_peered":"2024-09-10T05:59:08.891290+0000","last_clean":"2024-09-10T05:59:08.891290+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:59:08.891290+0000","last_undegraded":"2024-09-10T05:59:08.891290+0000","last_fullsized":"2024-09-10T05:59:08.891290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:16.743456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":350,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.919691+0000","last_change":"2024-09-10T05:58:40.731017+0000","last_active":"2024-09-10T05:59:07.919691+0000","last_peered":"2024-09-10T05:59:07.919691+0000","last_clean":"2024-09-10T05:59:07.919691+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:59:07.919691+0000","last_undegraded":"2024-09-10T05:59:07.919691+0000","last_fullsized":"2024-09-10T05:59:07.919691+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:36.888425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"133'32","reported_seq":66,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.249657+0000","last_change":"2024-09-10T05:58:41.114451+0000","last_active":"2024-09-10T05:59:08.249657+0000","last_peered":"2024-09-10T05:59:08.249657+0000","last_clean":"2024-09-10T05:59:08.249657+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:59:08.249657+0000","last_undegraded":"2024-09-10T05:59:08.249657+0000","last_fullsized":"2024-09-10T05:59:08.249657+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:53.586626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":156,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970582+0000","last_change":"2024-09-10T05:58:36.073669+0000","last_active":"2024-09-10T05:59:01.970582+0000","last_peered":"2024-09-10T05:59:01.970582+0000","last_clean":"2024-09-10T05:59:01.970582+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:59:01.970582+0000","last_undegraded":"2024-09-10T05:59:01.970582+0000","last_fullsized":"2024-09-10T05:59:01.970582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:53.770687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973043+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:59:01.973043+0000","last_peered":"2024-09-10T05:59:01.973043+0000","last_clean":"2024-09-10T05:59:01.973043+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:59:01.973043+0000","last_undegraded":"2024-09-10T05:59:01.973043+0000","last_fullsized":"2024-09-10T05:59:01.973043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.818325+0000","last_change":"2024-09-10T05:55:24.568011+0000","last_active":"2024-09-10T05:59:01.818325+0000","last_peered":"2024-09-10T05:59:01.818325+0000","last_clean":"2024-09-10T05:59:01.818325+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:59:01.818325+0000","last_undegraded":"2024-09-10T05:59:01.818325+0000","last_fullsized":"2024-09-10T05:59:01.818325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:22.593282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"133'52","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.974211+0000","last_change":"2024-09-10T05:55:22.562125+0000","last_active":"2024-09-10T05:59:08.974211+0000","last_peered":"2024-09-10T05:59:08.974211+0000","last_clean":"2024-09-10T05:59:08.974211+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:59:08.974211+0000","last_undegraded":"2024-09-10T05:59:08.974211+0000","last_fullsized":"2024-09-10T05:59:08.974211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:21.242327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970972+0000","last_change":"2024-09-10T05:55:26.578775+0000","last_active":"2024-09-10T05:59:01.970972+0000","last_peered":"2024-09-10T05:59:01.970972+0000","last_clean":"2024-09-10T05:59:01.970972+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:59:01.970972+0000","last_undegraded":"2024-09-10T05:59:01.970972+0000","last_fullsized":"2024-09-10T05:59:01.970972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:13.103184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814598+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:59:01.814598+0000","last_peered":"2024-09-10T05:59:01.814598+0000","last_clean":"2024-09-10T05:59:01.814598+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:59:01.814598+0000","last_undegraded":"2024-09-10T05:59:01.814598+0000","last_fullsized":"2024-09-10T05:59:01.814598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:29.711225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"133'138","reported_seq":389,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.964591+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:59:07.964591+0000","last_peered":"2024-09-10T05:59:07.964591+0000","last_clean":"2024-09-10T05:59:07.964591+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:59:07.964591+0000","last_undegraded":"2024-09-10T05:59:07.964591+0000","last_fullsized":"2024-09-10T05:59:07.964591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968551+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:59:01.968551+0000","last_peered":"2024-09-10T05:59:01.968551+0000","last_clean":"2024-09-10T05:59:01.968551+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:59:01.968551+0000","last_undegraded":"2024-09-10T05:59:01.968551+0000","last_fullsized":"2024-09-10T05:59:01.968551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813457+0000","last_change":"2024-09-10T05:58:40.129243+0000","last_active":"2024-09-10T05:59:01.813457+0000","last_peered":"2024-09-10T05:59:01.813457+0000","last_clean":"2024-09-10T05:59:01.813457+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:59:01.813457+0000","last_undegraded":"2024-09-10T05:59:01.813457+0000","last_fullsized":"2024-09-10T05:59:01.813457+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:22.831721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"133'32","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.919688+0000","last_change":"2024-09-10T05:55:22.572211+0000","last_active":"2024-09-10T05:59:08.919688+0000","last_peered":"2024-09-10T05:59:08.919688+0000","last_clean":"2024-09-10T05:59:08.919688+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:59:08.919688+0000","last_undegraded":"2024-09-10T05:59:08.919688+0000","last_fullsized":"2024-09-10T05:59:08.919688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.960771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":40,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969585+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:59:01.969585+0000","last_peered":"2024-09-10T05:59:01.969585+0000","last_clean":"2024-09-10T05:59:01.969585+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:59:01.969585+0000","last_undegraded":"2024-09-10T05:59:01.969585+0000","last_fullsized":"2024-09-10T05:59:01.969585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"133'52","reported_seq":304,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.557006+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:59:08.557006+0000","last_peered":"2024-09-10T05:59:08.557006+0000","last_clean":"2024-09-10T05:59:08.557006+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:59:08.557006+0000","last_undegraded":"2024-09-10T05:59:08.557006+0000","last_fullsized":"2024-09-10T05:59:08.557006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":73,"num_read_kb":292,"num_write":46,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811526+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:59:01.811526+0000","last_peered":"2024-09-10T05:59:01.811526+0000","last_clean":"2024-09-10T05:59:01.811526+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:59:01.811526+0000","last_undegraded":"2024-09-10T05:59:01.811526+0000","last_fullsized":"2024-09-10T05:59:01.811526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973463+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:59:01.973463+0000","last_peered":"2024-09-10T05:59:01.973463+0000","last_clean":"2024-09-10T05:59:01.973463+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:59:01.973463+0000","last_undegraded":"2024-09-10T05:59:01.973463+0000","last_fullsized":"2024-09-10T05:59:01.973463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":293,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813505+0000","last_change":"2024-09-10T05:58:37.200455+0000","last_active":"2024-09-10T05:59:01.813505+0000","last_peered":"2024-09-10T05:59:01.813505+0000","last_clean":"2024-09-10T05:59:01.813505+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:59:01.813505+0000","last_undegraded":"2024-09-10T05:59:01.813505+0000","last_fullsized":"2024-09-10T05:59:01.813505+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:25.815795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"133'46","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.928645+0000","last_change":"2024-09-10T05:55:22.572162+0000","last_active":"2024-09-10T05:59:08.928645+0000","last_peered":"2024-09-10T05:59:08.928645+0000","last_clean":"2024-09-10T05:59:08.928645+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:59:08.928645+0000","last_undegraded":"2024-09-10T05:59:08.928645+0000","last_fullsized":"2024-09-10T05:59:08.928645+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973100+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:59:01.973100+0000","last_peered":"2024-09-10T05:59:01.973100+0000","last_clean":"2024-09-10T05:59:01.973100+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:59:01.973100+0000","last_undegraded":"2024-09-10T05:59:01.973100+0000","last_fullsized":"2024-09-10T05:59:01.973100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"133'26","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.561347+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:59:08.561347+0000","last_peered":"2024-09-10T05:59:08.561347+0000","last_clean":"2024-09-10T05:59:08.561347+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:59:08.561347+0000","last_undegraded":"2024-09-10T05:59:08.561347+0000","last_fullsized":"2024-09-10T05:59:08.561347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978365+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:59:01.978365+0000","last_peered":"2024-09-10T05:59:01.978365+0000","last_clean":"2024-09-10T05:59:01.978365+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:59:01.978365+0000","last_undegraded":"2024-09-10T05:59:01.978365+0000","last_fullsized":"2024-09-10T05:59:01.978365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825337+0000","last_change":"2024-09-10T05:58:36.751943+0000","last_active":"2024-09-10T05:59:01.825337+0000","last_peered":"2024-09-10T05:59:01.825337+0000","last_clean":"2024-09-10T05:59:01.825337+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:59:01.825337+0000","last_undegraded":"2024-09-10T05:59:01.825337+0000","last_fullsized":"2024-09-10T05:59:01.825337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:52.279125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823701+0000","last_change":"2024-09-10T05:58:36.760284+0000","last_active":"2024-09-10T05:59:01.823701+0000","last_peered":"2024-09-10T05:59:01.823701+0000","last_clean":"2024-09-10T05:59:01.823701+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:59:01.823701+0000","last_undegraded":"2024-09-10T05:59:01.823701+0000","last_fullsized":"2024-09-10T05:59:01.823701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:27.695656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"133'60","reported_seq":136,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.956888+0000","last_change":"2024-09-10T05:58:36.748201+0000","last_active":"2024-09-10T05:59:08.956888+0000","last_peered":"2024-09-10T05:59:08.956888+0000","last_clean":"2024-09-10T05:59:08.956888+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:59:08.956888+0000","last_undegraded":"2024-09-10T05:59:08.956888+0000","last_fullsized":"2024-09-10T05:59:08.956888+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:07.304252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811947+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:59:01.811947+0000","last_peered":"2024-09-10T05:59:01.811947+0000","last_clean":"2024-09-10T05:59:01.811947+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:59:01.811947+0000","last_undegraded":"2024-09-10T05:59:01.811947+0000","last_fullsized":"2024-09-10T05:59:01.811947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"133'22","reported_seq":59,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.072811+0000","last_change":"2024-09-10T05:58:42.032681+0000","last_active":"2024-09-10T05:59:08.072811+0000","last_peered":"2024-09-10T05:59:08.072811+0000","last_clean":"2024-09-10T05:59:08.072811+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:59:08.072811+0000","last_undegraded":"2024-09-10T05:59:08.072811+0000","last_fullsized":"2024-09-10T05:59:08.072811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:11.388502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812414+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:59:01.812414+0000","last_peered":"2024-09-10T05:59:01.812414+0000","last_clean":"2024-09-10T05:59:01.812414+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:59:01.812414+0000","last_undegraded":"2024-09-10T05:59:01.812414+0000","last_fullsized":"2024-09-10T05:59:01.812414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970419+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:59:01.970419+0000","last_peered":"2024-09-10T05:59:01.970419+0000","last_clean":"2024-09-10T05:59:01.970419+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:59:01.970419+0000","last_undegraded":"2024-09-10T05:59:01.970419+0000","last_fullsized":"2024-09-10T05:59:01.970419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812442+0000","last_change":"2024-09-10T05:55:24.579734+0000","last_active":"2024-09-10T05:59:01.812442+0000","last_peered":"2024-09-10T05:59:01.812442+0000","last_clean":"2024-09-10T05:59:01.812442+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:59:01.812442+0000","last_undegraded":"2024-09-10T05:59:01.812442+0000","last_fullsized":"2024-09-10T05:59:01.812442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:12.119402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"133'50","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.885174+0000","last_change":"2024-09-10T05:55:59.086651+0000","last_active":"2024-09-10T05:59:08.885174+0000","last_peered":"2024-09-10T05:59:08.885174+0000","last_clean":"2024-09-10T05:59:08.885174+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:59:08.885174+0000","last_undegraded":"2024-09-10T05:59:08.885174+0000","last_fullsized":"2024-09-10T05:59:08.885174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:32.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968961+0000","last_change":"2024-09-10T05:55:26.586556+0000","last_active":"2024-09-10T05:59:01.968961+0000","last_peered":"2024-09-10T05:59:01.968961+0000","last_clean":"2024-09-10T05:59:01.968961+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:59:01.968961+0000","last_undegraded":"2024-09-10T05:59:01.968961+0000","last_fullsized":"2024-09-10T05:59:01.968961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:33:32.740111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"133'34","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.257046+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:59:08.257046+0000","last_peered":"2024-09-10T05:59:08.257046+0000","last_clean":"2024-09-10T05:59:08.257046+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:59:08.257046+0000","last_undegraded":"2024-09-10T05:59:08.257046+0000","last_fullsized":"2024-09-10T05:59:08.257046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":44,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813606+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:59:01.813606+0000","last_peered":"2024-09-10T05:59:01.813606+0000","last_clean":"2024-09-10T05:59:01.813606+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:59:01.813606+0000","last_undegraded":"2024-09-10T05:59:01.813606+0000","last_fullsized":"2024-09-10T05:59:01.813606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815081+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:59:01.815081+0000","last_peered":"2024-09-10T05:59:01.815081+0000","last_clean":"2024-09-10T05:59:01.815081+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:59:01.815081+0000","last_undegraded":"2024-09-10T05:59:01.815081+0000","last_fullsized":"2024-09-10T05:59:01.815081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971172+0000","last_change":"2024-09-10T05:55:24.571763+0000","last_active":"2024-09-10T05:59:01.971172+0000","last_peered":"2024-09-10T05:59:01.971172+0000","last_clean":"2024-09-10T05:59:01.971172+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:59:01.971172+0000","last_undegraded":"2024-09-10T05:59:01.971172+0000","last_fullsized":"2024-09-10T05:59:01.971172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:20.740941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"133'60","reported_seq":286,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.937201+0000","last_change":"2024-09-10T05:55:22.577750+0000","last_active":"2024-09-10T05:59:08.937201+0000","last_peered":"2024-09-10T05:59:08.937201+0000","last_clean":"2024-09-10T05:59:08.937201+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:59:08.937201+0000","last_undegraded":"2024-09-10T05:59:08.937201+0000","last_fullsized":"2024-09-10T05:59:08.937201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:04:45.108345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":254,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970866+0000","last_change":"2024-09-10T05:55:24.578078+0000","last_active":"2024-09-10T05:59:01.970866+0000","last_peered":"2024-09-10T05:59:01.970866+0000","last_clean":"2024-09-10T05:59:01.970866+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:59:01.970866+0000","last_undegraded":"2024-09-10T05:59:01.970866+0000","last_fullsized":"2024-09-10T05:59:01.970866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:16.193656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"133'44","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.973257+0000","last_change":"2024-09-10T05:55:22.554811+0000","last_active":"2024-09-10T05:59:08.973257+0000","last_peered":"2024-09-10T05:59:08.973257+0000","last_clean":"2024-09-10T05:59:08.973257+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:59:08.973257+0000","last_undegraded":"2024-09-10T05:59:08.973257+0000","last_fullsized":"2024-09-10T05:59:08.973257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:23.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976396+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:59:01.976396+0000","last_peered":"2024-09-10T05:59:01.976396+0000","last_clean":"2024-09-10T05:59:01.976396+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:59:01.976396+0000","last_undegraded":"2024-09-10T05:59:01.976396+0000","last_fullsized":"2024-09-10T05:59:01.976396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"133'40","reported_seq":339,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.766041+0000","last_change":"2024-09-10T05:58:37.753575+0000","last_active":"2024-09-10T05:59:08.766041+0000","last_peered":"2024-09-10T05:59:08.766041+0000","last_clean":"2024-09-10T05:59:08.766041+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:59:08.766041+0000","last_undegraded":"2024-09-10T05:59:08.766041+0000","last_fullsized":"2024-09-10T05:59:08.766041+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:21.191915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":48,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970245+0000","last_change":"2024-09-10T05:55:24.575229+0000","last_active":"2024-09-10T05:59:01.970245+0000","last_peered":"2024-09-10T05:59:01.970245+0000","last_clean":"2024-09-10T05:59:01.970245+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:59:01.970245+0000","last_undegraded":"2024-09-10T05:59:01.970245+0000","last_fullsized":"2024-09-10T05:59:01.970245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:32.794466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"133'44","reported_seq":351,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.968550+0000","last_change":"2024-09-10T05:58:38.431996+0000","last_active":"2024-09-10T05:59:08.968550+0000","last_peered":"2024-09-10T05:59:08.968550+0000","last_clean":"2024-09-10T05:59:08.968550+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:59:08.968550+0000","last_undegraded":"2024-09-10T05:59:08.968550+0000","last_fullsized":"2024-09-10T05:59:08.968550+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:15.662612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813281+0000","last_change":"2024-09-10T05:58:40.123148+0000","last_active":"2024-09-10T05:59:01.813281+0000","last_peered":"2024-09-10T05:59:01.813281+0000","last_clean":"2024-09-10T05:59:01.813281+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:59:01.813281+0000","last_undegraded":"2024-09-10T05:59:01.813281+0000","last_fullsized":"2024-09-10T05:59:01.813281+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:28.445530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"133'60","reported_seq":136,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.961880+0000","last_change":"2024-09-10T05:58:37.278065+0000","last_active":"2024-09-10T05:59:08.961880+0000","last_peered":"2024-09-10T05:59:08.961880+0000","last_clean":"2024-09-10T05:59:08.961880+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:59:08.961880+0000","last_undegraded":"2024-09-10T05:59:08.961880+0000","last_fullsized":"2024-09-10T05:59:08.961880+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:23.616575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813671+0000","last_change":"2024-09-10T05:55:24.575798+0000","last_active":"2024-09-10T05:59:01.813671+0000","last_peered":"2024-09-10T05:59:01.813671+0000","last_clean":"2024-09-10T05:59:01.813671+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:59:01.813671+0000","last_undegraded":"2024-09-10T05:59:01.813671+0000","last_fullsized":"2024-09-10T05:59:01.813671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:26.559013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"133'56","reported_seq":380,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.953827+0000","last_change":"2024-09-10T05:58:37.192873+0000","last_active":"2024-09-10T05:59:08.953827+0000","last_peered":"2024-09-10T05:59:08.953827+0000","last_clean":"2024-09-10T05:59:08.953827+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:59:08.953827+0000","last_undegraded":"2024-09-10T05:59:08.953827+0000","last_fullsized":"2024-09-10T05:59:08.953827+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:35.993383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823416+0000","last_change":"2024-09-10T05:58:36.076255+0000","last_active":"2024-09-10T05:59:01.823416+0000","last_peered":"2024-09-10T05:59:01.823416+0000","last_clean":"2024-09-10T05:59:01.823416+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:59:01.823416+0000","last_undegraded":"2024-09-10T05:59:01.823416+0000","last_fullsized":"2024-09-10T05:59:01.823416+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:20.131719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"133'38","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.886684+0000","last_change":"2024-09-10T05:55:22.579548+0000","last_active":"2024-09-10T05:59:08.886684+0000","last_peered":"2024-09-10T05:59:08.886684+0000","last_clean":"2024-09-10T05:59:08.886684+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:59:08.886684+0000","last_undegraded":"2024-09-10T05:59:08.886684+0000","last_fullsized":"2024-09-10T05:59:08.886684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:53.396424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.980248+0000","last_change":"2024-09-10T05:55:24.576553+0000","last_active":"2024-09-10T05:59:01.980248+0000","last_peered":"2024-09-10T05:59:01.980248+0000","last_clean":"2024-09-10T05:59:01.980248+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:59:01.980248+0000","last_undegraded":"2024-09-10T05:59:01.980248+0000","last_fullsized":"2024-09-10T05:59:01.980248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:10.044151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"133'42","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.901205+0000","last_change":"2024-09-10T05:58:40.562955+0000","last_active":"2024-09-10T05:59:08.901205+0000","last_peered":"2024-09-10T05:59:08.901205+0000","last_clean":"2024-09-10T05:59:08.901205+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:59:08.901205+0000","last_undegraded":"2024-09-10T05:59:08.901205+0000","last_fullsized":"2024-09-10T05:59:08.901205+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:55.849489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815897+0000","last_change":"2024-09-10T05:58:40.787117+0000","last_active":"2024-09-10T05:59:01.815897+0000","last_peered":"2024-09-10T05:59:01.815897+0000","last_clean":"2024-09-10T05:59:01.815897+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:59:01.815897+0000","last_undegraded":"2024-09-10T05:59:01.815897+0000","last_fullsized":"2024-09-10T05:59:01.815897+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:06.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"133'54","reported_seq":369,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.981436+0000","last_change":"2024-09-10T05:58:40.117727+0000","last_active":"2024-09-10T05:59:08.981436+0000","last_peered":"2024-09-10T05:59:08.981436+0000","last_clean":"2024-09-10T05:59:08.981436+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:59:08.981436+0000","last_undegraded":"2024-09-10T05:59:08.981436+0000","last_fullsized":"2024-09-10T05:59:08.981436+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:28.251854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814850+0000","last_change":"2024-09-10T05:55:24.573542+0000","last_active":"2024-09-10T05:59:01.814850+0000","last_peered":"2024-09-10T05:59:01.814850+0000","last_clean":"2024-09-10T05:59:01.814850+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:59:01.814850+0000","last_undegraded":"2024-09-10T05:59:01.814850+0000","last_fullsized":"2024-09-10T05:59:01.814850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:02:56.506194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"133'42","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.874037+0000","last_change":"2024-09-10T05:58:40.171208+0000","last_active":"2024-09-10T05:59:08.874037+0000","last_peered":"2024-09-10T05:59:08.874037+0000","last_clean":"2024-09-10T05:59:08.874037+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:59:08.874037+0000","last_undegraded":"2024-09-10T05:59:08.874037+0000","last_fullsized":"2024-09-10T05:59:08.874037+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:43.370109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":223,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.817504+0000","last_change":"2024-09-10T05:55:24.570924+0000","last_active":"2024-09-10T05:59:01.817504+0000","last_peered":"2024-09-10T05:59:01.817504+0000","last_clean":"2024-09-10T05:59:01.817504+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:59:01.817504+0000","last_undegraded":"2024-09-10T05:59:01.817504+0000","last_fullsized":"2024-09-10T05:59:01.817504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:10.337729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"133'66","reported_seq":292,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.972851+0000","last_change":"2024-09-10T05:55:22.580247+0000","last_active":"2024-09-10T05:59:08.972851+0000","last_peered":"2024-09-10T05:59:08.972851+0000","last_clean":"2024-09-10T05:59:08.972851+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:59:08.972851+0000","last_undegraded":"2024-09-10T05:59:08.972851+0000","last_fullsized":"2024-09-10T05:59:08.972851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:55.041185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814626+0000","last_change":"2024-09-10T05:55:24.576838+0000","last_active":"2024-09-10T05:59:01.814626+0000","last_peered":"2024-09-10T05:59:01.814626+0000","last_clean":"2024-09-10T05:59:01.814626+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:59:01.814626+0000","last_undegraded":"2024-09-10T05:59:01.814626+0000","last_fullsized":"2024-09-10T05:59:01.814626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:19.878513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"133'36","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.856688+0000","last_change":"2024-09-10T05:55:22.561265+0000","last_active":"2024-09-10T05:59:08.856688+0000","last_peered":"2024-09-10T05:59:08.856688+0000","last_clean":"2024-09-10T05:59:08.856688+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:59:08.856688+0000","last_undegraded":"2024-09-10T05:59:08.856688+0000","last_fullsized":"2024-09-10T05:59:08.856688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:43.664688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970326+0000","last_change":"2024-09-10T05:58:38.090502+0000","last_active":"2024-09-10T05:59:01.970326+0000","last_peered":"2024-09-10T05:59:01.970326+0000","last_clean":"2024-09-10T05:59:01.970326+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:59:01.970326+0000","last_undegraded":"2024-09-10T05:59:01.970326+0000","last_fullsized":"2024-09-10T05:59:01.970326+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:56.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"133'42","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.886337+0000","last_change":"2024-09-10T05:55:58.835559+0000","last_active":"2024-09-10T05:59:08.886337+0000","last_peered":"2024-09-10T05:59:08.886337+0000","last_clean":"2024-09-10T05:59:08.886337+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:59:08.886337+0000","last_undegraded":"2024-09-10T05:59:08.886337+0000","last_fullsized":"2024-09-10T05:59:08.886337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:01:42.736279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812931+0000","last_change":"2024-09-10T05:55:24.580834+0000","last_active":"2024-09-10T05:59:01.812931+0000","last_peered":"2024-09-10T05:59:01.812931+0000","last_clean":"2024-09-10T05:59:01.812931+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:59:01.812931+0000","last_undegraded":"2024-09-10T05:59:01.812931+0000","last_fullsized":"2024-09-10T05:59:01.812931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:33.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"133'48","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.907442+0000","last_change":"2024-09-10T05:55:22.577499+0000","last_active":"2024-09-10T05:59:08.907442+0000","last_peered":"2024-09-10T05:59:08.907442+0000","last_clean":"2024-09-10T05:59:08.907442+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:59:08.907442+0000","last_undegraded":"2024-09-10T05:59:08.907442+0000","last_fullsized":"2024-09-10T05:59:08.907442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:15:32.685928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824020+0000","last_change":"2024-09-10T05:58:36.090342+0000","last_active":"2024-09-10T05:59:01.824020+0000","last_peered":"2024-09-10T05:59:01.824020+0000","last_clean":"2024-09-10T05:59:01.824020+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:59:01.824020+0000","last_undegraded":"2024-09-10T05:59:01.824020+0000","last_fullsized":"2024-09-10T05:59:01.824020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:15.019257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"133'40","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.879839+0000","last_change":"2024-09-10T05:55:22.559916+0000","last_active":"2024-09-10T05:59:08.879839+0000","last_peered":"2024-09-10T05:59:08.879839+0000","last_clean":"2024-09-10T05:59:08.879839+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:59:08.879839+0000","last_undegraded":"2024-09-10T05:59:08.879839+0000","last_fullsized":"2024-09-10T05:59:08.879839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:44.809584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969117+0000","last_change":"2024-09-10T05:58:36.079403+0000","last_active":"2024-09-10T05:59:01.969117+0000","last_peered":"2024-09-10T05:59:01.969117+0000","last_clean":"2024-09-10T05:59:01.969117+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:59:01.969117+0000","last_undegraded":"2024-09-10T05:59:01.969117+0000","last_fullsized":"2024-09-10T05:59:01.969117+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:15.025854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"133'50","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.916497+0000","last_change":"2024-09-10T05:55:22.570071+0000","last_active":"2024-09-10T05:59:08.916497+0000","last_peered":"2024-09-10T05:59:08.916497+0000","last_clean":"2024-09-10T05:59:08.916497+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:59:08.916497+0000","last_undegraded":"2024-09-10T05:59:08.916497+0000","last_fullsized":"2024-09-10T05:59:08.916497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:14:44.709085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"133'48","reported_seq":183,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.910322+0000","last_change":"2024-09-10T05:56:59.930099+0000","last_active":"2024-09-10T05:59:08.910322+0000","last_peered":"2024-09-10T05:59:08.910322+0000","last_clean":"2024-09-10T05:59:08.910322+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:59:08.910322+0000","last_undegraded":"2024-09-10T05:59:08.910322+0000","last_fullsized":"2024-09-10T05:59:08.910322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:59.191032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815803+0000","last_change":"2024-09-10T05:58:40.744836+0000","last_active":"2024-09-10T05:59:01.815803+0000","last_peered":"2024-09-10T05:59:01.815803+0000","last_clean":"2024-09-10T05:59:01.815803+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:59:01.815803+0000","last_undegraded":"2024-09-10T05:59:01.815803+0000","last_fullsized":"2024-09-10T05:59:01.815803+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:36:01.390882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"133'46","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.874012+0000","last_change":"2024-09-10T05:55:22.564884+0000","last_active":"2024-09-10T05:59:08.874012+0000","last_peered":"2024-09-10T05:59:08.874012+0000","last_clean":"2024-09-10T05:59:08.874012+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:59:08.874012+0000","last_undegraded":"2024-09-10T05:59:08.874012+0000","last_fullsized":"2024-09-10T05:59:08.874012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:51:20.725230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976451+0000","last_change":"2024-09-10T05:55:24.559301+0000","last_active":"2024-09-10T05:59:01.976451+0000","last_peered":"2024-09-10T05:59:01.976451+0000","last_clean":"2024-09-10T05:59:01.976451+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:59:01.976451+0000","last_undegraded":"2024-09-10T05:59:01.976451+0000","last_fullsized":"2024-09-10T05:59:01.976451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:54.540127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1348,"num_read_kb":1798,"num_write":733,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1058,"ondisk_log_size":1058,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3088,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37524,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334316,"statfs":{"total":96636764160,"available":96598339584,"internally_reserved":0,"allocated":2232320,"data_stored":1535013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36988,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334852,"statfs":{"total":96636764160,"available":96598888448,"internally_reserved":0,"allocated":1617920,"data_stored":944421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37160,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334680,"statfs":{"total":96636764160,"available":96598712320,"internally_reserved":0,"allocated":1667072,"data_stored":944843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37032,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334808,"statfs":{"total":96636764160,"available":96598843392,"internally_reserved":0,"allocated":1605632,"data_stored":944476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1642496,"data_stored":945777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542198,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41068,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330772,"statfs":{"total":96636764160,"available":96594710528,"internally_reserved":0,"allocated":1601536,"data_stored":943547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41400,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1642496,"data_stored":945202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41668,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330172,"statfs":{"total":96636764160,"available":96594096128,"internally_reserved":0,"allocated":2215936,"data_stored":1534855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:59:15.709 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.709 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.710 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.710 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.710 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.710 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.710 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.710 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.710 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.711 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.712 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.713 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.713 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.713 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.713 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.713 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.713 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.714 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.715 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.716 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.716 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.716 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.716 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.716 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.716 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.717 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.717 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.717 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.717 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.717 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.717 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.718 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.719 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.720 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.721 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T05:55:05.959922+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=5, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.722 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.723 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.723 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.723 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.723 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.723 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.724 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.724 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.724 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.724 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.724 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.724 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.725 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.726 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.727 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.728 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T05:55:11.220017+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=11, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.729 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.730 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.731 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.732 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.733 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.734 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.735 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.736 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.736 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.736 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.736 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.737 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.737 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.737 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.737 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.737 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.737 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.738 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.738 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.738 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.738 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.738 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.738 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.738 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.739 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.740 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.741 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.742 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.742 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.742 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:15.742 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:59:35.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:59:36.096 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:59:36.102 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:59:36.115 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-09-10T05:59:35.750614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624007,"num_objects":232,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":5195,"num_read_kb":4070,"num_write":4545,"num_write_kb":6187131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":853,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5744,"ondisk_log_size":5744,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304960,"kb_used_data":13888,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754669760,"statfs":{"total":773094113280,"available":772781834240,"internally_reserved":0,"allocated":14221312,"data_stored":8737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005946"},"pg_stats":[{"pgid":"3.3f","version":"133'44","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.987008+0000","last_change":"2024-09-10T05:55:22.583668+0000","last_active":"2024-09-10T05:59:08.987008+0000","last_peered":"2024-09-10T05:59:08.987008+0000","last_clean":"2024-09-10T05:59:08.987008+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:59:08.987008+0000","last_undegraded":"2024-09-10T05:59:08.987008+0000","last_fullsized":"2024-09-10T05:59:08.987008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:21.652387+0000","last_clean_scrub_stamp":"2024-09-10T05:55:21.652387+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:50.845163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971871+0000","last_change":"2024-09-10T05:55:24.576555+0000","last_active":"2024-09-10T05:59:01.971871+0000","last_peered":"2024-09-10T05:59:01.971871+0000","last_clean":"2024-09-10T05:59:01.971871+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:59:01.971871+0000","last_undegraded":"2024-09-10T05:59:01.971871+0000","last_fullsized":"2024-09-10T05:59:01.971871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:19:48.650160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"133'54","reported_seq":289,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.959319+0000","last_change":"2024-09-10T05:59:18.959163+0000","last_active":"2024-09-10T05:59:18.959319+0000","last_peered":"2024-09-10T05:59:18.959319+0000","last_clean":"2024-09-10T05:59:18.959319+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:59:18.959319+0000","last_undegraded":"2024-09-10T05:59:18.959319+0000","last_fullsized":"2024-09-10T05:59:18.959319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:18.958994+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:18.958994+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.958994+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:34:18.270276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969559+0000","last_change":"2024-09-10T05:55:24.571863+0000","last_active":"2024-09-10T05:59:01.969559+0000","last_peered":"2024-09-10T05:59:01.969559+0000","last_clean":"2024-09-10T05:59:01.969559+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:59:01.969559+0000","last_undegraded":"2024-09-10T05:59:01.969559+0000","last_fullsized":"2024-09-10T05:59:01.969559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:47.023898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"133'54","reported_seq":290,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.118312+0000","last_change":"2024-09-10T05:59:18.118151+0000","last_active":"2024-09-10T05:59:18.118312+0000","last_peered":"2024-09-10T05:59:18.118312+0000","last_clean":"2024-09-10T05:59:18.118312+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:59:18.118312+0000","last_undegraded":"2024-09-10T05:59:18.118312+0000","last_fullsized":"2024-09-10T05:59:18.118312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:18.117878+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:18.117878+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.117878+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:45.071331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.428235+0000","last_change":"2024-09-10T05:59:33.428235+0000","last_active":"2024-09-10T05:59:33.428235+0000","last_peered":"2024-09-10T05:59:33.428235+0000","last_clean":"2024-09-10T05:59:33.428235+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:59:33.428235+0000","last_undegraded":"2024-09-10T05:59:33.428235+0000","last_fullsized":"2024-09-10T05:59:33.428235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'6","last_scrub_stamp":"2024-09-10T05:59:33.428048+0000","last_deep_scrub":"111'6","last_deep_scrub_stamp":"2024-09-10T05:59:33.428048+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.428048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.347579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"133'42","reported_seq":353,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.771593+0000","last_change":"2024-09-10T05:59:25.771432+0000","last_active":"2024-09-10T05:59:25.771593+0000","last_peered":"2024-09-10T05:59:25.771593+0000","last_clean":"2024-09-10T05:59:25.771593+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:59:25.771593+0000","last_undegraded":"2024-09-10T05:59:25.771593+0000","last_fullsized":"2024-09-10T05:59:25.771593+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:25.771229+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:25.771229+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.771229+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:26.630788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":318,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.169550+0000","last_change":"2024-09-10T05:59:28.169550+0000","last_active":"2024-09-10T05:59:28.169550+0000","last_peered":"2024-09-10T05:59:28.169550+0000","last_clean":"2024-09-10T05:59:28.169550+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:59:28.169550+0000","last_undegraded":"2024-09-10T05:59:28.169550+0000","last_fullsized":"2024-09-10T05:59:28.169550+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-10T05:59:28.169362+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-10T05:59:28.169362+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.169362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:24.927532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"133'58","reported_seq":294,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.279596+0000","last_change":"2024-09-10T05:59:25.279596+0000","last_active":"2024-09-10T05:59:25.279596+0000","last_peered":"2024-09-10T05:59:25.279596+0000","last_clean":"2024-09-10T05:59:25.279596+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:59:25.279596+0000","last_undegraded":"2024-09-10T05:59:25.279596+0000","last_fullsized":"2024-09-10T05:59:25.279596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'58","last_scrub_stamp":"2024-09-10T05:59:25.279376+0000","last_deep_scrub":"133'58","last_deep_scrub_stamp":"2024-09-10T05:59:25.279376+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.279376+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:57.444588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.591708+0000","last_change":"2024-09-10T05:59:26.591708+0000","last_active":"2024-09-10T05:59:26.591708+0000","last_peered":"2024-09-10T05:59:26.591708+0000","last_clean":"2024-09-10T05:59:26.591708+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:59:26.591708+0000","last_undegraded":"2024-09-10T05:59:26.591708+0000","last_fullsized":"2024-09-10T05:59:26.591708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:26.591508+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:26.591508+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.591508+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:27.839176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"133'50","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.780543+0000","last_change":"2024-09-10T05:59:24.780543+0000","last_active":"2024-09-10T05:59:24.780543+0000","last_peered":"2024-09-10T05:59:24.780543+0000","last_clean":"2024-09-10T05:59:24.780543+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:59:24.780543+0000","last_undegraded":"2024-09-10T05:59:24.780543+0000","last_fullsized":"2024-09-10T05:59:24.780543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:24.780355+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:24.780355+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.780355+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:00.729435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":58,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814548+0000","last_change":"2024-09-10T05:55:24.579719+0000","last_active":"2024-09-10T05:59:01.814548+0000","last_peered":"2024-09-10T05:59:01.814548+0000","last_clean":"2024-09-10T05:59:01.814548+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:59:01.814548+0000","last_undegraded":"2024-09-10T05:59:01.814548+0000","last_fullsized":"2024-09-10T05:59:01.814548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"133'38","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.309785+0000","last_change":"2024-09-10T05:59:24.309785+0000","last_active":"2024-09-10T05:59:24.309785+0000","last_peered":"2024-09-10T05:59:24.309785+0000","last_clean":"2024-09-10T05:59:24.309785+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:59:24.309785+0000","last_undegraded":"2024-09-10T05:59:24.309785+0000","last_fullsized":"2024-09-10T05:59:24.309785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:24.309603+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:24.309603+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.309603+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:52.271796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":46,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975884+0000","last_change":"2024-09-10T05:55:24.562741+0000","last_active":"2024-09-10T05:59:01.975884+0000","last_peered":"2024-09-10T05:59:01.975884+0000","last_clean":"2024-09-10T05:59:01.975884+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:59:01.975884+0000","last_undegraded":"2024-09-10T05:59:01.975884+0000","last_fullsized":"2024-09-10T05:59:01.975884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:26.697160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"133'26","reported_seq":93,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.003050+0000","last_change":"2024-09-10T05:59:24.003050+0000","last_active":"2024-09-10T05:59:24.003050+0000","last_peered":"2024-09-10T05:59:24.003050+0000","last_clean":"2024-09-10T05:59:24.003050+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:59:24.003050+0000","last_undegraded":"2024-09-10T05:59:24.003050+0000","last_fullsized":"2024-09-10T05:59:24.003050+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'26","last_scrub_stamp":"2024-09-10T05:59:24.002865+0000","last_deep_scrub":"133'26","last_deep_scrub_stamp":"2024-09-10T05:59:24.002865+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.002865+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:17:17.020481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.117766+0000","last_change":"2024-09-10T05:59:21.117639+0000","last_active":"2024-09-10T05:59:21.117766+0000","last_peered":"2024-09-10T05:59:21.117766+0000","last_clean":"2024-09-10T05:59:21.117766+0000","last_became_active":"2024-09-10T05:59:01.981080+0000","last_became_peered":"2024-09-10T05:59:01.981080+0000","last_unstale":"2024-09-10T05:59:21.117766+0000","last_undegraded":"2024-09-10T05:59:21.117766+0000","last_fullsized":"2024-09-10T05:59:21.117766+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'2","last_scrub_stamp":"2024-09-10T05:59:21.117454+0000","last_deep_scrub":"66'2","last_deep_scrub_stamp":"2024-09-10T05:59:21.117454+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.117454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:22.055934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.465207+0000","last_change":"2024-09-10T05:59:30.465207+0000","last_active":"2024-09-10T05:59:30.465207+0000","last_peered":"2024-09-10T05:59:30.465207+0000","last_clean":"2024-09-10T05:59:30.465207+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:59:30.465207+0000","last_undegraded":"2024-09-10T05:59:30.465207+0000","last_fullsized":"2024-09-10T05:59:30.465207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:30.464999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:30.464999+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.464999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:07.102665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"133'38","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.207545+0000","last_change":"2024-09-10T05:59:30.207545+0000","last_active":"2024-09-10T05:59:30.207545+0000","last_peered":"2024-09-10T05:59:30.207545+0000","last_clean":"2024-09-10T05:59:30.207545+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:59:30.207545+0000","last_undegraded":"2024-09-10T05:59:30.207545+0000","last_fullsized":"2024-09-10T05:59:30.207545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:30.207357+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:30.207357+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.207357+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:08.600952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969838+0000","last_change":"2024-09-10T05:55:24.570396+0000","last_active":"2024-09-10T05:59:01.969838+0000","last_peered":"2024-09-10T05:59:01.969838+0000","last_clean":"2024-09-10T05:59:01.969838+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:59:01.969838+0000","last_undegraded":"2024-09-10T05:59:01.969838+0000","last_fullsized":"2024-09-10T05:59:01.969838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:06:23.941701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"133'50","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.492135+0000","last_change":"2024-09-10T05:59:23.492135+0000","last_active":"2024-09-10T05:59:23.492135+0000","last_peered":"2024-09-10T05:59:23.492135+0000","last_clean":"2024-09-10T05:59:23.492135+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:59:23.492135+0000","last_undegraded":"2024-09-10T05:59:23.492135+0000","last_fullsized":"2024-09-10T05:59:23.492135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:23.491933+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:23.491933+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.491933+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:52.600446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.770343+0000","last_change":"2024-09-10T05:59:28.770343+0000","last_active":"2024-09-10T05:59:28.770343+0000","last_peered":"2024-09-10T05:59:28.770343+0000","last_clean":"2024-09-10T05:59:28.770343+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:59:28.770343+0000","last_undegraded":"2024-09-10T05:59:28.770343+0000","last_fullsized":"2024-09-10T05:59:28.770343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T05:59:28.770157+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T05:59:28.770157+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.770157+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:46.811556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"133'34","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.663544+0000","last_change":"2024-09-10T05:59:19.663544+0000","last_active":"2024-09-10T05:59:19.663544+0000","last_peered":"2024-09-10T05:59:19.663544+0000","last_clean":"2024-09-10T05:59:19.663544+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:59:19.663544+0000","last_undegraded":"2024-09-10T05:59:19.663544+0000","last_fullsized":"2024-09-10T05:59:19.663544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'34","last_scrub_stamp":"2024-09-10T05:59:19.663357+0000","last_deep_scrub":"133'34","last_deep_scrub_stamp":"2024-09-10T05:59:19.663357+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.663357+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:45.818653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":42,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.139540+0000","last_change":"2024-09-10T05:59:20.139540+0000","last_active":"2024-09-10T05:59:20.139540+0000","last_peered":"2024-09-10T05:59:20.139540+0000","last_clean":"2024-09-10T05:59:20.139540+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:59:20.139540+0000","last_undegraded":"2024-09-10T05:59:20.139540+0000","last_fullsized":"2024-09-10T05:59:20.139540+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-09-10T05:59:20.139337+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-09-10T05:59:20.139337+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.139337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:11.878224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"133'56","reported_seq":290,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.357845+0000","last_change":"2024-09-10T05:59:18.357845+0000","last_active":"2024-09-10T05:59:18.357845+0000","last_peered":"2024-09-10T05:59:18.357845+0000","last_clean":"2024-09-10T05:59:18.357845+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:59:18.357845+0000","last_undegraded":"2024-09-10T05:59:18.357845+0000","last_fullsized":"2024-09-10T05:59:18.357845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'56","last_scrub_stamp":"2024-09-10T05:59:18.357658+0000","last_deep_scrub":"133'56","last_deep_scrub_stamp":"2024-09-10T05:59:18.357658+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.357658+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:44.892383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.088415+0000","last_change":"2024-09-10T05:59:28.088415+0000","last_active":"2024-09-10T05:59:28.088415+0000","last_peered":"2024-09-10T05:59:28.088415+0000","last_clean":"2024-09-10T05:59:28.088415+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:59:28.088415+0000","last_undegraded":"2024-09-10T05:59:28.088415+0000","last_fullsized":"2024-09-10T05:59:28.088415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:28.088203+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:28.088203+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.088203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:48.435353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"133'44","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.982631+0000","last_change":"2024-09-10T05:59:22.982631+0000","last_active":"2024-09-10T05:59:22.982631+0000","last_peered":"2024-09-10T05:59:22.982631+0000","last_clean":"2024-09-10T05:59:22.982631+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:59:22.982631+0000","last_undegraded":"2024-09-10T05:59:22.982631+0000","last_fullsized":"2024-09-10T05:59:22.982631+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:22.982370+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:22.982370+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.982370+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:50.293924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.483996+0000","last_change":"2024-09-10T05:59:31.483996+0000","last_active":"2024-09-10T05:59:31.483996+0000","last_peered":"2024-09-10T05:59:31.483996+0000","last_clean":"2024-09-10T05:59:31.483996+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:59:31.483996+0000","last_undegraded":"2024-09-10T05:59:31.483996+0000","last_fullsized":"2024-09-10T05:59:31.483996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:31.483809+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:31.483809+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.483809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:02.131681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"133'48","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.139625+0000","last_change":"2024-09-10T05:59:17.139625+0000","last_active":"2024-09-10T05:59:17.139625+0000","last_peered":"2024-09-10T05:59:17.139625+0000","last_clean":"2024-09-10T05:59:17.139625+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:59:17.139625+0000","last_undegraded":"2024-09-10T05:59:17.139625+0000","last_fullsized":"2024-09-10T05:59:17.139625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'48","last_scrub_stamp":"2024-09-10T05:59:17.139441+0000","last_deep_scrub":"133'48","last_deep_scrub_stamp":"2024-09-10T05:59:17.139441+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.139441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.787313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811956+0000","last_change":"2024-09-10T05:58:38.995573+0000","last_active":"2024-09-10T05:59:01.811956+0000","last_peered":"2024-09-10T05:59:01.811956+0000","last_clean":"2024-09-10T05:59:01.811956+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:59:01.811956+0000","last_undegraded":"2024-09-10T05:59:01.811956+0000","last_fullsized":"2024-09-10T05:59:01.811956+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.727058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":62,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.116280+0000","last_change":"2024-09-10T05:59:30.116280+0000","last_active":"2024-09-10T05:59:30.116280+0000","last_peered":"2024-09-10T05:59:30.116280+0000","last_clean":"2024-09-10T05:59:30.116280+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:59:30.116280+0000","last_undegraded":"2024-09-10T05:59:30.116280+0000","last_fullsized":"2024-09-10T05:59:30.116280+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'8","last_scrub_stamp":"2024-09-10T05:59:30.116053+0000","last_deep_scrub":"103'8","last_deep_scrub_stamp":"2024-09-10T05:59:30.116053+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.116053+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.773741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"133'38","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.300210+0000","last_change":"2024-09-10T05:59:22.300210+0000","last_active":"2024-09-10T05:59:22.300210+0000","last_peered":"2024-09-10T05:59:22.300210+0000","last_clean":"2024-09-10T05:59:22.300210+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:59:22.300210+0000","last_undegraded":"2024-09-10T05:59:22.300210+0000","last_fullsized":"2024-09-10T05:59:22.300210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:22.300019+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:22.300019+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.300019+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:03.852729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976010+0000","last_change":"2024-09-10T05:55:26.572810+0000","last_active":"2024-09-10T05:59:01.976010+0000","last_peered":"2024-09-10T05:59:01.976010+0000","last_clean":"2024-09-10T05:59:01.976010+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:59:01.976010+0000","last_undegraded":"2024-09-10T05:59:01.976010+0000","last_fullsized":"2024-09-10T05:59:01.976010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:12.058148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"133'33","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.029815+0000","last_change":"2024-09-10T05:55:28.571288+0000","last_active":"2024-09-10T05:59:09.029815+0000","last_peered":"2024-09-10T05:59:09.029815+0000","last_clean":"2024-09-10T05:59:09.029815+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:59:09.029815+0000","last_undegraded":"2024-09-10T05:59:09.029815+0000","last_fullsized":"2024-09-10T05:59:09.029815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:02.204867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972175+0000","last_change":"2024-09-10T05:55:30.611190+0000","last_active":"2024-09-10T05:59:01.972175+0000","last_peered":"2024-09-10T05:59:01.972175+0000","last_clean":"2024-09-10T05:59:01.972175+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:59:01.972175+0000","last_undegraded":"2024-09-10T05:59:01.972175+0000","last_fullsized":"2024-09-10T05:59:01.972175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:20.945763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"111'48","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972638+0000","last_change":"2024-09-10T05:55:32.640140+0000","last_active":"2024-09-10T05:59:01.972638+0000","last_peered":"2024-09-10T05:59:01.972638+0000","last_clean":"2024-09-10T05:59:01.972638+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:59:01.972638+0000","last_undegraded":"2024-09-10T05:59:01.972638+0000","last_fullsized":"2024-09-10T05:59:01.972638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:05.505018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.769048+0000","last_change":"2024-09-10T05:59:27.769048+0000","last_active":"2024-09-10T05:59:27.769048+0000","last_peered":"2024-09-10T05:59:27.769048+0000","last_clean":"2024-09-10T05:59:27.769048+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:59:27.769048+0000","last_undegraded":"2024-09-10T05:59:27.769048+0000","last_fullsized":"2024-09-10T05:59:27.769048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:27.768858+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:27.768858+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.768858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:19.267676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"133'52","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.221937+0000","last_change":"2024-09-10T05:59:13.221937+0000","last_active":"2024-09-10T05:59:13.221937+0000","last_peered":"2024-09-10T05:59:13.221937+0000","last_clean":"2024-09-10T05:59:13.221937+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:59:13.221937+0000","last_undegraded":"2024-09-10T05:59:13.221937+0000","last_fullsized":"2024-09-10T05:59:13.221937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'52","last_scrub_stamp":"2024-09-10T05:59:13.221868+0000","last_deep_scrub":"133'52","last_deep_scrub_stamp":"2024-09-10T05:59:13.221868+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.221868+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:13.680028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825797+0000","last_change":"2024-09-10T05:58:36.074698+0000","last_active":"2024-09-10T05:59:01.825797+0000","last_peered":"2024-09-10T05:59:01.825797+0000","last_clean":"2024-09-10T05:59:01.825797+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:59:01.825797+0000","last_undegraded":"2024-09-10T05:59:01.825797+0000","last_fullsized":"2024-09-10T05:59:01.825797+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:37.044312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'12","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814922+0000","last_change":"2024-09-10T05:55:28.578723+0000","last_active":"2024-09-10T05:59:01.814922+0000","last_peered":"2024-09-10T05:59:01.814922+0000","last_clean":"2024-09-10T05:59:01.814922+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:59:01.814922+0000","last_undegraded":"2024-09-10T05:59:01.814922+0000","last_fullsized":"2024-09-10T05:59:01.814922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:41.713094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814332+0000","last_change":"2024-09-10T05:55:30.600612+0000","last_active":"2024-09-10T05:59:01.814332+0000","last_peered":"2024-09-10T05:59:01.814332+0000","last_clean":"2024-09-10T05:59:01.814332+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:59:01.814332+0000","last_undegraded":"2024-09-10T05:59:01.814332+0000","last_fullsized":"2024-09-10T05:59:01.814332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:55.956288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813141+0000","last_change":"2024-09-10T05:55:32.635450+0000","last_active":"2024-09-10T05:59:01.813141+0000","last_peered":"2024-09-10T05:59:01.813141+0000","last_clean":"2024-09-10T05:59:01.813141+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:59:01.813141+0000","last_undegraded":"2024-09-10T05:59:01.813141+0000","last_fullsized":"2024-09-10T05:59:01.813141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:06.875066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.113422+0000","last_change":"2024-09-10T05:59:24.113422+0000","last_active":"2024-09-10T05:59:24.113422+0000","last_peered":"2024-09-10T05:59:24.113422+0000","last_clean":"2024-09-10T05:59:24.113422+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:59:24.113422+0000","last_undegraded":"2024-09-10T05:59:24.113422+0000","last_fullsized":"2024-09-10T05:59:24.113422+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'2","last_scrub_stamp":"2024-09-10T05:59:24.113230+0000","last_deep_scrub":"111'2","last_deep_scrub_stamp":"2024-09-10T05:59:24.113230+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.113230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:07.148758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"133'54","reported_seq":291,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.262120+0000","last_change":"2024-09-10T05:59:20.262120+0000","last_active":"2024-09-10T05:59:20.262120+0000","last_peered":"2024-09-10T05:59:20.262120+0000","last_clean":"2024-09-10T05:59:20.262120+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:59:20.262120+0000","last_undegraded":"2024-09-10T05:59:20.262120+0000","last_fullsized":"2024-09-10T05:59:20.262120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:20.261802+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:20.261802+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.261802+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:35.355854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825597+0000","last_change":"2024-09-10T05:58:36.086954+0000","last_active":"2024-09-10T05:59:01.825597+0000","last_peered":"2024-09-10T05:59:01.825597+0000","last_clean":"2024-09-10T05:59:01.825597+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:59:01.825597+0000","last_undegraded":"2024-09-10T05:59:01.825597+0000","last_fullsized":"2024-09-10T05:59:01.825597+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:57.423283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"133'30","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.101039+0000","last_change":"2024-09-10T05:59:33.101039+0000","last_active":"2024-09-10T05:59:33.101039+0000","last_peered":"2024-09-10T05:59:33.101039+0000","last_clean":"2024-09-10T05:59:33.101039+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:59:33.101039+0000","last_undegraded":"2024-09-10T05:59:33.101039+0000","last_fullsized":"2024-09-10T05:59:33.101039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'30","last_scrub_stamp":"2024-09-10T05:59:33.100884+0000","last_deep_scrub":"133'30","last_deep_scrub_stamp":"2024-09-10T05:59:33.100884+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.100884+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:23.874400+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"133'138","reported_seq":391,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.968635+0000","last_change":"2024-09-10T05:55:30.618896+0000","last_active":"2024-09-10T05:59:07.968635+0000","last_peered":"2024-09-10T05:59:07.968635+0000","last_clean":"2024-09-10T05:59:07.968635+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:59:07.968635+0000","last_undegraded":"2024-09-10T05:59:07.968635+0000","last_fullsized":"2024-09-10T05:59:07.968635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:21.133942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812887+0000","last_change":"2024-09-10T05:55:32.863286+0000","last_active":"2024-09-10T05:59:01.812887+0000","last_peered":"2024-09-10T05:59:01.812887+0000","last_clean":"2024-09-10T05:59:01.812887+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:59:01.812887+0000","last_undegraded":"2024-09-10T05:59:01.812887+0000","last_fullsized":"2024-09-10T05:59:01.812887+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:09.155483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.079942+0000","last_change":"2024-09-10T05:59:31.079942+0000","last_active":"2024-09-10T05:59:31.079942+0000","last_peered":"2024-09-10T05:59:31.079942+0000","last_clean":"2024-09-10T05:59:31.079942+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:59:31.079942+0000","last_undegraded":"2024-09-10T05:59:31.079942+0000","last_fullsized":"2024-09-10T05:59:31.079942+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-09-10T05:59:31.079752+0000","last_deep_scrub":"66'8","last_deep_scrub_stamp":"2024-09-10T05:59:31.079752+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.079752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:14.479371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"133'36","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.705129+0000","last_change":"2024-09-10T05:59:17.705129+0000","last_active":"2024-09-10T05:59:17.705129+0000","last_peered":"2024-09-10T05:59:17.705129+0000","last_clean":"2024-09-10T05:59:17.705129+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:59:17.705129+0000","last_undegraded":"2024-09-10T05:59:17.705129+0000","last_fullsized":"2024-09-10T05:59:17.705129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'36","last_scrub_stamp":"2024-09-10T05:59:17.704952+0000","last_deep_scrub":"133'36","last_deep_scrub_stamp":"2024-09-10T05:59:17.704952+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.704952+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:22.199421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975529+0000","last_change":"2024-09-10T05:58:36.076514+0000","last_active":"2024-09-10T05:59:01.975529+0000","last_peered":"2024-09-10T05:59:01.975529+0000","last_clean":"2024-09-10T05:59:01.975529+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:59:01.975529+0000","last_undegraded":"2024-09-10T05:59:01.975529+0000","last_fullsized":"2024-09-10T05:59:01.975529+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:58.186754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"133'26","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.008675+0000","last_change":"2024-09-10T05:55:28.616002+0000","last_active":"2024-09-10T05:59:09.008675+0000","last_peered":"2024-09-10T05:59:09.008675+0000","last_clean":"2024-09-10T05:59:09.008675+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:59:09.008675+0000","last_undegraded":"2024-09-10T05:59:09.008675+0000","last_fullsized":"2024-09-10T05:59:09.008675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:49.983141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"133'145","reported_seq":351,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.974998+0000","last_change":"2024-09-10T05:58:42.104842+0000","last_active":"2024-09-10T05:59:07.974998+0000","last_peered":"2024-09-10T05:59:07.974998+0000","last_clean":"2024-09-10T05:59:07.974998+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:59:07.974998+0000","last_undegraded":"2024-09-10T05:59:07.974998+0000","last_fullsized":"2024-09-10T05:59:07.974998+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:06.712578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.813046+0000","last_change":"2024-09-10T05:59:26.813046+0000","last_active":"2024-09-10T05:59:26.813046+0000","last_peered":"2024-09-10T05:59:26.813046+0000","last_clean":"2024-09-10T05:59:26.813046+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:59:26.813046+0000","last_undegraded":"2024-09-10T05:59:26.813046+0000","last_fullsized":"2024-09-10T05:59:26.813046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-09-10T05:59:26.812862+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-09-10T05:59:26.812862+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.812862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:30.388499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"133'54","reported_seq":291,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.257223+0000","last_change":"2024-09-10T05:59:27.257223+0000","last_active":"2024-09-10T05:59:27.257223+0000","last_peered":"2024-09-10T05:59:27.257223+0000","last_clean":"2024-09-10T05:59:27.257223+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:59:27.257223+0000","last_undegraded":"2024-09-10T05:59:27.257223+0000","last_fullsized":"2024-09-10T05:59:27.257223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:27.256940+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:27.256940+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.256940+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:19.723739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969010+0000","last_change":"2024-09-10T05:55:26.573563+0000","last_active":"2024-09-10T05:59:01.969010+0000","last_peered":"2024-09-10T05:59:01.969010+0000","last_clean":"2024-09-10T05:59:01.969010+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:59:01.969010+0000","last_undegraded":"2024-09-10T05:59:01.969010+0000","last_fullsized":"2024-09-10T05:59:01.969010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:10.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"133'39","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.048271+0000","last_change":"2024-09-10T05:55:28.611343+0000","last_active":"2024-09-10T05:59:09.048271+0000","last_peered":"2024-09-10T05:59:09.048271+0000","last_clean":"2024-09-10T05:59:09.048271+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:59:09.048271+0000","last_undegraded":"2024-09-10T05:59:09.048271+0000","last_fullsized":"2024-09-10T05:59:09.048271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:34.288062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969386+0000","last_change":"2024-09-10T05:55:30.620232+0000","last_active":"2024-09-10T05:59:01.969386+0000","last_peered":"2024-09-10T05:59:01.969386+0000","last_clean":"2024-09-10T05:59:01.969386+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:59:01.969386+0000","last_undegraded":"2024-09-10T05:59:01.969386+0000","last_fullsized":"2024-09-10T05:59:01.969386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:05:23.900677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975163+0000","last_change":"2024-09-10T05:55:32.643387+0000","last_active":"2024-09-10T05:59:01.975163+0000","last_peered":"2024-09-10T05:59:01.975163+0000","last_clean":"2024-09-10T05:59:01.975163+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:59:01.975163+0000","last_undegraded":"2024-09-10T05:59:01.975163+0000","last_fullsized":"2024-09-10T05:59:01.975163+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:50.891499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.346192+0000","last_change":"2024-09-10T05:59:20.346192+0000","last_active":"2024-09-10T05:59:20.346192+0000","last_peered":"2024-09-10T05:59:20.346192+0000","last_clean":"2024-09-10T05:59:20.346192+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:59:20.346192+0000","last_undegraded":"2024-09-10T05:59:20.346192+0000","last_fullsized":"2024-09-10T05:59:20.346192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'6","last_scrub_stamp":"2024-09-10T05:59:20.345996+0000","last_deep_scrub":"74'6","last_deep_scrub_stamp":"2024-09-10T05:59:20.345996+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.345996+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:56.797598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"133'42","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.224830+0000","last_change":"2024-09-10T05:59:19.224830+0000","last_active":"2024-09-10T05:59:19.224830+0000","last_peered":"2024-09-10T05:59:19.224830+0000","last_clean":"2024-09-10T05:59:19.224830+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:59:19.224830+0000","last_undegraded":"2024-09-10T05:59:19.224830+0000","last_fullsized":"2024-09-10T05:59:19.224830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:19.224654+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:19.224654+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.224654+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:57.810616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.110104+0000","last_change":"2024-09-10T05:59:27.110104+0000","last_active":"2024-09-10T05:59:27.110104+0000","last_peered":"2024-09-10T05:59:27.110104+0000","last_clean":"2024-09-10T05:59:27.110104+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:59:27.110104+0000","last_undegraded":"2024-09-10T05:59:27.110104+0000","last_fullsized":"2024-09-10T05:59:27.110104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:27.109911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:27.109911+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.109911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:49.714306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"133'26","reported_seq":63,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.564810+0000","last_change":"2024-09-10T05:58:41.124218+0000","last_active":"2024-09-10T05:59:08.564810+0000","last_peered":"2024-09-10T05:59:08.564810+0000","last_clean":"2024-09-10T05:59:08.564810+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:59:08.564810+0000","last_undegraded":"2024-09-10T05:59:08.564810+0000","last_fullsized":"2024-09-10T05:59:08.564810+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:13.232943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823296+0000","last_change":"2024-09-10T05:58:36.068634+0000","last_active":"2024-09-10T05:59:01.823296+0000","last_peered":"2024-09-10T05:59:01.823296+0000","last_clean":"2024-09-10T05:59:01.823296+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:59:01.823296+0000","last_undegraded":"2024-09-10T05:59:01.823296+0000","last_fullsized":"2024-09-10T05:59:01.823296+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:54.848895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.977060+0000","last_change":"2024-09-10T05:55:32.640561+0000","last_active":"2024-09-10T05:59:01.977060+0000","last_peered":"2024-09-10T05:59:01.977060+0000","last_clean":"2024-09-10T05:59:01.977060+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:59:01.977060+0000","last_undegraded":"2024-09-10T05:59:01.977060+0000","last_fullsized":"2024-09-10T05:59:01.977060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:28.607393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.504084+0000","last_change":"2024-09-10T05:59:24.504084+0000","last_active":"2024-09-10T05:59:24.504084+0000","last_peered":"2024-09-10T05:59:24.504084+0000","last_clean":"2024-09-10T05:59:24.504084+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:59:24.504084+0000","last_undegraded":"2024-09-10T05:59:24.504084+0000","last_fullsized":"2024-09-10T05:59:24.504084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-09-10T05:59:24.503907+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-09-10T05:59:24.503907+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.503907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:17.200118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"133'46","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.239568+0000","last_change":"2024-09-10T05:59:18.239568+0000","last_active":"2024-09-10T05:59:18.239568+0000","last_peered":"2024-09-10T05:59:18.239568+0000","last_clean":"2024-09-10T05:59:18.239568+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:59:18.239568+0000","last_undegraded":"2024-09-10T05:59:18.239568+0000","last_fullsized":"2024-09-10T05:59:18.239568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:18.239395+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:18.239395+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.239395+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:20.990720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.078249+0000","last_change":"2024-09-10T05:59:25.078249+0000","last_active":"2024-09-10T05:59:25.078249+0000","last_peered":"2024-09-10T05:59:25.078249+0000","last_clean":"2024-09-10T05:59:25.078249+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:59:25.078249+0000","last_undegraded":"2024-09-10T05:59:25.078249+0000","last_fullsized":"2024-09-10T05:59:25.078249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:25.078074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:25.078074+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.078074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:26.337074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"133'38","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.065568+0000","last_change":"2024-09-10T05:55:28.578636+0000","last_active":"2024-09-10T05:59:08.065568+0000","last_peered":"2024-09-10T05:59:08.065568+0000","last_clean":"2024-09-10T05:59:08.065568+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:59:08.065568+0000","last_undegraded":"2024-09-10T05:59:08.065568+0000","last_fullsized":"2024-09-10T05:59:08.065568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:14.491275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"133'138","reported_seq":468,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.976502+0000","last_change":"2024-09-10T05:55:30.628872+0000","last_active":"2024-09-10T05:59:07.976502+0000","last_peered":"2024-09-10T05:59:07.976502+0000","last_clean":"2024-09-10T05:59:07.976502+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:59:07.976502+0000","last_undegraded":"2024-09-10T05:59:07.976502+0000","last_fullsized":"2024-09-10T05:59:07.976502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:30:52.403500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815295+0000","last_change":"2024-09-10T05:55:32.635226+0000","last_active":"2024-09-10T05:59:01.815295+0000","last_peered":"2024-09-10T05:59:01.815295+0000","last_clean":"2024-09-10T05:59:01.815295+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:59:01.815295+0000","last_undegraded":"2024-09-10T05:59:01.815295+0000","last_fullsized":"2024-09-10T05:59:01.815295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:15.769517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.048860+0000","last_change":"2024-09-10T05:59:22.048860+0000","last_active":"2024-09-10T05:59:22.048860+0000","last_peered":"2024-09-10T05:59:22.048860+0000","last_clean":"2024-09-10T05:59:22.048860+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:59:22.048860+0000","last_undegraded":"2024-09-10T05:59:22.048860+0000","last_fullsized":"2024-09-10T05:59:22.048860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T05:59:22.048665+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T05:59:22.048665+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.048665+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:35.022156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"133'24","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.177427+0000","last_change":"2024-09-10T05:59:14.177356+0000","last_active":"2024-09-10T05:59:14.177427+0000","last_peered":"2024-09-10T05:59:14.177427+0000","last_clean":"2024-09-10T05:59:14.177427+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:59:14.177427+0000","last_undegraded":"2024-09-10T05:59:14.177427+0000","last_fullsized":"2024-09-10T05:59:14.177427+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'24","last_scrub_stamp":"2024-09-10T05:59:14.177259+0000","last_deep_scrub":"133'24","last_deep_scrub_stamp":"2024-09-10T05:59:14.177259+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.177259+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:32.433365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.072322+0000","last_change":"2024-09-10T05:59:31.072322+0000","last_active":"2024-09-10T05:59:31.072322+0000","last_peered":"2024-09-10T05:59:31.072322+0000","last_clean":"2024-09-10T05:59:31.072322+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:59:31.072322+0000","last_undegraded":"2024-09-10T05:59:31.072322+0000","last_fullsized":"2024-09-10T05:59:31.072322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:31.072032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:31.072032+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.072032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:15.179235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"133'46","reported_seq":292,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.576565+0000","last_change":"2024-09-10T05:55:28.576518+0000","last_active":"2024-09-10T05:59:08.576565+0000","last_peered":"2024-09-10T05:59:08.576565+0000","last_clean":"2024-09-10T05:59:08.576565+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:59:08.576565+0000","last_undegraded":"2024-09-10T05:59:08.576565+0000","last_fullsized":"2024-09-10T05:59:08.576565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:43.392974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.088982+0000","last_change":"2024-09-10T05:59:32.088982+0000","last_active":"2024-09-10T05:59:32.088982+0000","last_peered":"2024-09-10T05:59:32.088982+0000","last_clean":"2024-09-10T05:59:32.088982+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:59:32.088982+0000","last_undegraded":"2024-09-10T05:59:32.088982+0000","last_fullsized":"2024-09-10T05:59:32.088982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:32.088724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:32.088724+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.088724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:21.779136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'5","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970802+0000","last_change":"2024-09-10T05:58:39.385287+0000","last_active":"2024-09-10T05:59:01.970802+0000","last_peered":"2024-09-10T05:59:01.970802+0000","last_clean":"2024-09-10T05:59:01.970802+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:59:01.970802+0000","last_undegraded":"2024-09-10T05:59:01.970802+0000","last_fullsized":"2024-09-10T05:59:01.970802+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:27.225607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.314015+0000","last_change":"2024-09-10T05:59:21.314015+0000","last_active":"2024-09-10T05:59:21.314015+0000","last_peered":"2024-09-10T05:59:21.314015+0000","last_clean":"2024-09-10T05:59:21.314015+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:59:21.314015+0000","last_undegraded":"2024-09-10T05:59:21.314015+0000","last_fullsized":"2024-09-10T05:59:21.314015+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T05:59:21.313832+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T05:59:21.313832+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.313832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:34.018244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"133'54","reported_seq":135,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.889841+0000","last_change":"2024-09-10T05:59:13.889841+0000","last_active":"2024-09-10T05:59:13.889841+0000","last_peered":"2024-09-10T05:59:13.889841+0000","last_clean":"2024-09-10T05:59:13.889841+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:59:13.889841+0000","last_undegraded":"2024-09-10T05:59:13.889841+0000","last_fullsized":"2024-09-10T05:59:13.889841+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:13.889656+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:13.889656+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.889656+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:42.591395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.077013+0000","last_change":"2024-09-10T05:59:26.077013+0000","last_active":"2024-09-10T05:59:26.077013+0000","last_peered":"2024-09-10T05:59:26.077013+0000","last_clean":"2024-09-10T05:59:26.077013+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:59:26.077013+0000","last_undegraded":"2024-09-10T05:59:26.077013+0000","last_fullsized":"2024-09-10T05:59:26.077013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:26.076829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:26.076829+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.076829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:44.583940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"133'32","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.847554+0000","last_change":"2024-09-10T05:55:28.581580+0000","last_active":"2024-09-10T05:59:08.847554+0000","last_peered":"2024-09-10T05:59:08.847554+0000","last_clean":"2024-09-10T05:59:08.847554+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:59:08.847554+0000","last_undegraded":"2024-09-10T05:59:08.847554+0000","last_fullsized":"2024-09-10T05:59:08.847554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:42.776888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":264,"num_write":24,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":235,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815733+0000","last_change":"2024-09-10T05:58:36.081028+0000","last_active":"2024-09-10T05:59:01.815733+0000","last_peered":"2024-09-10T05:59:01.815733+0000","last_clean":"2024-09-10T05:59:01.815733+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:59:01.815733+0000","last_undegraded":"2024-09-10T05:59:01.815733+0000","last_fullsized":"2024-09-10T05:59:01.815733+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:04:17.752342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"65'1","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822644+0000","last_change":"2024-09-10T05:58:42.021549+0000","last_active":"2024-09-10T05:59:01.822644+0000","last_peered":"2024-09-10T05:59:01.822644+0000","last_clean":"2024-09-10T05:59:01.822644+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:59:01.822644+0000","last_undegraded":"2024-09-10T05:59:01.822644+0000","last_fullsized":"2024-09-10T05:59:01.822644+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:23.621053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.352894+0000","last_change":"2024-09-10T05:59:22.352894+0000","last_active":"2024-09-10T05:59:22.352894+0000","last_peered":"2024-09-10T05:59:22.352894+0000","last_clean":"2024-09-10T05:59:22.352894+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:59:22.352894+0000","last_undegraded":"2024-09-10T05:59:22.352894+0000","last_fullsized":"2024-09-10T05:59:22.352894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T05:59:22.352679+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T05:59:22.352679+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.352679+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:54.767259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"133'50","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.725757+0000","last_change":"2024-09-10T05:59:16.725757+0000","last_active":"2024-09-10T05:59:16.725757+0000","last_peered":"2024-09-10T05:59:16.725757+0000","last_clean":"2024-09-10T05:59:16.725757+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:59:16.725757+0000","last_undegraded":"2024-09-10T05:59:16.725757+0000","last_fullsized":"2024-09-10T05:59:16.725757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.725575+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.725575+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.725575+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:07.521585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.049490+0000","last_change":"2024-09-10T05:59:29.049490+0000","last_active":"2024-09-10T05:59:29.049490+0000","last_peered":"2024-09-10T05:59:29.049490+0000","last_clean":"2024-09-10T05:59:29.049490+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:59:29.049490+0000","last_undegraded":"2024-09-10T05:59:29.049490+0000","last_fullsized":"2024-09-10T05:59:29.049490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:29.049294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:29.049294+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.049294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:55.584019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"133'32","reported_seq":357,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.099570+0000","last_change":"2024-09-10T05:59:29.099570+0000","last_active":"2024-09-10T05:59:29.099570+0000","last_peered":"2024-09-10T05:59:29.099570+0000","last_clean":"2024-09-10T05:59:29.099570+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:59:29.099570+0000","last_undegraded":"2024-09-10T05:59:29.099570+0000","last_fullsized":"2024-09-10T05:59:29.099570+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'32","last_scrub_stamp":"2024-09-10T05:59:29.099357+0000","last_deep_scrub":"133'32","last_deep_scrub_stamp":"2024-09-10T05:59:29.099357+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.099357+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:34.551717+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"133'138","reported_seq":413,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.046449+0000","last_change":"2024-09-10T05:59:30.046449+0000","last_active":"2024-09-10T05:59:30.046449+0000","last_peered":"2024-09-10T05:59:30.046449+0000","last_clean":"2024-09-10T05:59:30.046449+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:59:30.046449+0000","last_undegraded":"2024-09-10T05:59:30.046449+0000","last_fullsized":"2024-09-10T05:59:30.046449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'138","last_scrub_stamp":"2024-09-10T05:59:30.046270+0000","last_deep_scrub":"133'138","last_deep_scrub_stamp":"2024-09-10T05:59:30.046270+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.046270+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:46:45.058552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969247+0000","last_change":"2024-09-10T05:55:32.631907+0000","last_active":"2024-09-10T05:59:01.969247+0000","last_peered":"2024-09-10T05:59:01.969247+0000","last_clean":"2024-09-10T05:59:01.969247+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:59:01.969247+0000","last_undegraded":"2024-09-10T05:59:01.969247+0000","last_fullsized":"2024-09-10T05:59:01.969247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:29.311731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.308297+0000","last_change":"2024-09-10T05:59:23.308297+0000","last_active":"2024-09-10T05:59:23.308297+0000","last_peered":"2024-09-10T05:59:23.308297+0000","last_clean":"2024-09-10T05:59:23.308297+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:59:23.308297+0000","last_undegraded":"2024-09-10T05:59:23.308297+0000","last_fullsized":"2024-09-10T05:59:23.308297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:23.308106+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:23.308106+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.308106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:11.272295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"133'46","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.323087+0000","last_change":"2024-09-10T05:59:15.323087+0000","last_active":"2024-09-10T05:59:15.323087+0000","last_peered":"2024-09-10T05:59:15.323087+0000","last_clean":"2024-09-10T05:59:15.323087+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:59:15.323087+0000","last_undegraded":"2024-09-10T05:59:15.323087+0000","last_fullsized":"2024-09-10T05:59:15.323087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:15.322793+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:15.322793+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.322793+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:57.069261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":402,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.934237+0000","last_change":"2024-09-10T05:55:26.582956+0000","last_active":"2024-09-10T05:59:07.934237+0000","last_peered":"2024-09-10T05:59:07.934237+0000","last_clean":"2024-09-10T05:59:07.934237+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:59:07.934237+0000","last_undegraded":"2024-09-10T05:59:07.934237+0000","last_fullsized":"2024-09-10T05:59:07.934237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:54.247945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824969+0000","last_change":"2024-09-10T05:58:37.286390+0000","last_active":"2024-09-10T05:59:01.824969+0000","last_peered":"2024-09-10T05:59:01.824969+0000","last_clean":"2024-09-10T05:59:01.824969+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:59:01.824969+0000","last_undegraded":"2024-09-10T05:59:01.824969+0000","last_fullsized":"2024-09-10T05:59:01.824969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:08.545751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"133'138","reported_seq":437,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.972499+0000","last_change":"2024-09-10T05:55:30.619793+0000","last_active":"2024-09-10T05:59:07.972499+0000","last_peered":"2024-09-10T05:59:07.972499+0000","last_clean":"2024-09-10T05:59:07.972499+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:59:07.972499+0000","last_undegraded":"2024-09-10T05:59:07.972499+0000","last_fullsized":"2024-09-10T05:59:07.972499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:06.133825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812864+0000","last_change":"2024-09-10T05:55:32.640571+0000","last_active":"2024-09-10T05:59:01.812864+0000","last_peered":"2024-09-10T05:59:01.812864+0000","last_clean":"2024-09-10T05:59:01.812864+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:59:01.812864+0000","last_undegraded":"2024-09-10T05:59:01.812864+0000","last_fullsized":"2024-09-10T05:59:01.812864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.781291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":96,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.765276+0000","last_change":"2024-09-10T05:59:29.765276+0000","last_active":"2024-09-10T05:59:29.765276+0000","last_peered":"2024-09-10T05:59:29.765276+0000","last_clean":"2024-09-10T05:59:29.765276+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:59:29.765276+0000","last_undegraded":"2024-09-10T05:59:29.765276+0000","last_fullsized":"2024-09-10T05:59:29.765276+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:29.764996+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:29.764996+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.764996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:19.770367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"133'44","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.895942+0000","last_change":"2024-09-10T05:59:16.895942+0000","last_active":"2024-09-10T05:59:16.895942+0000","last_peered":"2024-09-10T05:59:16.895942+0000","last_clean":"2024-09-10T05:59:16.895942+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:59:16.895942+0000","last_undegraded":"2024-09-10T05:59:16.895942+0000","last_fullsized":"2024-09-10T05:59:16.895942+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:16.895758+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:16.895758+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.895758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:15.815655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814783+0000","last_change":"2024-09-10T05:55:26.574673+0000","last_active":"2024-09-10T05:59:01.814783+0000","last_peered":"2024-09-10T05:59:01.814783+0000","last_clean":"2024-09-10T05:59:01.814783+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:59:01.814783+0000","last_undegraded":"2024-09-10T05:59:01.814783+0000","last_fullsized":"2024-09-10T05:59:01.814783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:54.288798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"133'28","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.033186+0000","last_change":"2024-09-10T05:55:28.583438+0000","last_active":"2024-09-10T05:59:09.033186+0000","last_peered":"2024-09-10T05:59:09.033186+0000","last_clean":"2024-09-10T05:59:09.033186+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:59:09.033186+0000","last_undegraded":"2024-09-10T05:59:09.033186+0000","last_fullsized":"2024-09-10T05:59:09.033186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:23.342482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975062+0000","last_change":"2024-09-10T05:58:36.080814+0000","last_active":"2024-09-10T05:59:01.975062+0000","last_peered":"2024-09-10T05:59:01.975062+0000","last_clean":"2024-09-10T05:59:01.975062+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:59:01.975062+0000","last_undegraded":"2024-09-10T05:59:01.975062+0000","last_fullsized":"2024-09-10T05:59:01.975062+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:12.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969254+0000","last_change":"2024-09-10T05:55:32.630537+0000","last_active":"2024-09-10T05:59:01.969254+0000","last_peered":"2024-09-10T05:59:01.969254+0000","last_clean":"2024-09-10T05:59:01.969254+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:59:01.969254+0000","last_undegraded":"2024-09-10T05:59:01.969254+0000","last_fullsized":"2024-09-10T05:59:01.969254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:33.747231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.539521+0000","last_change":"2024-09-10T05:59:22.539521+0000","last_active":"2024-09-10T05:59:22.539521+0000","last_peered":"2024-09-10T05:59:22.539521+0000","last_clean":"2024-09-10T05:59:22.539521+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:59:22.539521+0000","last_undegraded":"2024-09-10T05:59:22.539521+0000","last_fullsized":"2024-09-10T05:59:22.539521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'12","last_scrub_stamp":"2024-09-10T05:59:22.539328+0000","last_deep_scrub":"111'12","last_deep_scrub_stamp":"2024-09-10T05:59:22.539328+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.539328+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:10.094325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"133'74","reported_seq":344,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.243617+0000","last_change":"2024-09-10T05:59:16.243617+0000","last_active":"2024-09-10T05:59:16.243617+0000","last_peered":"2024-09-10T05:59:16.243617+0000","last_clean":"2024-09-10T05:59:16.243617+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:59:16.243617+0000","last_undegraded":"2024-09-10T05:59:16.243617+0000","last_fullsized":"2024-09-10T05:59:16.243617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'74","last_scrub_stamp":"2024-09-10T05:59:16.243416+0000","last_deep_scrub":"133'74","last_deep_scrub_stamp":"2024-09-10T05:59:16.243416+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.243416+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:35.743548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"133'2","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.646741+0000","last_change":"2024-09-10T05:59:15.646611+0000","last_active":"2024-09-10T05:59:15.646741+0000","last_peered":"2024-09-10T05:59:15.646741+0000","last_clean":"2024-09-10T05:59:15.646741+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:59:15.646741+0000","last_undegraded":"2024-09-10T05:59:15.646741+0000","last_fullsized":"2024-09-10T05:59:15.646741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:15.646413+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:15.646413+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.646413+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:45.901294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"133'56","reported_seq":138,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.926657+0000","last_change":"2024-09-10T05:59:15.926657+0000","last_active":"2024-09-10T05:59:15.926657+0000","last_peered":"2024-09-10T05:59:15.926657+0000","last_clean":"2024-09-10T05:59:15.926657+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:59:15.926657+0000","last_undegraded":"2024-09-10T05:59:15.926657+0000","last_fullsized":"2024-09-10T05:59:15.926657+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'56","last_scrub_stamp":"2024-09-10T05:59:15.926475+0000","last_deep_scrub":"133'56","last_deep_scrub_stamp":"2024-09-10T05:59:15.926475+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.926475+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:13.197420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970305+0000","last_change":"2024-09-10T05:55:26.582546+0000","last_active":"2024-09-10T05:59:01.970305+0000","last_peered":"2024-09-10T05:59:01.970305+0000","last_clean":"2024-09-10T05:59:01.970305+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:59:01.970305+0000","last_undegraded":"2024-09-10T05:59:01.970305+0000","last_fullsized":"2024-09-10T05:59:01.970305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:19.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"133'52","reported_seq":378,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.040306+0000","last_change":"2024-09-10T05:58:40.775802+0000","last_active":"2024-09-10T05:59:09.040306+0000","last_peered":"2024-09-10T05:59:09.040306+0000","last_clean":"2024-09-10T05:59:09.040306+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:59:09.040306+0000","last_undegraded":"2024-09-10T05:59:09.040306+0000","last_fullsized":"2024-09-10T05:59:09.040306+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:20.223922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815484+0000","last_change":"2024-09-10T05:55:30.627852+0000","last_active":"2024-09-10T05:59:01.815484+0000","last_peered":"2024-09-10T05:59:01.815484+0000","last_clean":"2024-09-10T05:59:01.815484+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:59:01.815484+0000","last_undegraded":"2024-09-10T05:59:01.815484+0000","last_fullsized":"2024-09-10T05:59:01.815484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:41.385873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973038+0000","last_change":"2024-09-10T05:55:32.631329+0000","last_active":"2024-09-10T05:59:01.973038+0000","last_peered":"2024-09-10T05:59:01.973038+0000","last_clean":"2024-09-10T05:59:01.973038+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:59:01.973038+0000","last_undegraded":"2024-09-10T05:59:01.973038+0000","last_fullsized":"2024-09-10T05:59:01.973038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.676348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.075198+0000","last_change":"2024-09-10T05:59:23.075198+0000","last_active":"2024-09-10T05:59:23.075198+0000","last_peered":"2024-09-10T05:59:23.075198+0000","last_clean":"2024-09-10T05:59:23.075198+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:59:23.075198+0000","last_undegraded":"2024-09-10T05:59:23.075198+0000","last_fullsized":"2024-09-10T05:59:23.075198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:23.075016+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:23.075016+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.075016+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.671303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.292569+0000","last_change":"2024-09-10T05:59:23.292569+0000","last_active":"2024-09-10T05:59:23.292569+0000","last_peered":"2024-09-10T05:59:23.292569+0000","last_clean":"2024-09-10T05:59:23.292569+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:59:23.292569+0000","last_undegraded":"2024-09-10T05:59:23.292569+0000","last_fullsized":"2024-09-10T05:59:23.292569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:23.292366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:23.292366+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.292366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:38.097881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"133'38","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.205509+0000","last_change":"2024-09-10T05:59:14.205465+0000","last_active":"2024-09-10T05:59:14.205509+0000","last_peered":"2024-09-10T05:59:14.205509+0000","last_clean":"2024-09-10T05:59:14.205509+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:59:14.205509+0000","last_undegraded":"2024-09-10T05:59:14.205509+0000","last_fullsized":"2024-09-10T05:59:14.205509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:14.205402+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:14.205402+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.205402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:57.869179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.979956+0000","last_change":"2024-09-10T05:55:26.573018+0000","last_active":"2024-09-10T05:59:01.979956+0000","last_peered":"2024-09-10T05:59:01.979956+0000","last_clean":"2024-09-10T05:59:01.979956+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:59:01.979956+0000","last_undegraded":"2024-09-10T05:59:01.979956+0000","last_fullsized":"2024-09-10T05:59:01.979956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:59.424385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"133'162","reported_seq":506,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.042645+0000","last_change":"2024-09-10T05:59:33.042645+0000","last_active":"2024-09-10T05:59:33.042645+0000","last_peered":"2024-09-10T05:59:33.042645+0000","last_clean":"2024-09-10T05:59:33.042645+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:59:33.042645+0000","last_undegraded":"2024-09-10T05:59:33.042645+0000","last_fullsized":"2024-09-10T05:59:33.042645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'162","last_scrub_stamp":"2024-09-10T05:59:33.042447+0000","last_deep_scrub":"133'162","last_deep_scrub_stamp":"2024-09-10T05:59:33.042447+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.042447+0000","objects_scrubbed":11,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:05.457027+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":209,"num_read_kb":199,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970038+0000","last_change":"2024-09-10T05:55:30.603778+0000","last_active":"2024-09-10T05:59:01.970038+0000","last_peered":"2024-09-10T05:59:01.970038+0000","last_clean":"2024-09-10T05:59:01.970038+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:59:01.970038+0000","last_undegraded":"2024-09-10T05:59:01.970038+0000","last_fullsized":"2024-09-10T05:59:01.970038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:33.431234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969029+0000","last_change":"2024-09-10T05:55:32.862856+0000","last_active":"2024-09-10T05:59:01.969029+0000","last_peered":"2024-09-10T05:59:01.969029+0000","last_clean":"2024-09-10T05:59:01.969029+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:59:01.969029+0000","last_undegraded":"2024-09-10T05:59:01.969029+0000","last_fullsized":"2024-09-10T05:59:01.969029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:42.936403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.981529+0000","last_change":"2024-09-10T05:59:22.981529+0000","last_active":"2024-09-10T05:59:22.981529+0000","last_peered":"2024-09-10T05:59:22.981529+0000","last_clean":"2024-09-10T05:59:22.981529+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:59:22.981529+0000","last_undegraded":"2024-09-10T05:59:22.981529+0000","last_fullsized":"2024-09-10T05:59:22.981529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'4","last_scrub_stamp":"2024-09-10T05:59:22.981296+0000","last_deep_scrub":"103'4","last_deep_scrub_stamp":"2024-09-10T05:59:22.981296+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.981296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:50.386060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.147695+0000","last_change":"2024-09-10T05:59:13.147566+0000","last_active":"2024-09-10T05:59:13.147695+0000","last_peered":"2024-09-10T05:59:13.147695+0000","last_clean":"2024-09-10T05:59:13.147695+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:59:13.147695+0000","last_undegraded":"2024-09-10T05:59:13.147695+0000","last_fullsized":"2024-09-10T05:59:13.147695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:13.147335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:13.147335+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.147335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:49.739019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"133'44","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.996627+0000","last_change":"2024-09-10T05:59:14.996552+0000","last_active":"2024-09-10T05:59:14.996627+0000","last_peered":"2024-09-10T05:59:14.996627+0000","last_clean":"2024-09-10T05:59:14.996627+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:59:14.996627+0000","last_undegraded":"2024-09-10T05:59:14.996627+0000","last_fullsized":"2024-09-10T05:59:14.996627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:14.996448+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:14.996448+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.996448+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:47.774831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"133'2","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.098311+0000","last_change":"2024-09-10T05:59:22.098311+0000","last_active":"2024-09-10T05:59:22.098311+0000","last_peered":"2024-09-10T05:59:22.098311+0000","last_clean":"2024-09-10T05:59:22.098311+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:59:22.098311+0000","last_undegraded":"2024-09-10T05:59:22.098311+0000","last_fullsized":"2024-09-10T05:59:22.098311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:22.098112+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:22.098112+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.098112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:14.941418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"131'16","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970890+0000","last_change":"2024-09-10T05:55:28.615439+0000","last_active":"2024-09-10T05:59:01.970890+0000","last_peered":"2024-09-10T05:59:01.970890+0000","last_clean":"2024-09-10T05:59:01.970890+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:59:01.970890+0000","last_undegraded":"2024-09-10T05:59:01.970890+0000","last_fullsized":"2024-09-10T05:59:01.970890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:44.544841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.146930+0000","last_change":"2024-09-10T05:59:33.146930+0000","last_active":"2024-09-10T05:59:33.146930+0000","last_peered":"2024-09-10T05:59:33.146930+0000","last_clean":"2024-09-10T05:59:33.146930+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:59:33.146930+0000","last_undegraded":"2024-09-10T05:59:33.146930+0000","last_fullsized":"2024-09-10T05:59:33.146930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:33.146746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:33.146746+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.146746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:03:13.729577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825738+0000","last_change":"2024-09-10T05:58:36.090394+0000","last_active":"2024-09-10T05:59:01.825738+0000","last_peered":"2024-09-10T05:59:01.825738+0000","last_clean":"2024-09-10T05:59:01.825738+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:59:01.825738+0000","last_undegraded":"2024-09-10T05:59:01.825738+0000","last_fullsized":"2024-09-10T05:59:01.825738+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:49.622437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.985701+0000","last_change":"2024-09-10T05:59:21.985568+0000","last_active":"2024-09-10T05:59:21.985701+0000","last_peered":"2024-09-10T05:59:21.985701+0000","last_clean":"2024-09-10T05:59:21.985701+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:59:21.985701+0000","last_undegraded":"2024-09-10T05:59:21.985701+0000","last_fullsized":"2024-09-10T05:59:21.985701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'6","last_scrub_stamp":"2024-09-10T05:59:21.985378+0000","last_deep_scrub":"103'6","last_deep_scrub_stamp":"2024-09-10T05:59:21.985378+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.985378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:59.699711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"133'3","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.651486+0000","last_change":"2024-09-10T05:59:14.651339+0000","last_active":"2024-09-10T05:59:14.651486+0000","last_peered":"2024-09-10T05:59:14.651486+0000","last_clean":"2024-09-10T05:59:14.651486+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:59:14.651486+0000","last_undegraded":"2024-09-10T05:59:14.651486+0000","last_fullsized":"2024-09-10T05:59:14.651486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'3","last_scrub_stamp":"2024-09-10T05:59:14.651126+0000","last_deep_scrub":"133'3","last_deep_scrub_stamp":"2024-09-10T05:59:14.651126+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.651126+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:50.020791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"133'70","reported_seq":305,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.312434+0000","last_change":"2024-09-10T05:59:14.312294+0000","last_active":"2024-09-10T05:59:14.312434+0000","last_peered":"2024-09-10T05:59:14.312434+0000","last_clean":"2024-09-10T05:59:14.312434+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:59:14.312434+0000","last_undegraded":"2024-09-10T05:59:14.312434+0000","last_fullsized":"2024-09-10T05:59:14.312434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'70","last_scrub_stamp":"2024-09-10T05:59:14.312107+0000","last_deep_scrub":"133'70","last_deep_scrub_stamp":"2024-09-10T05:59:14.312107+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.312107+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:41.908033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.109196+0000","last_change":"2024-09-10T05:59:30.109196+0000","last_active":"2024-09-10T05:59:30.109196+0000","last_peered":"2024-09-10T05:59:30.109196+0000","last_clean":"2024-09-10T05:59:30.109196+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:59:30.109196+0000","last_undegraded":"2024-09-10T05:59:30.109196+0000","last_fullsized":"2024-09-10T05:59:30.109196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:30.108975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:30.108975+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.108975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:12.258423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"133'18","reported_seq":72,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.998682+0000","last_change":"2024-09-10T05:59:33.998682+0000","last_active":"2024-09-10T05:59:33.998682+0000","last_peered":"2024-09-10T05:59:33.998682+0000","last_clean":"2024-09-10T05:59:33.998682+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:59:33.998682+0000","last_undegraded":"2024-09-10T05:59:33.998682+0000","last_fullsized":"2024-09-10T05:59:33.998682+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'18","last_scrub_stamp":"2024-09-10T05:59:33.998580+0000","last_deep_scrub":"133'18","last_deep_scrub_stamp":"2024-09-10T05:59:33.998580+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.998580+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:47.716605+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978658+0000","last_change":"2024-09-10T05:55:30.632058+0000","last_active":"2024-09-10T05:59:01.978658+0000","last_peered":"2024-09-10T05:59:01.978658+0000","last_clean":"2024-09-10T05:59:01.978658+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:59:01.978658+0000","last_undegraded":"2024-09-10T05:59:01.978658+0000","last_fullsized":"2024-09-10T05:59:01.978658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:48.531525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.971389+0000","last_change":"2024-09-10T05:58:40.735106+0000","last_active":"2024-09-10T05:59:01.971389+0000","last_peered":"2024-09-10T05:59:01.971389+0000","last_clean":"2024-09-10T05:59:01.971389+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:59:01.971389+0000","last_undegraded":"2024-09-10T05:59:01.971389+0000","last_fullsized":"2024-09-10T05:59:01.971389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:08.686783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.173582+0000","last_change":"2024-09-10T05:59:17.173582+0000","last_active":"2024-09-10T05:59:17.173582+0000","last_peered":"2024-09-10T05:59:17.173582+0000","last_clean":"2024-09-10T05:59:17.173582+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:59:17.173582+0000","last_undegraded":"2024-09-10T05:59:17.173582+0000","last_fullsized":"2024-09-10T05:59:17.173582+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-10T05:59:17.173395+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-10T05:59:17.173395+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.173395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:57.083250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"133'50","reported_seq":364,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.658850+0000","last_change":"2024-09-10T05:59:16.658850+0000","last_active":"2024-09-10T05:59:16.658850+0000","last_peered":"2024-09-10T05:59:16.658850+0000","last_clean":"2024-09-10T05:59:16.658850+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:59:16.658850+0000","last_undegraded":"2024-09-10T05:59:16.658850+0000","last_fullsized":"2024-09-10T05:59:16.658850+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.658656+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.658656+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.658656+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:48.622648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.956764+0000","last_change":"2024-09-10T05:59:13.956712+0000","last_active":"2024-09-10T05:59:13.956764+0000","last_peered":"2024-09-10T05:59:13.956764+0000","last_clean":"2024-09-10T05:59:13.956764+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:59:13.956764+0000","last_undegraded":"2024-09-10T05:59:13.956764+0000","last_fullsized":"2024-09-10T05:59:13.956764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:13.956649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:13.956649+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.956649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:28.951619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"133'2","reported_seq":320,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.143675+0000","last_change":"2024-09-10T05:59:31.143675+0000","last_active":"2024-09-10T05:59:31.143675+0000","last_peered":"2024-09-10T05:59:31.143675+0000","last_clean":"2024-09-10T05:59:31.143675+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:59:31.143675+0000","last_undegraded":"2024-09-10T05:59:31.143675+0000","last_fullsized":"2024-09-10T05:59:31.143675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:31.143491+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:31.143491+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.143491+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:11.212450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"133'53","reported_seq":415,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.013018+0000","last_change":"2024-09-10T05:58:39.382781+0000","last_active":"2024-09-10T05:59:09.013018+0000","last_peered":"2024-09-10T05:59:09.013018+0000","last_clean":"2024-09-10T05:59:09.013018+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:59:09.013018+0000","last_undegraded":"2024-09-10T05:59:09.013018+0000","last_fullsized":"2024-09-10T05:59:09.013018+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":50,"num_write":36,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812156+0000","last_change":"2024-09-10T05:58:36.065033+0000","last_active":"2024-09-10T05:59:01.812156+0000","last_peered":"2024-09-10T05:59:01.812156+0000","last_clean":"2024-09-10T05:59:01.812156+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:59:01.812156+0000","last_undegraded":"2024-09-10T05:59:01.812156+0000","last_fullsized":"2024-09-10T05:59:01.812156+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.563276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814898+0000","last_change":"2024-09-10T05:55:32.862668+0000","last_active":"2024-09-10T05:59:01.814898+0000","last_peered":"2024-09-10T05:59:01.814898+0000","last_clean":"2024-09-10T05:59:01.814898+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:59:01.814898+0000","last_undegraded":"2024-09-10T05:59:01.814898+0000","last_fullsized":"2024-09-10T05:59:01.814898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:48.103884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.058820+0000","last_change":"2024-09-10T05:59:21.058560+0000","last_active":"2024-09-10T05:59:21.058820+0000","last_peered":"2024-09-10T05:59:21.058820+0000","last_clean":"2024-09-10T05:59:21.058820+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:59:21.058820+0000","last_undegraded":"2024-09-10T05:59:21.058820+0000","last_fullsized":"2024-09-10T05:59:21.058820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'2","last_scrub_stamp":"2024-09-10T05:59:21.058279+0000","last_deep_scrub":"66'2","last_deep_scrub_stamp":"2024-09-10T05:59:21.058279+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.058279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:46.067602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"133'62","reported_seq":297,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.977790+0000","last_change":"2024-09-10T05:59:17.977542+0000","last_active":"2024-09-10T05:59:17.977790+0000","last_peered":"2024-09-10T05:59:17.977790+0000","last_clean":"2024-09-10T05:59:17.977790+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:59:17.977790+0000","last_undegraded":"2024-09-10T05:59:17.977790+0000","last_fullsized":"2024-09-10T05:59:17.977790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'62","last_scrub_stamp":"2024-09-10T05:59:17.977309+0000","last_deep_scrub":"133'62","last_deep_scrub_stamp":"2024-09-10T05:59:17.977309+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.977309+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:48.319064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.284301+0000","last_change":"2024-09-10T05:59:17.284171+0000","last_active":"2024-09-10T05:59:17.284301+0000","last_peered":"2024-09-10T05:59:17.284301+0000","last_clean":"2024-09-10T05:59:17.284301+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:59:17.284301+0000","last_undegraded":"2024-09-10T05:59:17.284301+0000","last_fullsized":"2024-09-10T05:59:17.284301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:17.283992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:17.283992+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.283992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:49.937579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.555162+0000","last_change":"2024-09-10T05:59:27.555162+0000","last_active":"2024-09-10T05:59:27.555162+0000","last_peered":"2024-09-10T05:59:27.555162+0000","last_clean":"2024-09-10T05:59:27.555162+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:59:27.555162+0000","last_undegraded":"2024-09-10T05:59:27.555162+0000","last_fullsized":"2024-09-10T05:59:27.555162+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:27.554987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:27.554987+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.554987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:04.244956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"133'28","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.022773+0000","last_change":"2024-09-10T05:59:31.022773+0000","last_active":"2024-09-10T05:59:31.022773+0000","last_peered":"2024-09-10T05:59:31.022773+0000","last_clean":"2024-09-10T05:59:31.022773+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:59:31.022773+0000","last_undegraded":"2024-09-10T05:59:31.022773+0000","last_fullsized":"2024-09-10T05:59:31.022773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'28","last_scrub_stamp":"2024-09-10T05:59:31.022575+0000","last_deep_scrub":"133'28","last_deep_scrub_stamp":"2024-09-10T05:59:31.022575+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.022575+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:07.474177+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"133'138","reported_seq":390,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.058297+0000","last_change":"2024-09-10T05:55:30.622269+0000","last_active":"2024-09-10T05:59:09.058297+0000","last_peered":"2024-09-10T05:59:09.058297+0000","last_clean":"2024-09-10T05:59:09.058297+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:59:09.058297+0000","last_undegraded":"2024-09-10T05:59:09.058297+0000","last_fullsized":"2024-09-10T05:59:09.058297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825935+0000","last_change":"2024-09-10T05:58:40.566181+0000","last_active":"2024-09-10T05:59:01.825935+0000","last_peered":"2024-09-10T05:59:01.825935+0000","last_clean":"2024-09-10T05:59:01.825935+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:59:01.825935+0000","last_undegraded":"2024-09-10T05:59:01.825935+0000","last_fullsized":"2024-09-10T05:59:01.825935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:02.161299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.007281+0000","last_change":"2024-09-10T05:59:25.007281+0000","last_active":"2024-09-10T05:59:25.007281+0000","last_peered":"2024-09-10T05:59:25.007281+0000","last_clean":"2024-09-10T05:59:25.007281+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:59:25.007281+0000","last_undegraded":"2024-09-10T05:59:25.007281+0000","last_fullsized":"2024-09-10T05:59:25.007281+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'2","last_scrub_stamp":"2024-09-10T05:59:25.007085+0000","last_deep_scrub":"111'2","last_deep_scrub_stamp":"2024-09-10T05:59:25.007085+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.007085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:26.835195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"133'44","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.898747+0000","last_change":"2024-09-10T05:59:14.898747+0000","last_active":"2024-09-10T05:59:14.898747+0000","last_peered":"2024-09-10T05:59:14.898747+0000","last_clean":"2024-09-10T05:59:14.898747+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:59:14.898747+0000","last_undegraded":"2024-09-10T05:59:14.898747+0000","last_fullsized":"2024-09-10T05:59:14.898747+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:14.898657+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:14.898657+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.898657+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:16.081466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:12.989458+0000","last_change":"2024-09-10T05:59:12.989341+0000","last_active":"2024-09-10T05:59:12.989458+0000","last_peered":"2024-09-10T05:59:12.989458+0000","last_clean":"2024-09-10T05:59:12.989458+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:59:12.989458+0000","last_undegraded":"2024-09-10T05:59:12.989458+0000","last_fullsized":"2024-09-10T05:59:12.989458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:12.989167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:12.989167+0000","last_clean_scrub_stamp":"2024-09-10T05:59:12.989167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:24.216589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.401740+0000","last_change":"2024-09-10T05:59:34.401740+0000","last_active":"2024-09-10T05:59:34.401740+0000","last_peered":"2024-09-10T05:59:34.401740+0000","last_clean":"2024-09-10T05:59:34.401740+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:59:34.401740+0000","last_undegraded":"2024-09-10T05:59:34.401740+0000","last_fullsized":"2024-09-10T05:59:34.401740+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.401559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.401559+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.401559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:37.806614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813201+0000","last_change":"2024-09-10T05:58:39.400842+0000","last_active":"2024-09-10T05:59:01.813201+0000","last_peered":"2024-09-10T05:59:01.813201+0000","last_clean":"2024-09-10T05:59:01.813201+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:59:01.813201+0000","last_undegraded":"2024-09-10T05:59:01.813201+0000","last_fullsized":"2024-09-10T05:59:01.813201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:38:57.886787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"133'145","reported_seq":324,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.973482+0000","last_change":"2024-09-10T05:58:42.102476+0000","last_active":"2024-09-10T05:59:07.973482+0000","last_peered":"2024-09-10T05:59:07.973482+0000","last_clean":"2024-09-10T05:59:07.973482+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:59:07.973482+0000","last_undegraded":"2024-09-10T05:59:07.973482+0000","last_fullsized":"2024-09-10T05:59:07.973482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:33.488054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814423+0000","last_change":"2024-09-10T05:58:36.071317+0000","last_active":"2024-09-10T05:59:01.814423+0000","last_peered":"2024-09-10T05:59:01.814423+0000","last_clean":"2024-09-10T05:59:01.814423+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:59:01.814423+0000","last_undegraded":"2024-09-10T05:59:01.814423+0000","last_fullsized":"2024-09-10T05:59:01.814423+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:36.078639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.372707+0000","last_change":"2024-09-10T05:59:19.372463+0000","last_active":"2024-09-10T05:59:19.372707+0000","last_peered":"2024-09-10T05:59:19.372707+0000","last_clean":"2024-09-10T05:59:19.372707+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:59:19.372707+0000","last_undegraded":"2024-09-10T05:59:19.372707+0000","last_fullsized":"2024-09-10T05:59:19.372707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:19.372187+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:19.372187+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.372187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:24.297278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"133'42","reported_seq":277,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:12.250756+0000","last_change":"2024-09-10T05:59:12.250756+0000","last_active":"2024-09-10T05:59:12.250756+0000","last_peered":"2024-09-10T05:59:12.250756+0000","last_clean":"2024-09-10T05:59:12.250756+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:59:12.250756+0000","last_undegraded":"2024-09-10T05:59:12.250756+0000","last_fullsized":"2024-09-10T05:59:12.250756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:12.250666+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:12.250666+0000","last_clean_scrub_stamp":"2024-09-10T05:59:12.250666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:45.112879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.735047+0000","last_change":"2024-09-10T05:59:15.735047+0000","last_active":"2024-09-10T05:59:15.735047+0000","last_peered":"2024-09-10T05:59:15.735047+0000","last_clean":"2024-09-10T05:59:15.735047+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:59:15.735047+0000","last_undegraded":"2024-09-10T05:59:15.735047+0000","last_fullsized":"2024-09-10T05:59:15.735047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:15.734857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:15.734857+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.734857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:21.882735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.050236+0000","last_change":"2024-09-10T05:59:32.050236+0000","last_active":"2024-09-10T05:59:32.050236+0000","last_peered":"2024-09-10T05:59:32.050236+0000","last_clean":"2024-09-10T05:59:32.050236+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:59:32.050236+0000","last_undegraded":"2024-09-10T05:59:32.050236+0000","last_fullsized":"2024-09-10T05:59:32.050236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:32.050051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:32.050051+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.050051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:47.153096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"133'59","reported_seq":310,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.026102+0000","last_change":"2024-09-10T05:55:28.612911+0000","last_active":"2024-09-10T05:59:09.026102+0000","last_peered":"2024-09-10T05:59:09.026102+0000","last_clean":"2024-09-10T05:59:09.026102+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:59:09.026102+0000","last_undegraded":"2024-09-10T05:59:09.026102+0000","last_fullsized":"2024-09-10T05:59:09.026102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:16.932304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.823349+0000","last_change":"2024-09-10T05:58:36.068927+0000","last_active":"2024-09-10T05:59:01.823349+0000","last_peered":"2024-09-10T05:59:01.823349+0000","last_clean":"2024-09-10T05:59:01.823349+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:59:01.823349+0000","last_undegraded":"2024-09-10T05:59:01.823349+0000","last_fullsized":"2024-09-10T05:59:01.823349+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:34.118740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.972639+0000","last_change":"2024-09-10T05:55:32.630547+0000","last_active":"2024-09-10T05:59:01.972639+0000","last_peered":"2024-09-10T05:59:01.972639+0000","last_clean":"2024-09-10T05:59:01.972639+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:59:01.972639+0000","last_undegraded":"2024-09-10T05:59:01.972639+0000","last_fullsized":"2024-09-10T05:59:01.972639+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:33.331940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815536+0000","last_change":"2024-09-10T05:55:32.635855+0000","last_active":"2024-09-10T05:59:01.815536+0000","last_peered":"2024-09-10T05:59:01.815536+0000","last_clean":"2024-09-10T05:59:01.815536+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:59:01.815536+0000","last_undegraded":"2024-09-10T05:59:01.815536+0000","last_fullsized":"2024-09-10T05:59:01.815536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:00.223740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.292024+0000","last_change":"2024-09-10T05:59:24.292024+0000","last_active":"2024-09-10T05:59:24.292024+0000","last_peered":"2024-09-10T05:59:24.292024+0000","last_clean":"2024-09-10T05:59:24.292024+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:59:24.292024+0000","last_undegraded":"2024-09-10T05:59:24.292024+0000","last_fullsized":"2024-09-10T05:59:24.292024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-09-10T05:59:24.291839+0000","last_deep_scrub":"66'8","last_deep_scrub_stamp":"2024-09-10T05:59:24.291839+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.291839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:14.719010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"133'52","reported_seq":286,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.396804+0000","last_change":"2024-09-10T05:59:17.396804+0000","last_active":"2024-09-10T05:59:17.396804+0000","last_peered":"2024-09-10T05:59:17.396804+0000","last_clean":"2024-09-10T05:59:17.396804+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:59:17.396804+0000","last_undegraded":"2024-09-10T05:59:17.396804+0000","last_fullsized":"2024-09-10T05:59:17.396804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'52","last_scrub_stamp":"2024-09-10T05:59:17.396634+0000","last_deep_scrub":"133'52","last_deep_scrub_stamp":"2024-09-10T05:59:17.396634+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.396634+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:21.444487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.977761+0000","last_change":"2024-09-10T05:59:25.977761+0000","last_active":"2024-09-10T05:59:25.977761+0000","last_peered":"2024-09-10T05:59:25.977761+0000","last_clean":"2024-09-10T05:59:25.977761+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:59:25.977761+0000","last_undegraded":"2024-09-10T05:59:25.977761+0000","last_fullsized":"2024-09-10T05:59:25.977761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:25.977575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:25.977575+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.977575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:07.724043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"133'29","reported_seq":65,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.052372+0000","last_change":"2024-09-10T05:58:36.101085+0000","last_active":"2024-09-10T05:59:09.052372+0000","last_peered":"2024-09-10T05:59:09.052372+0000","last_clean":"2024-09-10T05:59:09.052372+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:59:09.052372+0000","last_undegraded":"2024-09-10T05:59:09.052372+0000","last_fullsized":"2024-09-10T05:59:09.052372+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:36.463324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.822640+0000","last_change":"2024-09-10T05:58:36.083554+0000","last_active":"2024-09-10T05:59:01.822640+0000","last_peered":"2024-09-10T05:59:01.822640+0000","last_clean":"2024-09-10T05:59:01.822640+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:59:01.822640+0000","last_undegraded":"2024-09-10T05:59:01.822640+0000","last_fullsized":"2024-09-10T05:59:01.822640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:47.211919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825582+0000","last_change":"2024-09-10T05:58:36.106761+0000","last_active":"2024-09-10T05:59:01.825582+0000","last_peered":"2024-09-10T05:59:01.825582+0000","last_clean":"2024-09-10T05:59:01.825582+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:59:01.825582+0000","last_undegraded":"2024-09-10T05:59:01.825582+0000","last_fullsized":"2024-09-10T05:59:01.825582+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:10:44.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.001760+0000","last_change":"2024-09-10T05:59:21.001760+0000","last_active":"2024-09-10T05:59:21.001760+0000","last_peered":"2024-09-10T05:59:21.001760+0000","last_clean":"2024-09-10T05:59:21.001760+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:59:21.001760+0000","last_undegraded":"2024-09-10T05:59:21.001760+0000","last_fullsized":"2024-09-10T05:59:21.001760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-09-10T05:59:21.001469+0000","last_deep_scrub":"66'8","last_deep_scrub_stamp":"2024-09-10T05:59:21.001469+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.001469+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:29.886601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"133'50","reported_seq":374,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.285863+0000","last_change":"2024-09-10T05:59:21.285863+0000","last_active":"2024-09-10T05:59:21.285863+0000","last_peered":"2024-09-10T05:59:21.285863+0000","last_clean":"2024-09-10T05:59:21.285863+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:59:21.285863+0000","last_undegraded":"2024-09-10T05:59:21.285863+0000","last_fullsized":"2024-09-10T05:59:21.285863+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:21.285688+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:21.285688+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.285688+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:53.196589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825072+0000","last_change":"2024-09-10T05:58:36.087688+0000","last_active":"2024-09-10T05:59:01.825072+0000","last_peered":"2024-09-10T05:59:01.825072+0000","last_clean":"2024-09-10T05:59:01.825072+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:59:01.825072+0000","last_undegraded":"2024-09-10T05:59:01.825072+0000","last_fullsized":"2024-09-10T05:59:01.825072+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:11.802961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"114'10","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812168+0000","last_change":"2024-09-10T05:55:28.575881+0000","last_active":"2024-09-10T05:59:01.812168+0000","last_peered":"2024-09-10T05:59:01.812168+0000","last_clean":"2024-09-10T05:59:01.812168+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:59:01.812168+0000","last_undegraded":"2024-09-10T05:59:01.812168+0000","last_fullsized":"2024-09-10T05:59:01.812168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:32:54.637009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969302+0000","last_change":"2024-09-10T05:55:30.613523+0000","last_active":"2024-09-10T05:59:01.969302+0000","last_peered":"2024-09-10T05:59:01.969302+0000","last_clean":"2024-09-10T05:59:01.969302+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:59:01.969302+0000","last_undegraded":"2024-09-10T05:59:01.969302+0000","last_fullsized":"2024-09-10T05:59:01.969302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:14.891741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814579+0000","last_change":"2024-09-10T05:55:32.634817+0000","last_active":"2024-09-10T05:59:01.814579+0000","last_peered":"2024-09-10T05:59:01.814579+0000","last_clean":"2024-09-10T05:59:01.814579+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:59:01.814579+0000","last_undegraded":"2024-09-10T05:59:01.814579+0000","last_fullsized":"2024-09-10T05:59:01.814579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:06.088166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":60,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.058934+0000","last_change":"2024-09-10T05:59:27.058934+0000","last_active":"2024-09-10T05:59:27.058934+0000","last_peered":"2024-09-10T05:59:27.058934+0000","last_clean":"2024-09-10T05:59:27.058934+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:59:27.058934+0000","last_undegraded":"2024-09-10T05:59:27.058934+0000","last_fullsized":"2024-09-10T05:59:27.058934+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-09-10T05:59:27.058742+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-09-10T05:59:27.058742+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.058742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:28.781032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"133'46","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.646364+0000","last_change":"2024-09-10T05:59:17.646364+0000","last_active":"2024-09-10T05:59:17.646364+0000","last_peered":"2024-09-10T05:59:17.646364+0000","last_clean":"2024-09-10T05:59:17.646364+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:59:17.646364+0000","last_undegraded":"2024-09-10T05:59:17.646364+0000","last_fullsized":"2024-09-10T05:59:17.646364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:17.646148+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:17.646148+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.646148+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:40.120177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968619+0000","last_change":"2024-09-10T05:55:26.576075+0000","last_active":"2024-09-10T05:59:01.968619+0000","last_peered":"2024-09-10T05:59:01.968619+0000","last_clean":"2024-09-10T05:59:01.968619+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:59:01.968619+0000","last_undegraded":"2024-09-10T05:59:01.968619+0000","last_fullsized":"2024-09-10T05:59:01.968619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:02.098686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"133'24","reported_seq":63,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:09.005972+0000","last_change":"2024-09-10T05:58:41.135121+0000","last_active":"2024-09-10T05:59:09.005972+0000","last_peered":"2024-09-10T05:59:09.005972+0000","last_clean":"2024-09-10T05:59:09.005972+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:59:09.005972+0000","last_undegraded":"2024-09-10T05:59:09.005972+0000","last_fullsized":"2024-09-10T05:59:09.005972+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:59.259766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973584+0000","last_change":"2024-09-10T05:55:30.625705+0000","last_active":"2024-09-10T05:59:01.973584+0000","last_peered":"2024-09-10T05:59:01.973584+0000","last_clean":"2024-09-10T05:59:01.973584+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:59:01.973584+0000","last_undegraded":"2024-09-10T05:59:01.973584+0000","last_fullsized":"2024-09-10T05:59:01.973584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.441608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.974783+0000","last_change":"2024-09-10T05:55:32.624288+0000","last_active":"2024-09-10T05:59:01.974783+0000","last_peered":"2024-09-10T05:59:01.974783+0000","last_clean":"2024-09-10T05:59:01.974783+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:59:01.974783+0000","last_undegraded":"2024-09-10T05:59:01.974783+0000","last_fullsized":"2024-09-10T05:59:01.974783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:34.528892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.032588+0000","last_change":"2024-09-10T05:59:26.032588+0000","last_active":"2024-09-10T05:59:26.032588+0000","last_peered":"2024-09-10T05:59:26.032588+0000","last_clean":"2024-09-10T05:59:26.032588+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:59:26.032588+0000","last_undegraded":"2024-09-10T05:59:26.032588+0000","last_fullsized":"2024-09-10T05:59:26.032588+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:26.032398+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:26.032398+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.032398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:47.140938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"133'60","reported_seq":295,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.185107+0000","last_change":"2024-09-10T05:59:16.185107+0000","last_active":"2024-09-10T05:59:16.185107+0000","last_peered":"2024-09-10T05:59:16.185107+0000","last_clean":"2024-09-10T05:59:16.185107+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:59:16.185107+0000","last_undegraded":"2024-09-10T05:59:16.185107+0000","last_fullsized":"2024-09-10T05:59:16.185107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:16.184898+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:16.184898+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.184898+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:20.614025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.493504+0000","last_change":"2024-09-10T05:59:30.493504+0000","last_active":"2024-09-10T05:59:30.493504+0000","last_peered":"2024-09-10T05:59:30.493504+0000","last_clean":"2024-09-10T05:59:30.493504+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:59:30.493504+0000","last_undegraded":"2024-09-10T05:59:30.493504+0000","last_fullsized":"2024-09-10T05:59:30.493504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:30.493327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:30.493327+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.493327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:51.950474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"133'20","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.995088+0000","last_change":"2024-09-10T05:55:28.577512+0000","last_active":"2024-09-10T05:59:08.995088+0000","last_peered":"2024-09-10T05:59:08.995088+0000","last_clean":"2024-09-10T05:59:08.995088+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:59:08.995088+0000","last_undegraded":"2024-09-10T05:59:08.995088+0000","last_fullsized":"2024-09-10T05:59:08.995088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:53.562580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813668+0000","last_change":"2024-09-10T05:55:30.628457+0000","last_active":"2024-09-10T05:59:01.813668+0000","last_peered":"2024-09-10T05:59:01.813668+0000","last_clean":"2024-09-10T05:59:01.813668+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:59:01.813668+0000","last_undegraded":"2024-09-10T05:59:01.813668+0000","last_fullsized":"2024-09-10T05:59:01.813668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:40.108346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.543767+0000","last_change":"2024-09-10T05:59:28.543767+0000","last_active":"2024-09-10T05:59:28.543767+0000","last_peered":"2024-09-10T05:59:28.543767+0000","last_clean":"2024-09-10T05:59:28.543767+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:59:28.543767+0000","last_undegraded":"2024-09-10T05:59:28.543767+0000","last_fullsized":"2024-09-10T05:59:28.543767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-09-10T05:59:28.543579+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-09-10T05:59:28.543579+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.543579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:27.084544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"133'50","reported_seq":129,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.952941+0000","last_change":"2024-09-10T05:59:18.952941+0000","last_active":"2024-09-10T05:59:18.952941+0000","last_peered":"2024-09-10T05:59:18.952941+0000","last_clean":"2024-09-10T05:59:18.952941+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:59:18.952941+0000","last_undegraded":"2024-09-10T05:59:18.952941+0000","last_fullsized":"2024-09-10T05:59:18.952941+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:18.952748+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:18.952748+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.952748+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:50.656154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.163573+0000","last_change":"2024-09-10T05:59:34.163573+0000","last_active":"2024-09-10T05:59:34.163573+0000","last_peered":"2024-09-10T05:59:34.163573+0000","last_clean":"2024-09-10T05:59:34.163573+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:59:34.163573+0000","last_undegraded":"2024-09-10T05:59:34.163573+0000","last_fullsized":"2024-09-10T05:59:34.163573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.163369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.163369+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.163369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:21.050407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"133'49","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.003921+0000","last_change":"2024-09-10T05:59:32.003921+0000","last_active":"2024-09-10T05:59:32.003921+0000","last_peered":"2024-09-10T05:59:32.003921+0000","last_clean":"2024-09-10T05:59:32.003921+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:59:32.003921+0000","last_undegraded":"2024-09-10T05:59:32.003921+0000","last_fullsized":"2024-09-10T05:59:32.003921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'49","last_scrub_stamp":"2024-09-10T05:59:32.003669+0000","last_deep_scrub":"133'49","last_deep_scrub_stamp":"2024-09-10T05:59:32.003669+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.003669+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:44.708081+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":159,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":234,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.975447+0000","last_change":"2024-09-10T05:58:36.082148+0000","last_active":"2024-09-10T05:59:01.975447+0000","last_peered":"2024-09-10T05:59:01.975447+0000","last_clean":"2024-09-10T05:59:01.975447+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:59:01.975447+0000","last_undegraded":"2024-09-10T05:59:01.975447+0000","last_fullsized":"2024-09-10T05:59:01.975447+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:32.319630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":44,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824811+0000","last_change":"2024-09-10T05:58:36.090193+0000","last_active":"2024-09-10T05:59:01.824811+0000","last_peered":"2024-09-10T05:59:01.824811+0000","last_clean":"2024-09-10T05:59:01.824811+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:59:01.824811+0000","last_undegraded":"2024-09-10T05:59:01.824811+0000","last_fullsized":"2024-09-10T05:59:01.824811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:35.156675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.137747+0000","last_change":"2024-09-10T05:59:25.137747+0000","last_active":"2024-09-10T05:59:25.137747+0000","last_peered":"2024-09-10T05:59:25.137747+0000","last_clean":"2024-09-10T05:59:25.137747+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:59:25.137747+0000","last_undegraded":"2024-09-10T05:59:25.137747+0000","last_fullsized":"2024-09-10T05:59:25.137747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:25.137550+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:25.137550+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.137550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:20.763077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"133'50","reported_seq":378,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.933819+0000","last_change":"2024-09-10T05:59:16.933819+0000","last_active":"2024-09-10T05:59:16.933819+0000","last_peered":"2024-09-10T05:59:16.933819+0000","last_clean":"2024-09-10T05:59:16.933819+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:59:16.933819+0000","last_undegraded":"2024-09-10T05:59:16.933819+0000","last_fullsized":"2024-09-10T05:59:16.933819+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.933620+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.933620+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.933620+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:57.079640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.542345+0000","last_change":"2024-09-10T05:59:29.542345+0000","last_active":"2024-09-10T05:59:29.542345+0000","last_peered":"2024-09-10T05:59:29.542345+0000","last_clean":"2024-09-10T05:59:29.542345+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:59:29.542345+0000","last_undegraded":"2024-09-10T05:59:29.542345+0000","last_fullsized":"2024-09-10T05:59:29.542345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:29.542161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:29.542161+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.542161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:00.556891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"133'26","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.998644+0000","last_change":"2024-09-10T05:55:28.577584+0000","last_active":"2024-09-10T05:59:08.998644+0000","last_peered":"2024-09-10T05:59:08.998644+0000","last_clean":"2024-09-10T05:59:08.998644+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:59:08.998644+0000","last_undegraded":"2024-09-10T05:59:08.998644+0000","last_fullsized":"2024-09-10T05:59:08.998644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:46.259573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":214,"reported_epoch":133,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-10T05:59:34.969936+0000","last_change":"2024-09-10T05:59:34.969263+0000","last_active":"2024-09-10T05:59:34.969936+0000","last_peered":"2024-09-10T05:59:34.969936+0000","last_clean":"2024-09-10T05:59:34.969936+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:59:34.969936+0000","last_undegraded":"2024-09-10T05:59:34.969936+0000","last_fullsized":"2024-09-10T05:59:34.969936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":206,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973068+0000","last_change":"2024-09-10T05:55:32.627820+0000","last_active":"2024-09-10T05:59:01.973068+0000","last_peered":"2024-09-10T05:59:01.973068+0000","last_clean":"2024-09-10T05:59:01.973068+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:59:01.973068+0000","last_undegraded":"2024-09-10T05:59:01.973068+0000","last_fullsized":"2024-09-10T05:59:01.973068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:29.483974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.066824+0000","last_change":"2024-09-10T05:59:29.066824+0000","last_active":"2024-09-10T05:59:29.066824+0000","last_peered":"2024-09-10T05:59:29.066824+0000","last_clean":"2024-09-10T05:59:29.066824+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:59:29.066824+0000","last_undegraded":"2024-09-10T05:59:29.066824+0000","last_fullsized":"2024-09-10T05:59:29.066824+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'6","last_scrub_stamp":"2024-09-10T05:59:29.066624+0000","last_deep_scrub":"74'6","last_deep_scrub_stamp":"2024-09-10T05:59:29.066624+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.066624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:58.964077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"133'38","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.366911+0000","last_change":"2024-09-10T05:59:16.366911+0000","last_active":"2024-09-10T05:59:16.366911+0000","last_peered":"2024-09-10T05:59:16.366911+0000","last_clean":"2024-09-10T05:59:16.366911+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:59:16.366911+0000","last_undegraded":"2024-09-10T05:59:16.366911+0000","last_fullsized":"2024-09-10T05:59:16.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:16.366739+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:16.366739+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.366739+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:09.340629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"29'1","reported_seq":350,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.919691+0000","last_change":"2024-09-10T05:58:40.731017+0000","last_active":"2024-09-10T05:59:07.919691+0000","last_peered":"2024-09-10T05:59:07.919691+0000","last_clean":"2024-09-10T05:59:07.919691+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:59:07.919691+0000","last_undegraded":"2024-09-10T05:59:07.919691+0000","last_fullsized":"2024-09-10T05:59:07.919691+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:36.888425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"133'32","reported_seq":66,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.249657+0000","last_change":"2024-09-10T05:58:41.114451+0000","last_active":"2024-09-10T05:59:08.249657+0000","last_peered":"2024-09-10T05:59:08.249657+0000","last_clean":"2024-09-10T05:59:08.249657+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:59:08.249657+0000","last_undegraded":"2024-09-10T05:59:08.249657+0000","last_fullsized":"2024-09-10T05:59:08.249657+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:54:53.586626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":156,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":243,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.004061+0000","last_change":"2024-09-10T05:59:34.004061+0000","last_active":"2024-09-10T05:59:34.004061+0000","last_peered":"2024-09-10T05:59:34.004061+0000","last_clean":"2024-09-10T05:59:34.004061+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:59:34.004061+0000","last_undegraded":"2024-09-10T05:59:34.004061+0000","last_fullsized":"2024-09-10T05:59:34.004061+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.003990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.003990+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.003990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:21.968179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973043+0000","last_change":"2024-09-10T05:55:32.627745+0000","last_active":"2024-09-10T05:59:01.973043+0000","last_peered":"2024-09-10T05:59:01.973043+0000","last_clean":"2024-09-10T05:59:01.973043+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:59:01.973043+0000","last_undegraded":"2024-09-10T05:59:01.973043+0000","last_fullsized":"2024-09-10T05:59:01.973043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:55.329767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.107185+0000","last_change":"2024-09-10T05:59:23.107185+0000","last_active":"2024-09-10T05:59:23.107185+0000","last_peered":"2024-09-10T05:59:23.107185+0000","last_clean":"2024-09-10T05:59:23.107185+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:59:23.107185+0000","last_undegraded":"2024-09-10T05:59:23.107185+0000","last_fullsized":"2024-09-10T05:59:23.107185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:23.107001+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:23.107001+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.107001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:53.546690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"133'52","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.214420+0000","last_change":"2024-09-10T05:59:15.214420+0000","last_active":"2024-09-10T05:59:15.214420+0000","last_peered":"2024-09-10T05:59:15.214420+0000","last_clean":"2024-09-10T05:59:15.214420+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:59:15.214420+0000","last_undegraded":"2024-09-10T05:59:15.214420+0000","last_fullsized":"2024-09-10T05:59:15.214420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'52","last_scrub_stamp":"2024-09-10T05:59:15.214350+0000","last_deep_scrub":"133'52","last_deep_scrub_stamp":"2024-09-10T05:59:15.214350+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.214350+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:33.989680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.052320+0000","last_change":"2024-09-10T05:59:28.052320+0000","last_active":"2024-09-10T05:59:28.052320+0000","last_peered":"2024-09-10T05:59:28.052320+0000","last_clean":"2024-09-10T05:59:28.052320+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:59:28.052320+0000","last_undegraded":"2024-09-10T05:59:28.052320+0000","last_fullsized":"2024-09-10T05:59:28.052320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:28.052109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:28.052109+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.052109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:32.099961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.814714+0000","last_change":"2024-09-10T05:55:28.611698+0000","last_active":"2024-09-10T05:59:01.814714+0000","last_peered":"2024-09-10T05:59:01.814714+0000","last_clean":"2024-09-10T05:59:01.814714+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:59:01.814714+0000","last_undegraded":"2024-09-10T05:59:01.814714+0000","last_fullsized":"2024-09-10T05:59:01.814714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"133'138","reported_seq":389,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:07.964591+0000","last_change":"2024-09-10T05:55:30.611704+0000","last_active":"2024-09-10T05:59:07.964591+0000","last_peered":"2024-09-10T05:59:07.964591+0000","last_clean":"2024-09-10T05:59:07.964591+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:59:07.964591+0000","last_undegraded":"2024-09-10T05:59:07.964591+0000","last_fullsized":"2024-09-10T05:59:07.964591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:23.915409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.968551+0000","last_change":"2024-09-10T05:55:32.624799+0000","last_active":"2024-09-10T05:59:01.968551+0000","last_peered":"2024-09-10T05:59:01.968551+0000","last_clean":"2024-09-10T05:59:01.968551+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:59:01.968551+0000","last_undegraded":"2024-09-10T05:59:01.968551+0000","last_fullsized":"2024-09-10T05:59:01.968551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:51.448933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.398758+0000","last_change":"2024-09-10T05:59:27.398758+0000","last_active":"2024-09-10T05:59:27.398758+0000","last_peered":"2024-09-10T05:59:27.398758+0000","last_clean":"2024-09-10T05:59:27.398758+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:59:27.398758+0000","last_undegraded":"2024-09-10T05:59:27.398758+0000","last_fullsized":"2024-09-10T05:59:27.398758+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:27.398538+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:27.398538+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.398538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:29.315847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"133'32","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.716003+0000","last_change":"2024-09-10T05:59:19.716003+0000","last_active":"2024-09-10T05:59:19.716003+0000","last_peered":"2024-09-10T05:59:19.716003+0000","last_clean":"2024-09-10T05:59:19.716003+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:59:19.716003+0000","last_undegraded":"2024-09-10T05:59:19.716003+0000","last_fullsized":"2024-09-10T05:59:19.716003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'32","last_scrub_stamp":"2024-09-10T05:59:19.715807+0000","last_deep_scrub":"133'32","last_deep_scrub_stamp":"2024-09-10T05:59:19.715807+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.715807+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:47.160496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":40,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.969585+0000","last_change":"2024-09-10T05:55:26.583360+0000","last_active":"2024-09-10T05:59:01.969585+0000","last_peered":"2024-09-10T05:59:01.969585+0000","last_clean":"2024-09-10T05:59:01.969585+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:59:01.969585+0000","last_undegraded":"2024-09-10T05:59:01.969585+0000","last_fullsized":"2024-09-10T05:59:01.969585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:44.496386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"133'52","reported_seq":304,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.557006+0000","last_change":"2024-09-10T05:55:28.582123+0000","last_active":"2024-09-10T05:59:08.557006+0000","last_peered":"2024-09-10T05:59:08.557006+0000","last_clean":"2024-09-10T05:59:08.557006+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:59:08.557006+0000","last_undegraded":"2024-09-10T05:59:08.557006+0000","last_fullsized":"2024-09-10T05:59:08.557006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:27:46.757484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":73,"num_read_kb":292,"num_write":46,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811526+0000","last_change":"2024-09-10T05:55:30.631847+0000","last_active":"2024-09-10T05:59:01.811526+0000","last_peered":"2024-09-10T05:59:01.811526+0000","last_clean":"2024-09-10T05:59:01.811526+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:59:01.811526+0000","last_undegraded":"2024-09-10T05:59:01.811526+0000","last_fullsized":"2024-09-10T05:59:01.811526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:20.905645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":208,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973463+0000","last_change":"2024-09-10T05:55:32.629026+0000","last_active":"2024-09-10T05:59:01.973463+0000","last_peered":"2024-09-10T05:59:01.973463+0000","last_clean":"2024-09-10T05:59:01.973463+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:59:01.973463+0000","last_undegraded":"2024-09-10T05:59:01.973463+0000","last_fullsized":"2024-09-10T05:59:01.973463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:12:28.589664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":301,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.378981+0000","last_change":"2024-09-10T05:59:26.378981+0000","last_active":"2024-09-10T05:59:26.378981+0000","last_peered":"2024-09-10T05:59:26.378981+0000","last_clean":"2024-09-10T05:59:26.378981+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:59:26.378981+0000","last_undegraded":"2024-09-10T05:59:26.378981+0000","last_fullsized":"2024-09-10T05:59:26.378981+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'6","last_scrub_stamp":"2024-09-10T05:59:26.378791+0000","last_deep_scrub":"103'6","last_deep_scrub_stamp":"2024-09-10T05:59:26.378791+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.378791+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:59.241004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"133'46","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.668876+0000","last_change":"2024-09-10T05:59:18.668876+0000","last_active":"2024-09-10T05:59:18.668876+0000","last_peered":"2024-09-10T05:59:18.668876+0000","last_clean":"2024-09-10T05:59:18.668876+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:59:18.668876+0000","last_undegraded":"2024-09-10T05:59:18.668876+0000","last_fullsized":"2024-09-10T05:59:18.668876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:18.668620+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:18.668620+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.668620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:10.335130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.973100+0000","last_change":"2024-09-10T05:55:26.573159+0000","last_active":"2024-09-10T05:59:01.973100+0000","last_peered":"2024-09-10T05:59:01.973100+0000","last_clean":"2024-09-10T05:59:01.973100+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:59:01.973100+0000","last_undegraded":"2024-09-10T05:59:01.973100+0000","last_fullsized":"2024-09-10T05:59:01.973100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:59.932644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"133'26","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.561347+0000","last_change":"2024-09-10T05:55:28.584323+0000","last_active":"2024-09-10T05:59:08.561347+0000","last_peered":"2024-09-10T05:59:08.561347+0000","last_clean":"2024-09-10T05:59:08.561347+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:59:08.561347+0000","last_undegraded":"2024-09-10T05:59:08.561347+0000","last_fullsized":"2024-09-10T05:59:08.561347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:56.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.978365+0000","last_change":"2024-09-10T05:55:30.607945+0000","last_active":"2024-09-10T05:59:01.978365+0000","last_peered":"2024-09-10T05:59:01.978365+0000","last_clean":"2024-09-10T05:59:01.978365+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:59:01.978365+0000","last_undegraded":"2024-09-10T05:59:01.978365+0000","last_fullsized":"2024-09-10T05:59:01.978365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:01.274341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":48,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.825337+0000","last_change":"2024-09-10T05:58:36.751943+0000","last_active":"2024-09-10T05:59:01.825337+0000","last_peered":"2024-09-10T05:59:01.825337+0000","last_clean":"2024-09-10T05:59:01.825337+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:59:01.825337+0000","last_undegraded":"2024-09-10T05:59:01.825337+0000","last_fullsized":"2024-09-10T05:59:01.825337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:52.279125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.105900+0000","last_change":"2024-09-10T05:59:28.105900+0000","last_active":"2024-09-10T05:59:28.105900+0000","last_peered":"2024-09-10T05:59:28.105900+0000","last_clean":"2024-09-10T05:59:28.105900+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:59:28.105900+0000","last_undegraded":"2024-09-10T05:59:28.105900+0000","last_fullsized":"2024-09-10T05:59:28.105900+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:28.105721+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:28.105721+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.105721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:57.586721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"133'60","reported_seq":144,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.926684+0000","last_change":"2024-09-10T05:59:17.926684+0000","last_active":"2024-09-10T05:59:17.926684+0000","last_peered":"2024-09-10T05:59:17.926684+0000","last_clean":"2024-09-10T05:59:17.926684+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:59:17.926684+0000","last_undegraded":"2024-09-10T05:59:17.926684+0000","last_fullsized":"2024-09-10T05:59:17.926684+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:17.926486+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:17.926486+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.926486+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:05.537251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.811947+0000","last_change":"2024-09-10T05:55:26.568640+0000","last_active":"2024-09-10T05:59:01.811947+0000","last_peered":"2024-09-10T05:59:01.811947+0000","last_clean":"2024-09-10T05:59:01.811947+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:59:01.811947+0000","last_undegraded":"2024-09-10T05:59:01.811947+0000","last_fullsized":"2024-09-10T05:59:01.811947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:25.533167+0000","last_clean_scrub_stamp":"2024-09-10T05:55:25.533167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:16.145714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"133'22","reported_seq":59,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.072811+0000","last_change":"2024-09-10T05:58:42.032681+0000","last_active":"2024-09-10T05:59:08.072811+0000","last_peered":"2024-09-10T05:59:08.072811+0000","last_clean":"2024-09-10T05:59:08.072811+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:59:08.072811+0000","last_undegraded":"2024-09-10T05:59:08.072811+0000","last_fullsized":"2024-09-10T05:59:08.072811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:11.388502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.812414+0000","last_change":"2024-09-10T05:55:30.610163+0000","last_active":"2024-09-10T05:59:01.812414+0000","last_peered":"2024-09-10T05:59:01.812414+0000","last_clean":"2024-09-10T05:59:01.812414+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:59:01.812414+0000","last_undegraded":"2024-09-10T05:59:01.812414+0000","last_fullsized":"2024-09-10T05:59:01.812414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:31:52.120569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.970419+0000","last_change":"2024-09-10T05:55:32.625223+0000","last_active":"2024-09-10T05:59:01.970419+0000","last_peered":"2024-09-10T05:59:01.970419+0000","last_clean":"2024-09-10T05:59:01.970419+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:59:01.970419+0000","last_undegraded":"2024-09-10T05:59:01.970419+0000","last_fullsized":"2024-09-10T05:59:01.970419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:57.318928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.329942+0000","last_change":"2024-09-10T05:59:25.329942+0000","last_active":"2024-09-10T05:59:25.329942+0000","last_peered":"2024-09-10T05:59:25.329942+0000","last_clean":"2024-09-10T05:59:25.329942+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:59:25.329942+0000","last_undegraded":"2024-09-10T05:59:25.329942+0000","last_fullsized":"2024-09-10T05:59:25.329942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:25.329737+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:25.329737+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.329737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:59.621742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"133'50","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.162924+0000","last_change":"2024-09-10T05:59:16.162924+0000","last_active":"2024-09-10T05:59:16.162924+0000","last_peered":"2024-09-10T05:59:16.162924+0000","last_clean":"2024-09-10T05:59:16.162924+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:59:16.162924+0000","last_undegraded":"2024-09-10T05:59:16.162924+0000","last_fullsized":"2024-09-10T05:59:16.162924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.162653+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.162653+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.162653+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:01.267884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"133'2","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.012220+0000","last_change":"2024-09-10T05:59:30.012220+0000","last_active":"2024-09-10T05:59:30.012220+0000","last_peered":"2024-09-10T05:59:30.012220+0000","last_clean":"2024-09-10T05:59:30.012220+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:59:30.012220+0000","last_undegraded":"2024-09-10T05:59:30.012220+0000","last_fullsized":"2024-09-10T05:59:30.012220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:30.012044+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:30.012044+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.012044+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:34.937135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"133'34","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:08.257046+0000","last_change":"2024-09-10T05:55:28.573299+0000","last_active":"2024-09-10T05:59:08.257046+0000","last_peered":"2024-09-10T05:59:08.257046+0000","last_clean":"2024-09-10T05:59:08.257046+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:59:08.257046+0000","last_undegraded":"2024-09-10T05:59:08.257046+0000","last_fullsized":"2024-09-10T05:59:08.257046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:27.545032+0000","last_clean_scrub_stamp":"2024-09-10T05:55:27.545032+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:44.788825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":44,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.813606+0000","last_change":"2024-09-10T05:55:30.631819+0000","last_active":"2024-09-10T05:59:01.813606+0000","last_peered":"2024-09-10T05:59:01.813606+0000","last_clean":"2024-09-10T05:59:01.813606+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:59:01.813606+0000","last_undegraded":"2024-09-10T05:59:01.813606+0000","last_fullsized":"2024-09-10T05:59:01.813606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:29.568306+0000","last_clean_scrub_stamp":"2024-09-10T05:55:29.568306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:27.894292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":212,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.815081+0000","last_change":"2024-09-10T05:55:32.640435+0000","last_active":"2024-09-10T05:59:01.815081+0000","last_peered":"2024-09-10T05:59:01.815081+0000","last_clean":"2024-09-10T05:59:01.815081+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:59:01.815081+0000","last_undegraded":"2024-09-10T05:59:01.815081+0000","last_fullsized":"2024-09-10T05:59:01.815081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:31.581038+0000","last_clean_scrub_stamp":"2024-09-10T05:55:31.581038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:45.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.014273+0000","last_change":"2024-09-10T05:59:27.014273+0000","last_active":"2024-09-10T05:59:27.014273+0000","last_peered":"2024-09-10T05:59:27.014273+0000","last_clean":"2024-09-10T05:59:27.014273+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:59:27.014273+0000","last_undegraded":"2024-09-10T05:59:27.014273+0000","last_fullsized":"2024-09-10T05:59:27.014273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'6","last_scrub_stamp":"2024-09-10T05:59:27.014056+0000","last_deep_scrub":"111'6","last_deep_scrub_stamp":"2024-09-10T05:59:27.014056+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.014056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:19.987945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"133'60","reported_seq":294,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.669875+0000","last_change":"2024-09-10T05:59:18.669875+0000","last_active":"2024-09-10T05:59:18.669875+0000","last_peered":"2024-09-10T05:59:18.669875+0000","last_clean":"2024-09-10T05:59:18.669875+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:59:18.669875+0000","last_undegraded":"2024-09-10T05:59:18.669875+0000","last_fullsized":"2024-09-10T05:59:18.669875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:18.669682+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:18.669682+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.669682+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:10.494023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":262,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.962289+0000","last_change":"2024-09-10T05:59:23.962289+0000","last_active":"2024-09-10T05:59:23.962289+0000","last_peered":"2024-09-10T05:59:23.962289+0000","last_clean":"2024-09-10T05:59:23.962289+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:59:23.962289+0000","last_undegraded":"2024-09-10T05:59:23.962289+0000","last_fullsized":"2024-09-10T05:59:23.962289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T05:59:23.962005+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T05:59:23.962005+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.962005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:36.747611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"133'44","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.195969+0000","last_change":"2024-09-10T05:59:15.195909+0000","last_active":"2024-09-10T05:59:15.195969+0000","last_peered":"2024-09-10T05:59:15.195969+0000","last_clean":"2024-09-10T05:59:15.195969+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:59:15.195969+0000","last_undegraded":"2024-09-10T05:59:15.195969+0000","last_fullsized":"2024-09-10T05:59:15.195969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:15.195818+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:15.195818+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.195818+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:50.050428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.976396+0000","last_change":"2024-09-10T05:55:24.550660+0000","last_active":"2024-09-10T05:59:01.976396+0000","last_peered":"2024-09-10T05:59:01.976396+0000","last_clean":"2024-09-10T05:59:01.976396+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:59:01.976396+0000","last_undegraded":"2024-09-10T05:59:01.976396+0000","last_fullsized":"2024-09-10T05:59:01.976396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:43.729303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"133'40","reported_seq":347,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.688005+0000","last_change":"2024-09-10T05:59:20.688005+0000","last_active":"2024-09-10T05:59:20.688005+0000","last_peered":"2024-09-10T05:59:20.688005+0000","last_clean":"2024-09-10T05:59:20.688005+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:59:20.688005+0000","last_undegraded":"2024-09-10T05:59:20.688005+0000","last_fullsized":"2024-09-10T05:59:20.688005+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'40","last_scrub_stamp":"2024-09-10T05:59:20.687816+0000","last_deep_scrub":"133'40","last_deep_scrub_stamp":"2024-09-10T05:59:20.687816+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.687816+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:39.520070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":48,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.964033+0000","last_change":"2024-09-10T05:59:24.964033+0000","last_active":"2024-09-10T05:59:24.964033+0000","last_peered":"2024-09-10T05:59:24.964033+0000","last_clean":"2024-09-10T05:59:24.964033+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:59:24.964033+0000","last_undegraded":"2024-09-10T05:59:24.964033+0000","last_fullsized":"2024-09-10T05:59:24.964033+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'2","last_scrub_stamp":"2024-09-10T05:59:24.963835+0000","last_deep_scrub":"111'2","last_deep_scrub_stamp":"2024-09-10T05:59:24.963835+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.963835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:52.559761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"133'44","reported_seq":360,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.078089+0000","last_change":"2024-09-10T05:59:20.077927+0000","last_active":"2024-09-10T05:59:20.078089+0000","last_peered":"2024-09-10T05:59:20.078089+0000","last_clean":"2024-09-10T05:59:20.078089+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:59:20.078089+0000","last_undegraded":"2024-09-10T05:59:20.078089+0000","last_fullsized":"2024-09-10T05:59:20.078089+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:20.077742+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:20.077742+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.077742+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:54.834780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.125225+0000","last_change":"2024-09-10T05:59:26.125225+0000","last_active":"2024-09-10T05:59:26.125225+0000","last_peered":"2024-09-10T05:59:26.125225+0000","last_clean":"2024-09-10T05:59:26.125225+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:59:26.125225+0000","last_undegraded":"2024-09-10T05:59:26.125225+0000","last_fullsized":"2024-09-10T05:59:26.125225+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:26.125044+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:26.125044+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.125044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:59.777590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"133'60","reported_seq":144,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.007306+0000","last_change":"2024-09-10T05:59:21.007306+0000","last_active":"2024-09-10T05:59:21.007306+0000","last_peered":"2024-09-10T05:59:21.007306+0000","last_clean":"2024-09-10T05:59:21.007306+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:59:21.007306+0000","last_undegraded":"2024-09-10T05:59:21.007306+0000","last_fullsized":"2024-09-10T05:59:21.007306+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:21.007124+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:21.007124+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.007124+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:15.336800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.425638+0000","last_change":"2024-09-10T05:59:29.425501+0000","last_active":"2024-09-10T05:59:29.425638+0000","last_peered":"2024-09-10T05:59:29.425638+0000","last_clean":"2024-09-10T05:59:29.425638+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:59:29.425638+0000","last_undegraded":"2024-09-10T05:59:29.425638+0000","last_fullsized":"2024-09-10T05:59:29.425638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-10T05:59:29.425313+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-10T05:59:29.425313+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.425313+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:18.067509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"133'56","reported_seq":388,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.950881+0000","last_change":"2024-09-10T05:59:15.950881+0000","last_active":"2024-09-10T05:59:15.950881+0000","last_peered":"2024-09-10T05:59:15.950881+0000","last_clean":"2024-09-10T05:59:15.950881+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:59:15.950881+0000","last_undegraded":"2024-09-10T05:59:15.950881+0000","last_fullsized":"2024-09-10T05:59:15.950881+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'56","last_scrub_stamp":"2024-09-10T05:59:15.950679+0000","last_deep_scrub":"133'56","last_deep_scrub_stamp":"2024-09-10T05:59:15.950679+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.950679+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:18.246035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.021789+0000","last_change":"2024-09-10T05:59:33.021789+0000","last_active":"2024-09-10T05:59:33.021789+0000","last_peered":"2024-09-10T05:59:33.021789+0000","last_clean":"2024-09-10T05:59:33.021789+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:59:33.021789+0000","last_undegraded":"2024-09-10T05:59:33.021789+0000","last_fullsized":"2024-09-10T05:59:33.021789+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:33.021597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:33.021597+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.021597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:03.671499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"133'38","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.629600+0000","last_change":"2024-09-10T05:59:20.629600+0000","last_active":"2024-09-10T05:59:20.629600+0000","last_peered":"2024-09-10T05:59:20.629600+0000","last_clean":"2024-09-10T05:59:20.629600+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:59:20.629600+0000","last_undegraded":"2024-09-10T05:59:20.629600+0000","last_fullsized":"2024-09-10T05:59:20.629600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:20.629379+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:20.629379+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.629379+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:28.096617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.552815+0000","last_change":"2024-09-10T05:59:25.552815+0000","last_active":"2024-09-10T05:59:25.552815+0000","last_peered":"2024-09-10T05:59:25.552815+0000","last_clean":"2024-09-10T05:59:25.552815+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:59:25.552815+0000","last_undegraded":"2024-09-10T05:59:25.552815+0000","last_fullsized":"2024-09-10T05:59:25.552815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:25.552579+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:25.552579+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.552579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:38.929496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"133'42","reported_seq":117,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.995820+0000","last_change":"2024-09-10T05:59:19.995820+0000","last_active":"2024-09-10T05:59:19.995820+0000","last_peered":"2024-09-10T05:59:19.995820+0000","last_clean":"2024-09-10T05:59:19.995820+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:59:19.995820+0000","last_undegraded":"2024-09-10T05:59:19.995820+0000","last_fullsized":"2024-09-10T05:59:19.995820+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:19.995635+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:19.995635+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.995635+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:35.542512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.155537+0000","last_change":"2024-09-10T05:59:29.155537+0000","last_active":"2024-09-10T05:59:29.155537+0000","last_peered":"2024-09-10T05:59:29.155537+0000","last_clean":"2024-09-10T05:59:29.155537+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:59:29.155537+0000","last_undegraded":"2024-09-10T05:59:29.155537+0000","last_fullsized":"2024-09-10T05:59:29.155537+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:29.155322+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:29.155322+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.155322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:18.310331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"133'54","reported_seq":377,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.726965+0000","last_change":"2024-09-10T05:59:21.726965+0000","last_active":"2024-09-10T05:59:21.726965+0000","last_peered":"2024-09-10T05:59:21.726965+0000","last_clean":"2024-09-10T05:59:21.726965+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:59:21.726965+0000","last_undegraded":"2024-09-10T05:59:21.726965+0000","last_fullsized":"2024-09-10T05:59:21.726965+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:21.726738+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:21.726738+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.726738+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:14.969501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":268,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.454193+0000","last_change":"2024-09-10T05:59:32.454193+0000","last_active":"2024-09-10T05:59:32.454193+0000","last_peered":"2024-09-10T05:59:32.454193+0000","last_clean":"2024-09-10T05:59:32.454193+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:59:32.454193+0000","last_undegraded":"2024-09-10T05:59:32.454193+0000","last_fullsized":"2024-09-10T05:59:32.454193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T05:59:32.454003+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T05:59:32.454003+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.454003+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:21.811889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"133'42","reported_seq":117,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.961660+0000","last_change":"2024-09-10T05:59:21.961660+0000","last_active":"2024-09-10T05:59:21.961660+0000","last_peered":"2024-09-10T05:59:21.961660+0000","last_clean":"2024-09-10T05:59:21.961660+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:59:21.961660+0000","last_undegraded":"2024-09-10T05:59:21.961660+0000","last_fullsized":"2024-09-10T05:59:21.961660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:21.961477+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:21.961477+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.961477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:51.923232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":231,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.098740+0000","last_change":"2024-09-10T05:59:24.098740+0000","last_active":"2024-09-10T05:59:24.098740+0000","last_peered":"2024-09-10T05:59:24.098740+0000","last_clean":"2024-09-10T05:59:24.098740+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:59:24.098740+0000","last_undegraded":"2024-09-10T05:59:24.098740+0000","last_fullsized":"2024-09-10T05:59:24.098740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:24.098563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:24.098563+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.098563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:29.274071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"133'66","reported_seq":300,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.771457+0000","last_change":"2024-09-10T05:59:22.771457+0000","last_active":"2024-09-10T05:59:22.771457+0000","last_peered":"2024-09-10T05:59:22.771457+0000","last_clean":"2024-09-10T05:59:22.771457+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:59:22.771457+0000","last_undegraded":"2024-09-10T05:59:22.771457+0000","last_fullsized":"2024-09-10T05:59:22.771457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'66","last_scrub_stamp":"2024-09-10T05:59:22.771156+0000","last_deep_scrub":"133'66","last_deep_scrub_stamp":"2024-09-10T05:59:22.771156+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.771156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:19.382437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.388988+0000","last_change":"2024-09-10T05:59:28.388988+0000","last_active":"2024-09-10T05:59:28.388988+0000","last_peered":"2024-09-10T05:59:28.388988+0000","last_clean":"2024-09-10T05:59:28.388988+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:59:28.388988+0000","last_undegraded":"2024-09-10T05:59:28.388988+0000","last_fullsized":"2024-09-10T05:59:28.388988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:28.388786+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:28.388786+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.388786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:58.111233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"133'36","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.094723+0000","last_change":"2024-09-10T05:59:19.094723+0000","last_active":"2024-09-10T05:59:19.094723+0000","last_peered":"2024-09-10T05:59:19.094723+0000","last_clean":"2024-09-10T05:59:19.094723+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:59:19.094723+0000","last_undegraded":"2024-09-10T05:59:19.094723+0000","last_fullsized":"2024-09-10T05:59:19.094723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'36","last_scrub_stamp":"2024-09-10T05:59:19.094491+0000","last_deep_scrub":"133'36","last_deep_scrub_stamp":"2024-09-10T05:59:19.094491+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.094491+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.499546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.301219+0000","last_change":"2024-09-10T05:59:28.301219+0000","last_active":"2024-09-10T05:59:28.301219+0000","last_peered":"2024-09-10T05:59:28.301219+0000","last_clean":"2024-09-10T05:59:28.301219+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:59:28.301219+0000","last_undegraded":"2024-09-10T05:59:28.301219+0000","last_fullsized":"2024-09-10T05:59:28.301219+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:28.301033+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:28.301033+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.301033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:11.113069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"133'42","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.583347+0000","last_change":"2024-09-10T05:59:21.583347+0000","last_active":"2024-09-10T05:59:21.583347+0000","last_peered":"2024-09-10T05:59:21.583347+0000","last_clean":"2024-09-10T05:59:21.583347+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:59:21.583347+0000","last_undegraded":"2024-09-10T05:59:21.583347+0000","last_fullsized":"2024-09-10T05:59:21.583347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:21.583092+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:21.583092+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.583092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:00.386473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.164278+0000","last_change":"2024-09-10T05:59:27.164278+0000","last_active":"2024-09-10T05:59:27.164278+0000","last_peered":"2024-09-10T05:59:27.164278+0000","last_clean":"2024-09-10T05:59:27.164278+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:59:27.164278+0000","last_undegraded":"2024-09-10T05:59:27.164278+0000","last_fullsized":"2024-09-10T05:59:27.164278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:27.164066+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:27.164066+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.164066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:05.146906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"133'48","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.253540+0000","last_change":"2024-09-10T05:59:29.253540+0000","last_active":"2024-09-10T05:59:29.253540+0000","last_peered":"2024-09-10T05:59:29.253540+0000","last_clean":"2024-09-10T05:59:29.253540+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:59:29.253540+0000","last_undegraded":"2024-09-10T05:59:29.253540+0000","last_fullsized":"2024-09-10T05:59:29.253540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'48","last_scrub_stamp":"2024-09-10T05:59:29.253329+0000","last_deep_scrub":"133'48","last_deep_scrub_stamp":"2024-09-10T05:59:29.253329+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.253329+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:21.358493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":50,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:01.824020+0000","last_change":"2024-09-10T05:58:36.090342+0000","last_active":"2024-09-10T05:59:01.824020+0000","last_peered":"2024-09-10T05:59:01.824020+0000","last_clean":"2024-09-10T05:59:01.824020+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:59:01.824020+0000","last_undegraded":"2024-09-10T05:59:01.824020+0000","last_fullsized":"2024-09-10T05:59:01.824020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:55:23.520439+0000","last_clean_scrub_stamp":"2024-09-10T05:55:23.520439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:15.019257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"133'40","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.133105+0000","last_change":"2024-09-10T05:59:18.133105+0000","last_active":"2024-09-10T05:59:18.133105+0000","last_peered":"2024-09-10T05:59:18.133105+0000","last_clean":"2024-09-10T05:59:18.133105+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:59:18.133105+0000","last_undegraded":"2024-09-10T05:59:18.133105+0000","last_fullsized":"2024-09-10T05:59:18.133105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'40","last_scrub_stamp":"2024-09-10T05:59:18.132912+0000","last_deep_scrub":"133'40","last_deep_scrub_stamp":"2024-09-10T05:59:18.132912+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.132912+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:47.899139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.287465+0000","last_change":"2024-09-10T05:59:26.287465+0000","last_active":"2024-09-10T05:59:26.287465+0000","last_peered":"2024-09-10T05:59:26.287465+0000","last_clean":"2024-09-10T05:59:26.287465+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:59:26.287465+0000","last_undegraded":"2024-09-10T05:59:26.287465+0000","last_fullsized":"2024-09-10T05:59:26.287465+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:26.287277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:26.287277+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.287277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:08.927353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"133'50","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.817941+0000","last_change":"2024-09-10T05:59:23.817941+0000","last_active":"2024-09-10T05:59:23.817941+0000","last_peered":"2024-09-10T05:59:23.817941+0000","last_clean":"2024-09-10T05:59:23.817941+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:59:23.817941+0000","last_undegraded":"2024-09-10T05:59:23.817941+0000","last_fullsized":"2024-09-10T05:59:23.817941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:23.817761+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:23.817761+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.817761+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:48.642303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"133'48","reported_seq":192,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.096374+0000","last_change":"2024-09-10T05:59:19.096078+0000","last_active":"2024-09-10T05:59:19.096374+0000","last_peered":"2024-09-10T05:59:19.096374+0000","last_clean":"2024-09-10T05:59:19.096374+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:59:19.096374+0000","last_undegraded":"2024-09-10T05:59:19.096374+0000","last_fullsized":"2024-09-10T05:59:19.096374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'48","last_scrub_stamp":"2024-09-10T05:59:19.095788+0000","last_deep_scrub":"133'48","last_deep_scrub_stamp":"2024-09-10T05:59:19.095788+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.095788+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:40.566520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.111276+0000","last_change":"2024-09-10T05:59:32.111276+0000","last_active":"2024-09-10T05:59:32.111276+0000","last_peered":"2024-09-10T05:59:32.111276+0000","last_clean":"2024-09-10T05:59:32.111276+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:59:32.111276+0000","last_undegraded":"2024-09-10T05:59:32.111276+0000","last_fullsized":"2024-09-10T05:59:32.111276+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'4","last_scrub_stamp":"2024-09-10T05:59:32.110974+0000","last_deep_scrub":"103'4","last_deep_scrub_stamp":"2024-09-10T05:59:32.110974+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.110974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:27.071303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"133'46","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.958937+0000","last_change":"2024-09-10T05:59:19.958937+0000","last_active":"2024-09-10T05:59:19.958937+0000","last_peered":"2024-09-10T05:59:19.958937+0000","last_clean":"2024-09-10T05:59:19.958937+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:59:19.958937+0000","last_undegraded":"2024-09-10T05:59:19.958937+0000","last_fullsized":"2024-09-10T05:59:19.958937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:19.958755+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:19.958755+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.958755+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.314013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.728513+0000","last_change":"2024-09-10T05:59:30.728513+0000","last_active":"2024-09-10T05:59:30.728513+0000","last_peered":"2024-09-10T05:59:30.728513+0000","last_clean":"2024-09-10T05:59:30.728513+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:59:30.728513+0000","last_undegraded":"2024-09-10T05:59:30.728513+0000","last_fullsized":"2024-09-10T05:59:30.728513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:30.728323+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:30.728323+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.728323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:24.713658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1348,"num_read_kb":1798,"num_write":733,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3088,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37524,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334316,"statfs":{"total":96636764160,"available":96598339584,"internally_reserved":0,"allocated":2232320,"data_stored":1535013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1617920,"data_stored":944421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1667072,"data_stored":944843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542202,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":944476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1642496,"data_stored":945777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542203,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41068,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330772,"statfs":{"total":96636764160,"available":96594710528,"internally_reserved":0,"allocated":1601536,"data_stored":943547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41104,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330736,"statfs":{"total":96636764160,"available":96594673664,"internally_reserved":0,"allocated":1638400,"data_stored":944646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542202,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41668,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330172,"statfs":{"total":96636764160,"available":96594096128,"internally_reserved":0,"allocated":2215936,"data_stored":1534855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:59:36.125 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T05:55:21.652387+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=21, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.125 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.125 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.125 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.126 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.126 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.126 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.126 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.126 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.126 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.126 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.127 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.128 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.128 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.128 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.128 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.128 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.128 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.129 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.129 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.129 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.129 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.129 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.129 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.129 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.130 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.130 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.130 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.130 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.130 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.130 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.130 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.131 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.132 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.132 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.132 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.132 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.132 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.132 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.132 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.133 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.133 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.133 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.133 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.133 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.133 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.133 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.134 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.134 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.134 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.134 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.134 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.135 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.136 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.137 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.137 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.137 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.137 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.137 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.137 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.137 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.138 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.139 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.139 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.139 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.139 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.139 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.139 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.139 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T05:55:25.533167+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=25, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T05:55:27.545032+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=27, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T05:55:29.568306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.140 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T05:55:31.581038+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.141 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.141 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T05:55:23.520439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=55, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=5, tm_min=59, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T05:59:36.141 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T05:59:56.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T05:59:56.485 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-10T05:59:56.492 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-10T05:59:56.507 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-10T05:59:55.761532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624007,"num_objects":232,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":232,"num_whiteouts":0,"num_read":5195,"num_read_kb":4070,"num_write":4545,"num_write_kb":6187131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":853,"num_bytes_recovered":2262895717,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5913,"ondisk_log_size":5913,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":309120,"kb_used_data":13888,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754665600,"statfs":{"total":773094113280,"available":772777574400,"internally_reserved":0,"allocated":14221312,"data_stored":8737578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006047"},"pg_stats":[{"pgid":"3.3f","version":"133'44","reported_seq":281,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.202337+0000","last_change":"2024-09-10T05:59:32.202077+0000","last_active":"2024-09-10T05:59:32.202337+0000","last_peered":"2024-09-10T05:59:32.202337+0000","last_clean":"2024-09-10T05:59:32.202337+0000","last_became_active":"2024-09-10T05:55:22.583088+0000","last_became_peered":"2024-09-10T05:55:22.583088+0000","last_unstale":"2024-09-10T05:59:32.202337+0000","last_undegraded":"2024-09-10T05:59:32.202337+0000","last_fullsized":"2024-09-10T05:59:32.202337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:32.201813+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:32.201813+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.201813+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:02.456694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"111'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.732393+0000","last_change":"2024-09-10T05:59:32.732393+0000","last_active":"2024-09-10T05:59:32.732393+0000","last_peered":"2024-09-10T05:59:32.732393+0000","last_clean":"2024-09-10T05:59:32.732393+0000","last_became_active":"2024-09-10T05:55:24.575809+0000","last_became_peered":"2024-09-10T05:55:24.575809+0000","last_unstale":"2024-09-10T05:59:32.732393+0000","last_undegraded":"2024-09-10T05:59:32.732393+0000","last_fullsized":"2024-09-10T05:59:32.732393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:32.732194+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:32.732194+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.732194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:53.430281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"133'54","reported_seq":289,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.959319+0000","last_change":"2024-09-10T05:59:18.959163+0000","last_active":"2024-09-10T05:59:18.959319+0000","last_peered":"2024-09-10T05:59:18.959319+0000","last_clean":"2024-09-10T05:59:18.959319+0000","last_became_active":"2024-09-10T05:55:22.542950+0000","last_became_peered":"2024-09-10T05:55:22.542950+0000","last_unstale":"2024-09-10T05:59:18.959319+0000","last_undegraded":"2024-09-10T05:59:18.959319+0000","last_fullsized":"2024-09-10T05:59:18.959319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:18.958994+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:18.958994+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.958994+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:34:18.270276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"74'8","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.196283+0000","last_change":"2024-09-10T05:59:33.196283+0000","last_active":"2024-09-10T05:59:33.196283+0000","last_peered":"2024-09-10T05:59:33.196283+0000","last_clean":"2024-09-10T05:59:33.196283+0000","last_became_active":"2024-09-10T05:55:24.570306+0000","last_became_peered":"2024-09-10T05:55:24.570306+0000","last_unstale":"2024-09-10T05:59:33.196283+0000","last_undegraded":"2024-09-10T05:59:33.196283+0000","last_fullsized":"2024-09-10T05:59:33.196283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'8","last_scrub_stamp":"2024-09-10T05:59:33.196099+0000","last_deep_scrub":"74'8","last_deep_scrub_stamp":"2024-09-10T05:59:33.196099+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.196099+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:05.160091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"133'54","reported_seq":290,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.118312+0000","last_change":"2024-09-10T05:59:18.118151+0000","last_active":"2024-09-10T05:59:18.118312+0000","last_peered":"2024-09-10T05:59:18.118312+0000","last_clean":"2024-09-10T05:59:18.118312+0000","last_became_active":"2024-09-10T05:55:22.549259+0000","last_became_peered":"2024-09-10T05:55:22.549259+0000","last_unstale":"2024-09-10T05:59:18.118312+0000","last_undegraded":"2024-09-10T05:59:18.118312+0000","last_fullsized":"2024-09-10T05:59:18.118312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:18.117878+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:18.117878+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.117878+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:45.071331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"111'6","reported_seq":255,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.428235+0000","last_change":"2024-09-10T05:59:33.428235+0000","last_active":"2024-09-10T05:59:33.428235+0000","last_peered":"2024-09-10T05:59:33.428235+0000","last_clean":"2024-09-10T05:59:33.428235+0000","last_became_active":"2024-09-10T05:55:24.582343+0000","last_became_peered":"2024-09-10T05:55:24.582343+0000","last_unstale":"2024-09-10T05:59:33.428235+0000","last_undegraded":"2024-09-10T05:59:33.428235+0000","last_fullsized":"2024-09-10T05:59:33.428235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'6","last_scrub_stamp":"2024-09-10T05:59:33.428048+0000","last_deep_scrub":"111'6","last_deep_scrub_stamp":"2024-09-10T05:59:33.428048+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.428048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.347579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"133'42","reported_seq":353,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.771593+0000","last_change":"2024-09-10T05:59:25.771432+0000","last_active":"2024-09-10T05:59:25.771593+0000","last_peered":"2024-09-10T05:59:25.771593+0000","last_clean":"2024-09-10T05:59:25.771593+0000","last_became_active":"2024-09-10T05:58:36.084915+0000","last_became_peered":"2024-09-10T05:58:36.084915+0000","last_unstale":"2024-09-10T05:59:25.771593+0000","last_undegraded":"2024-09-10T05:59:25.771593+0000","last_fullsized":"2024-09-10T05:59:25.771593+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:25.771229+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:25.771229+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.771229+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:26.630788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"103'10","reported_seq":318,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.169550+0000","last_change":"2024-09-10T05:59:28.169550+0000","last_active":"2024-09-10T05:59:28.169550+0000","last_peered":"2024-09-10T05:59:28.169550+0000","last_clean":"2024-09-10T05:59:28.169550+0000","last_became_active":"2024-09-10T05:58:36.082508+0000","last_became_peered":"2024-09-10T05:58:36.082508+0000","last_unstale":"2024-09-10T05:59:28.169550+0000","last_undegraded":"2024-09-10T05:59:28.169550+0000","last_fullsized":"2024-09-10T05:59:28.169550+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-10T05:59:28.169362+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-10T05:59:28.169362+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.169362+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:24.927532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"133'58","reported_seq":294,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.279596+0000","last_change":"2024-09-10T05:59:25.279596+0000","last_active":"2024-09-10T05:59:25.279596+0000","last_peered":"2024-09-10T05:59:25.279596+0000","last_clean":"2024-09-10T05:59:25.279596+0000","last_became_active":"2024-09-10T05:55:22.556427+0000","last_became_peered":"2024-09-10T05:55:22.556427+0000","last_unstale":"2024-09-10T05:59:25.279596+0000","last_undegraded":"2024-09-10T05:59:25.279596+0000","last_fullsized":"2024-09-10T05:59:25.279596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'58","last_scrub_stamp":"2024-09-10T05:59:25.279376+0000","last_deep_scrub":"133'58","last_deep_scrub_stamp":"2024-09-10T05:59:25.279376+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.279376+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:56:57.444588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"66'4","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.591708+0000","last_change":"2024-09-10T05:59:26.591708+0000","last_active":"2024-09-10T05:59:26.591708+0000","last_peered":"2024-09-10T05:59:26.591708+0000","last_clean":"2024-09-10T05:59:26.591708+0000","last_became_active":"2024-09-10T05:55:24.579035+0000","last_became_peered":"2024-09-10T05:55:24.579035+0000","last_unstale":"2024-09-10T05:59:26.591708+0000","last_undegraded":"2024-09-10T05:59:26.591708+0000","last_fullsized":"2024-09-10T05:59:26.591708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:26.591508+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:26.591508+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.591508+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:27.839176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"133'50","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.780543+0000","last_change":"2024-09-10T05:59:24.780543+0000","last_active":"2024-09-10T05:59:24.780543+0000","last_peered":"2024-09-10T05:59:24.780543+0000","last_clean":"2024-09-10T05:59:24.780543+0000","last_became_active":"2024-09-10T05:55:22.564399+0000","last_became_peered":"2024-09-10T05:55:22.564399+0000","last_unstale":"2024-09-10T05:59:24.780543+0000","last_undegraded":"2024-09-10T05:59:24.780543+0000","last_fullsized":"2024-09-10T05:59:24.780543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:24.780355+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:24.780355+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.780355+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:00.729435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":58,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"94'8","reported_seq":266,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:35.398109+0000","last_change":"2024-09-10T05:59:35.398109+0000","last_active":"2024-09-10T05:59:35.398109+0000","last_peered":"2024-09-10T05:59:35.398109+0000","last_clean":"2024-09-10T05:59:35.398109+0000","last_became_active":"2024-09-10T05:55:24.578998+0000","last_became_peered":"2024-09-10T05:55:24.578998+0000","last_unstale":"2024-09-10T05:59:35.398109+0000","last_undegraded":"2024-09-10T05:59:35.398109+0000","last_fullsized":"2024-09-10T05:59:35.398109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T05:59:35.397879+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T05:59:35.397879+0000","last_clean_scrub_stamp":"2024-09-10T05:59:35.397879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:56:51.507326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"133'38","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.309785+0000","last_change":"2024-09-10T05:59:24.309785+0000","last_active":"2024-09-10T05:59:24.309785+0000","last_peered":"2024-09-10T05:59:24.309785+0000","last_clean":"2024-09-10T05:59:24.309785+0000","last_became_active":"2024-09-10T05:55:22.568682+0000","last_became_peered":"2024-09-10T05:55:22.568682+0000","last_unstale":"2024-09-10T05:59:24.309785+0000","last_undegraded":"2024-09-10T05:59:24.309785+0000","last_fullsized":"2024-09-10T05:59:24.309785+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:24.309603+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:24.309603+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.309603+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:52.271796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":46,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"67'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.728139+0000","last_change":"2024-09-10T05:59:33.727974+0000","last_active":"2024-09-10T05:59:33.728139+0000","last_peered":"2024-09-10T05:59:33.728139+0000","last_clean":"2024-09-10T05:59:33.728139+0000","last_became_active":"2024-09-10T05:55:24.562010+0000","last_became_peered":"2024-09-10T05:55:24.562010+0000","last_unstale":"2024-09-10T05:59:33.728139+0000","last_undegraded":"2024-09-10T05:59:33.728139+0000","last_fullsized":"2024-09-10T05:59:33.728139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:33.727776+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:33.727776+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.727776+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:11:09.066150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"133'26","reported_seq":93,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.003050+0000","last_change":"2024-09-10T05:59:24.003050+0000","last_active":"2024-09-10T05:59:24.003050+0000","last_peered":"2024-09-10T05:59:24.003050+0000","last_clean":"2024-09-10T05:59:24.003050+0000","last_became_active":"2024-09-10T05:58:36.088039+0000","last_became_peered":"2024-09-10T05:58:36.088039+0000","last_unstale":"2024-09-10T05:59:24.003050+0000","last_undegraded":"2024-09-10T05:59:24.003050+0000","last_fullsized":"2024-09-10T05:59:24.003050+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'26","last_scrub_stamp":"2024-09-10T05:59:24.002865+0000","last_deep_scrub":"133'26","last_deep_scrub_stamp":"2024-09-10T05:59:24.002865+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.002865+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:17:17.020481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"66'2","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.117766+0000","last_change":"2024-09-10T05:59:21.117639+0000","last_active":"2024-09-10T05:59:21.117766+0000","last_peered":"2024-09-10T05:59:21.117766+0000","last_clean":"2024-09-10T05:59:21.117766+0000","last_became_active":"2024-09-10T05:59:01.981080+0000","last_became_peered":"2024-09-10T05:59:01.981080+0000","last_unstale":"2024-09-10T05:59:21.117766+0000","last_undegraded":"2024-09-10T05:59:21.117766+0000","last_fullsized":"2024-09-10T05:59:21.117766+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'2","last_scrub_stamp":"2024-09-10T05:59:21.117454+0000","last_deep_scrub":"66'2","last_deep_scrub_stamp":"2024-09-10T05:59:21.117454+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.117454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:22.055934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.465207+0000","last_change":"2024-09-10T05:59:30.465207+0000","last_active":"2024-09-10T05:59:30.465207+0000","last_peered":"2024-09-10T05:59:30.465207+0000","last_clean":"2024-09-10T05:59:30.465207+0000","last_became_active":"2024-09-10T05:55:24.567532+0000","last_became_peered":"2024-09-10T05:55:24.567532+0000","last_unstale":"2024-09-10T05:59:30.465207+0000","last_undegraded":"2024-09-10T05:59:30.465207+0000","last_fullsized":"2024-09-10T05:59:30.465207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:30.464999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:30.464999+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.464999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:07.102665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"133'38","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.207545+0000","last_change":"2024-09-10T05:59:30.207545+0000","last_active":"2024-09-10T05:59:30.207545+0000","last_peered":"2024-09-10T05:59:30.207545+0000","last_clean":"2024-09-10T05:59:30.207545+0000","last_became_active":"2024-09-10T05:55:22.583826+0000","last_became_peered":"2024-09-10T05:55:22.583826+0000","last_unstale":"2024-09-10T05:59:30.207545+0000","last_undegraded":"2024-09-10T05:59:30.207545+0000","last_fullsized":"2024-09-10T05:59:30.207545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:30.207357+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:30.207357+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.207357+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:08.600952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"66'4","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.225896+0000","last_change":"2024-09-10T05:59:31.225896+0000","last_active":"2024-09-10T05:59:31.225896+0000","last_peered":"2024-09-10T05:59:31.225896+0000","last_clean":"2024-09-10T05:59:31.225896+0000","last_became_active":"2024-09-10T05:55:24.569506+0000","last_became_peered":"2024-09-10T05:55:24.569506+0000","last_unstale":"2024-09-10T05:59:31.225896+0000","last_undegraded":"2024-09-10T05:59:31.225896+0000","last_fullsized":"2024-09-10T05:59:31.225896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:31.225412+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:31.225412+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.225412+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:06.595076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"133'50","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.492135+0000","last_change":"2024-09-10T05:59:23.492135+0000","last_active":"2024-09-10T05:59:23.492135+0000","last_peered":"2024-09-10T05:59:23.492135+0000","last_clean":"2024-09-10T05:59:23.492135+0000","last_became_active":"2024-09-10T05:55:22.561817+0000","last_became_peered":"2024-09-10T05:55:22.561817+0000","last_unstale":"2024-09-10T05:59:23.492135+0000","last_undegraded":"2024-09-10T05:59:23.492135+0000","last_fullsized":"2024-09-10T05:59:23.492135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:23.491933+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:23.491933+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.491933+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:52.600446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"67'10","reported_seq":260,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.770343+0000","last_change":"2024-09-10T05:59:28.770343+0000","last_active":"2024-09-10T05:59:28.770343+0000","last_peered":"2024-09-10T05:59:28.770343+0000","last_clean":"2024-09-10T05:59:28.770343+0000","last_became_active":"2024-09-10T05:55:24.552337+0000","last_became_peered":"2024-09-10T05:55:24.552337+0000","last_unstale":"2024-09-10T05:59:28.770343+0000","last_undegraded":"2024-09-10T05:59:28.770343+0000","last_fullsized":"2024-09-10T05:59:28.770343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T05:59:28.770157+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T05:59:28.770157+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.770157+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:46.811556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"133'34","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.663544+0000","last_change":"2024-09-10T05:59:19.663544+0000","last_active":"2024-09-10T05:59:19.663544+0000","last_peered":"2024-09-10T05:59:19.663544+0000","last_clean":"2024-09-10T05:59:19.663544+0000","last_became_active":"2024-09-10T05:55:22.574082+0000","last_became_peered":"2024-09-10T05:55:22.574082+0000","last_unstale":"2024-09-10T05:59:19.663544+0000","last_undegraded":"2024-09-10T05:59:19.663544+0000","last_fullsized":"2024-09-10T05:59:19.663544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'34","last_scrub_stamp":"2024-09-10T05:59:19.663357+0000","last_deep_scrub":"133'34","last_deep_scrub_stamp":"2024-09-10T05:59:19.663357+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.663357+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:45.818653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":42,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"74'4","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.139540+0000","last_change":"2024-09-10T05:59:20.139540+0000","last_active":"2024-09-10T05:59:20.139540+0000","last_peered":"2024-09-10T05:59:20.139540+0000","last_clean":"2024-09-10T05:59:20.139540+0000","last_became_active":"2024-09-10T05:58:36.080615+0000","last_became_peered":"2024-09-10T05:58:36.080615+0000","last_unstale":"2024-09-10T05:59:20.139540+0000","last_undegraded":"2024-09-10T05:59:20.139540+0000","last_fullsized":"2024-09-10T05:59:20.139540+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-09-10T05:59:20.139337+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-09-10T05:59:20.139337+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.139337+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:53:11.878224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"133'56","reported_seq":290,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.357845+0000","last_change":"2024-09-10T05:59:18.357845+0000","last_active":"2024-09-10T05:59:18.357845+0000","last_peered":"2024-09-10T05:59:18.357845+0000","last_clean":"2024-09-10T05:59:18.357845+0000","last_became_active":"2024-09-10T05:55:22.559052+0000","last_became_peered":"2024-09-10T05:55:22.559052+0000","last_unstale":"2024-09-10T05:59:18.357845+0000","last_undegraded":"2024-09-10T05:59:18.357845+0000","last_fullsized":"2024-09-10T05:59:18.357845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'56","last_scrub_stamp":"2024-09-10T05:59:18.357658+0000","last_deep_scrub":"133'56","last_deep_scrub_stamp":"2024-09-10T05:59:18.357658+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.357658+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:44.892383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"111'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.088415+0000","last_change":"2024-09-10T05:59:28.088415+0000","last_active":"2024-09-10T05:59:28.088415+0000","last_peered":"2024-09-10T05:59:28.088415+0000","last_clean":"2024-09-10T05:59:28.088415+0000","last_became_active":"2024-09-10T05:55:24.565676+0000","last_became_peered":"2024-09-10T05:55:24.565676+0000","last_unstale":"2024-09-10T05:59:28.088415+0000","last_undegraded":"2024-09-10T05:59:28.088415+0000","last_fullsized":"2024-09-10T05:59:28.088415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:28.088203+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:28.088203+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.088203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:56:48.435353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"133'44","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.982631+0000","last_change":"2024-09-10T05:59:22.982631+0000","last_active":"2024-09-10T05:59:22.982631+0000","last_peered":"2024-09-10T05:59:22.982631+0000","last_clean":"2024-09-10T05:59:22.982631+0000","last_became_active":"2024-09-10T05:58:36.088226+0000","last_became_peered":"2024-09-10T05:58:36.088226+0000","last_unstale":"2024-09-10T05:59:22.982631+0000","last_undegraded":"2024-09-10T05:59:22.982631+0000","last_fullsized":"2024-09-10T05:59:22.982631+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:22.982370+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:22.982370+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.982370+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:50.293924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.483996+0000","last_change":"2024-09-10T05:59:31.483996+0000","last_active":"2024-09-10T05:59:31.483996+0000","last_peered":"2024-09-10T05:59:31.483996+0000","last_clean":"2024-09-10T05:59:31.483996+0000","last_became_active":"2024-09-10T05:55:24.567921+0000","last_became_peered":"2024-09-10T05:55:24.567921+0000","last_unstale":"2024-09-10T05:59:31.483996+0000","last_undegraded":"2024-09-10T05:59:31.483996+0000","last_fullsized":"2024-09-10T05:59:31.483996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:31.483809+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:31.483809+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.483809+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:02.131681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"133'48","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.139625+0000","last_change":"2024-09-10T05:59:17.139625+0000","last_active":"2024-09-10T05:59:17.139625+0000","last_peered":"2024-09-10T05:59:17.139625+0000","last_clean":"2024-09-10T05:59:17.139625+0000","last_became_active":"2024-09-10T05:55:22.543067+0000","last_became_peered":"2024-09-10T05:55:22.543067+0000","last_unstale":"2024-09-10T05:59:17.139625+0000","last_undegraded":"2024-09-10T05:59:17.139625+0000","last_fullsized":"2024-09-10T05:59:17.139625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'48","last_scrub_stamp":"2024-09-10T05:59:17.139441+0000","last_deep_scrub":"133'48","last_deep_scrub_stamp":"2024-09-10T05:59:17.139441+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.139441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:47.787313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"103'6","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:49.257162+0000","last_change":"2024-09-10T05:59:49.257162+0000","last_active":"2024-09-10T05:59:49.257162+0000","last_peered":"2024-09-10T05:59:49.257162+0000","last_clean":"2024-09-10T05:59:49.257162+0000","last_became_active":"2024-09-10T05:58:36.073078+0000","last_became_peered":"2024-09-10T05:58:36.073078+0000","last_unstale":"2024-09-10T05:59:49.257162+0000","last_undegraded":"2024-09-10T05:59:49.257162+0000","last_fullsized":"2024-09-10T05:59:49.257162+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'6","last_scrub_stamp":"2024-09-10T05:59:49.256947+0000","last_deep_scrub":"103'6","last_deep_scrub_stamp":"2024-09-10T05:59:49.256947+0000","last_clean_scrub_stamp":"2024-09-10T05:59:49.256947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:40.495840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":416,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"103'8","reported_seq":62,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.116280+0000","last_change":"2024-09-10T05:59:30.116280+0000","last_active":"2024-09-10T05:59:30.116280+0000","last_peered":"2024-09-10T05:59:30.116280+0000","last_clean":"2024-09-10T05:59:30.116280+0000","last_became_active":"2024-09-10T05:58:36.072517+0000","last_became_peered":"2024-09-10T05:58:36.072517+0000","last_unstale":"2024-09-10T05:59:30.116280+0000","last_undegraded":"2024-09-10T05:59:30.116280+0000","last_fullsized":"2024-09-10T05:59:30.116280+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'8","last_scrub_stamp":"2024-09-10T05:59:30.116053+0000","last_deep_scrub":"103'8","last_deep_scrub_stamp":"2024-09-10T05:59:30.116053+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.116053+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:35.773741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"133'38","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.300210+0000","last_change":"2024-09-10T05:59:22.300210+0000","last_active":"2024-09-10T05:59:22.300210+0000","last_peered":"2024-09-10T05:59:22.300210+0000","last_clean":"2024-09-10T05:59:22.300210+0000","last_became_active":"2024-09-10T05:55:22.570609+0000","last_became_peered":"2024-09-10T05:55:22.570609+0000","last_unstale":"2024-09-10T05:59:22.300210+0000","last_undegraded":"2024-09-10T05:59:22.300210+0000","last_fullsized":"2024-09-10T05:59:22.300210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:22.300019+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:22.300019+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.300019+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:03.852729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:36.628181+0000","last_change":"2024-09-10T05:59:36.628181+0000","last_active":"2024-09-10T05:59:36.628181+0000","last_peered":"2024-09-10T05:59:36.628181+0000","last_clean":"2024-09-10T05:59:36.628181+0000","last_became_active":"2024-09-10T05:55:26.571944+0000","last_became_peered":"2024-09-10T05:55:26.571944+0000","last_unstale":"2024-09-10T05:59:36.628181+0000","last_undegraded":"2024-09-10T05:59:36.628181+0000","last_fullsized":"2024-09-10T05:59:36.628181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:36.627968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:36.627968+0000","last_clean_scrub_stamp":"2024-09-10T05:59:36.627968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:26.492504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"133'39","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:39.216752+0000","last_change":"2024-09-10T05:59:39.216752+0000","last_active":"2024-09-10T05:59:39.216752+0000","last_peered":"2024-09-10T05:59:39.216752+0000","last_clean":"2024-09-10T05:59:39.216752+0000","last_became_active":"2024-09-10T05:55:28.570573+0000","last_became_peered":"2024-09-10T05:55:28.570573+0000","last_unstale":"2024-09-10T05:59:39.216752+0000","last_undegraded":"2024-09-10T05:59:39.216752+0000","last_fullsized":"2024-09-10T05:59:39.216752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'39","last_scrub_stamp":"2024-09-10T05:59:39.216545+0000","last_deep_scrub":"133'39","last_deep_scrub_stamp":"2024-09-10T05:59:39.216545+0000","last_clean_scrub_stamp":"2024-09-10T05:59:39.216545+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:23.116828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:48.128019+0000","last_change":"2024-09-10T05:59:48.128019+0000","last_active":"2024-09-10T05:59:48.128019+0000","last_peered":"2024-09-10T05:59:48.128019+0000","last_clean":"2024-09-10T05:59:48.128019+0000","last_became_active":"2024-09-10T05:55:30.610461+0000","last_became_peered":"2024-09-10T05:55:30.610461+0000","last_unstale":"2024-09-10T05:59:48.128019+0000","last_undegraded":"2024-09-10T05:59:48.128019+0000","last_fullsized":"2024-09-10T05:59:48.128019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:48.127800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:48.127800+0000","last_clean_scrub_stamp":"2024-09-10T05:59:48.127800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:41.381198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"133'49","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:49.797634+0000","last_change":"2024-09-10T05:59:49.797634+0000","last_active":"2024-09-10T05:59:49.797634+0000","last_peered":"2024-09-10T05:59:49.797634+0000","last_clean":"2024-09-10T05:59:49.797634+0000","last_became_active":"2024-09-10T05:55:32.639461+0000","last_became_peered":"2024-09-10T05:55:32.639461+0000","last_unstale":"2024-09-10T05:59:49.797634+0000","last_undegraded":"2024-09-10T05:59:49.797634+0000","last_fullsized":"2024-09-10T05:59:49.797634+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'49","last_scrub_stamp":"2024-09-10T05:59:49.797408+0000","last_deep_scrub":"133'49","last_deep_scrub_stamp":"2024-09-10T05:59:49.797408+0000","last_clean_scrub_stamp":"2024-09-10T05:59:49.797408+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:43.689239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.769048+0000","last_change":"2024-09-10T05:59:27.769048+0000","last_active":"2024-09-10T05:59:27.769048+0000","last_peered":"2024-09-10T05:59:27.769048+0000","last_clean":"2024-09-10T05:59:27.769048+0000","last_became_active":"2024-09-10T05:55:24.554549+0000","last_became_peered":"2024-09-10T05:55:24.554549+0000","last_unstale":"2024-09-10T05:59:27.769048+0000","last_undegraded":"2024-09-10T05:59:27.769048+0000","last_fullsized":"2024-09-10T05:59:27.769048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:27.768858+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:27.768858+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.768858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:19.267676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"133'52","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.221937+0000","last_change":"2024-09-10T05:59:13.221937+0000","last_active":"2024-09-10T05:59:13.221937+0000","last_peered":"2024-09-10T05:59:13.221937+0000","last_clean":"2024-09-10T05:59:13.221937+0000","last_became_active":"2024-09-10T05:55:22.572726+0000","last_became_peered":"2024-09-10T05:55:22.572726+0000","last_unstale":"2024-09-10T05:59:13.221937+0000","last_undegraded":"2024-09-10T05:59:13.221937+0000","last_fullsized":"2024-09-10T05:59:13.221937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'52","last_scrub_stamp":"2024-09-10T05:59:13.221868+0000","last_deep_scrub":"133'52","last_deep_scrub_stamp":"2024-09-10T05:59:13.221868+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.221868+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:13.680028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:37.064714+0000","last_change":"2024-09-10T05:59:37.064714+0000","last_active":"2024-09-10T05:59:37.064714+0000","last_peered":"2024-09-10T05:59:37.064714+0000","last_clean":"2024-09-10T05:59:37.064714+0000","last_became_active":"2024-09-10T05:58:36.070240+0000","last_became_peered":"2024-09-10T05:58:36.070240+0000","last_unstale":"2024-09-10T05:59:37.064714+0000","last_undegraded":"2024-09-10T05:59:37.064714+0000","last_fullsized":"2024-09-10T05:59:37.064714+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:37.064501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:37.064501+0000","last_clean_scrub_stamp":"2024-09-10T05:59:37.064501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:29.688013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"133'16","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:44.259973+0000","last_change":"2024-09-10T05:59:44.259973+0000","last_active":"2024-09-10T05:59:44.259973+0000","last_peered":"2024-09-10T05:59:44.259973+0000","last_clean":"2024-09-10T05:59:44.259973+0000","last_became_active":"2024-09-10T05:55:28.577574+0000","last_became_peered":"2024-09-10T05:55:28.577574+0000","last_unstale":"2024-09-10T05:59:44.259973+0000","last_undegraded":"2024-09-10T05:59:44.259973+0000","last_fullsized":"2024-09-10T05:59:44.259973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'16","last_scrub_stamp":"2024-09-10T05:59:44.259758+0000","last_deep_scrub":"133'16","last_deep_scrub_stamp":"2024-09-10T05:59:44.259758+0000","last_clean_scrub_stamp":"2024-09-10T05:59:44.259758+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:08.861599+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:45.230652+0000","last_change":"2024-09-10T05:59:45.230652+0000","last_active":"2024-09-10T05:59:45.230652+0000","last_peered":"2024-09-10T05:59:45.230652+0000","last_clean":"2024-09-10T05:59:45.230652+0000","last_became_active":"2024-09-10T05:55:30.599767+0000","last_became_peered":"2024-09-10T05:55:30.599767+0000","last_unstale":"2024-09-10T05:59:45.230652+0000","last_undegraded":"2024-09-10T05:59:45.230652+0000","last_fullsized":"2024-09-10T05:59:45.230652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:45.230442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:45.230442+0000","last_clean_scrub_stamp":"2024-09-10T05:59:45.230442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:54.169660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"67'3","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:49.067581+0000","last_change":"2024-09-10T05:59:49.067581+0000","last_active":"2024-09-10T05:59:49.067581+0000","last_peered":"2024-09-10T05:59:49.067581+0000","last_clean":"2024-09-10T05:59:49.067581+0000","last_became_active":"2024-09-10T05:55:32.634476+0000","last_became_peered":"2024-09-10T05:55:32.634476+0000","last_unstale":"2024-09-10T05:59:49.067581+0000","last_undegraded":"2024-09-10T05:59:49.067581+0000","last_fullsized":"2024-09-10T05:59:49.067581+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2024-09-10T05:59:49.067390+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2024-09-10T05:59:49.067390+0000","last_clean_scrub_stamp":"2024-09-10T05:59:49.067390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:44.490214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"111'2","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.113422+0000","last_change":"2024-09-10T05:59:24.113422+0000","last_active":"2024-09-10T05:59:24.113422+0000","last_peered":"2024-09-10T05:59:24.113422+0000","last_clean":"2024-09-10T05:59:24.113422+0000","last_became_active":"2024-09-10T05:58:36.069450+0000","last_became_peered":"2024-09-10T05:58:36.069450+0000","last_unstale":"2024-09-10T05:59:24.113422+0000","last_undegraded":"2024-09-10T05:59:24.113422+0000","last_fullsized":"2024-09-10T05:59:24.113422+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'2","last_scrub_stamp":"2024-09-10T05:59:24.113230+0000","last_deep_scrub":"111'2","last_deep_scrub_stamp":"2024-09-10T05:59:24.113230+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.113230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:07.148758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"133'54","reported_seq":291,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.262120+0000","last_change":"2024-09-10T05:59:20.262120+0000","last_active":"2024-09-10T05:59:20.262120+0000","last_peered":"2024-09-10T05:59:20.262120+0000","last_clean":"2024-09-10T05:59:20.262120+0000","last_became_active":"2024-09-10T05:55:22.570662+0000","last_became_peered":"2024-09-10T05:55:22.570662+0000","last_unstale":"2024-09-10T05:59:20.262120+0000","last_undegraded":"2024-09-10T05:59:20.262120+0000","last_fullsized":"2024-09-10T05:59:20.262120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:20.261802+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:20.261802+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.261802+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:35.355854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:35.010187+0000","last_change":"2024-09-10T05:59:35.010187+0000","last_active":"2024-09-10T05:59:35.010187+0000","last_peered":"2024-09-10T05:59:35.010187+0000","last_clean":"2024-09-10T05:59:35.010187+0000","last_became_active":"2024-09-10T05:58:36.085126+0000","last_became_peered":"2024-09-10T05:58:36.085126+0000","last_unstale":"2024-09-10T05:59:35.010187+0000","last_undegraded":"2024-09-10T05:59:35.010187+0000","last_fullsized":"2024-09-10T05:59:35.010187+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:35.009961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:35.009961+0000","last_clean_scrub_stamp":"2024-09-10T05:59:35.009961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:29:54.613969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"133'30","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.101039+0000","last_change":"2024-09-10T05:59:33.101039+0000","last_active":"2024-09-10T05:59:33.101039+0000","last_peered":"2024-09-10T05:59:33.101039+0000","last_clean":"2024-09-10T05:59:33.101039+0000","last_became_active":"2024-09-10T05:55:28.579659+0000","last_became_peered":"2024-09-10T05:55:28.579659+0000","last_unstale":"2024-09-10T05:59:33.101039+0000","last_undegraded":"2024-09-10T05:59:33.101039+0000","last_fullsized":"2024-09-10T05:59:33.101039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'30","last_scrub_stamp":"2024-09-10T05:59:33.100884+0000","last_deep_scrub":"133'30","last_deep_scrub_stamp":"2024-09-10T05:59:33.100884+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.100884+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:23.874400+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"133'139","reported_seq":400,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:46.122618+0000","last_change":"2024-09-10T05:59:46.122618+0000","last_active":"2024-09-10T05:59:46.122618+0000","last_peered":"2024-09-10T05:59:46.122618+0000","last_clean":"2024-09-10T05:59:46.122618+0000","last_became_active":"2024-09-10T05:55:30.618209+0000","last_became_peered":"2024-09-10T05:55:30.618209+0000","last_unstale":"2024-09-10T05:59:46.122618+0000","last_undegraded":"2024-09-10T05:59:46.122618+0000","last_fullsized":"2024-09-10T05:59:46.122618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'139","last_scrub_stamp":"2024-09-10T05:59:46.122414+0000","last_deep_scrub":"133'139","last_deep_scrub_stamp":"2024-09-10T05:59:46.122414+0000","last_clean_scrub_stamp":"2024-09-10T05:59:46.122414+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:55.040706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"74'2","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:50.260584+0000","last_change":"2024-09-10T05:59:50.260584+0000","last_active":"2024-09-10T05:59:50.260584+0000","last_peered":"2024-09-10T05:59:50.260584+0000","last_clean":"2024-09-10T05:59:50.260584+0000","last_became_active":"2024-09-10T05:55:32.862540+0000","last_became_peered":"2024-09-10T05:55:32.862540+0000","last_unstale":"2024-09-10T05:59:50.260584+0000","last_undegraded":"2024-09-10T05:59:50.260584+0000","last_fullsized":"2024-09-10T05:59:50.260584+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'2","last_scrub_stamp":"2024-09-10T05:59:50.260395+0000","last_deep_scrub":"74'2","last_deep_scrub_stamp":"2024-09-10T05:59:50.260395+0000","last_clean_scrub_stamp":"2024-09-10T05:59:50.260395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:26.486151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"66'8","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.079942+0000","last_change":"2024-09-10T05:59:31.079942+0000","last_active":"2024-09-10T05:59:31.079942+0000","last_peered":"2024-09-10T05:59:31.079942+0000","last_clean":"2024-09-10T05:59:31.079942+0000","last_became_active":"2024-09-10T05:58:36.079867+0000","last_became_peered":"2024-09-10T05:58:36.079867+0000","last_unstale":"2024-09-10T05:59:31.079942+0000","last_undegraded":"2024-09-10T05:59:31.079942+0000","last_fullsized":"2024-09-10T05:59:31.079942+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-09-10T05:59:31.079752+0000","last_deep_scrub":"66'8","last_deep_scrub_stamp":"2024-09-10T05:59:31.079752+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.079752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:15:14.479371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"133'36","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.705129+0000","last_change":"2024-09-10T05:59:17.705129+0000","last_active":"2024-09-10T05:59:17.705129+0000","last_peered":"2024-09-10T05:59:17.705129+0000","last_clean":"2024-09-10T05:59:17.705129+0000","last_became_active":"2024-09-10T05:55:22.555929+0000","last_became_peered":"2024-09-10T05:55:22.555929+0000","last_unstale":"2024-09-10T05:59:17.705129+0000","last_undegraded":"2024-09-10T05:59:17.705129+0000","last_fullsized":"2024-09-10T05:59:17.705129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'36","last_scrub_stamp":"2024-09-10T05:59:17.704952+0000","last_deep_scrub":"133'36","last_deep_scrub_stamp":"2024-09-10T05:59:17.704952+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.704952+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:08:22.199421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:37.645517+0000","last_change":"2024-09-10T05:59:37.645517+0000","last_active":"2024-09-10T05:59:37.645517+0000","last_peered":"2024-09-10T05:59:37.645517+0000","last_clean":"2024-09-10T05:59:37.645517+0000","last_became_active":"2024-09-10T05:58:36.075931+0000","last_became_peered":"2024-09-10T05:58:36.075931+0000","last_unstale":"2024-09-10T05:59:37.645517+0000","last_undegraded":"2024-09-10T05:59:37.645517+0000","last_fullsized":"2024-09-10T05:59:37.645517+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:37.645339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:37.645339+0000","last_clean_scrub_stamp":"2024-09-10T05:59:37.645339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:40.383128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"133'31","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:42.077387+0000","last_change":"2024-09-10T05:59:42.077387+0000","last_active":"2024-09-10T05:59:42.077387+0000","last_peered":"2024-09-10T05:59:42.077387+0000","last_clean":"2024-09-10T05:59:42.077387+0000","last_became_active":"2024-09-10T05:55:28.614880+0000","last_became_peered":"2024-09-10T05:55:28.614880+0000","last_unstale":"2024-09-10T05:59:42.077387+0000","last_undegraded":"2024-09-10T05:59:42.077387+0000","last_fullsized":"2024-09-10T05:59:42.077387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'31","last_scrub_stamp":"2024-09-10T05:59:42.077134+0000","last_deep_scrub":"133'31","last_deep_scrub_stamp":"2024-09-10T05:59:42.077134+0000","last_clean_scrub_stamp":"2024-09-10T05:59:42.077134+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:28.346928+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"133'146","reported_seq":360,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:41.069864+0000","last_change":"2024-09-10T05:59:41.069864+0000","last_active":"2024-09-10T05:59:41.069864+0000","last_peered":"2024-09-10T05:59:41.069864+0000","last_clean":"2024-09-10T05:59:41.069864+0000","last_became_active":"2024-09-10T05:58:42.103400+0000","last_became_peered":"2024-09-10T05:58:42.103400+0000","last_unstale":"2024-09-10T05:59:41.069864+0000","last_undegraded":"2024-09-10T05:59:41.069864+0000","last_fullsized":"2024-09-10T05:59:41.069864+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'146","last_scrub_stamp":"2024-09-10T05:59:41.069650+0000","last_deep_scrub":"133'146","last_deep_scrub_stamp":"2024-09-10T05:59:41.069650+0000","last_clean_scrub_stamp":"2024-09-10T05:59:41.069650+0000","objects_scrubbed":1,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:30:24.547884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"74'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.813205+0000","last_change":"2024-09-10T05:59:26.813046+0000","last_active":"2024-09-10T05:59:26.813205+0000","last_peered":"2024-09-10T05:59:26.813205+0000","last_clean":"2024-09-10T05:59:26.813205+0000","last_became_active":"2024-09-10T05:55:24.555011+0000","last_became_peered":"2024-09-10T05:55:24.555011+0000","last_unstale":"2024-09-10T05:59:26.813205+0000","last_undegraded":"2024-09-10T05:59:26.813205+0000","last_fullsized":"2024-09-10T05:59:26.813205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-09-10T05:59:26.812862+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-09-10T05:59:26.812862+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.812862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:30.388499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"133'54","reported_seq":291,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.257223+0000","last_change":"2024-09-10T05:59:27.257223+0000","last_active":"2024-09-10T05:59:27.257223+0000","last_peered":"2024-09-10T05:59:27.257223+0000","last_clean":"2024-09-10T05:59:27.257223+0000","last_became_active":"2024-09-10T05:55:22.573394+0000","last_became_peered":"2024-09-10T05:55:22.573394+0000","last_unstale":"2024-09-10T05:59:27.257223+0000","last_undegraded":"2024-09-10T05:59:27.257223+0000","last_fullsized":"2024-09-10T05:59:27.257223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:27.256940+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:27.256940+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.256940+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:19.723739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:36.148528+0000","last_change":"2024-09-10T05:59:36.148282+0000","last_active":"2024-09-10T05:59:36.148528+0000","last_peered":"2024-09-10T05:59:36.148528+0000","last_clean":"2024-09-10T05:59:36.148528+0000","last_became_active":"2024-09-10T05:55:26.572803+0000","last_became_peered":"2024-09-10T05:55:26.572803+0000","last_unstale":"2024-09-10T05:59:36.148528+0000","last_undegraded":"2024-09-10T05:59:36.148528+0000","last_fullsized":"2024-09-10T05:59:36.148528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:36.148065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:36.148065+0000","last_clean_scrub_stamp":"2024-09-10T05:59:36.148065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:03.592754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"133'49","reported_seq":294,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:40.726164+0000","last_change":"2024-09-10T05:59:40.725995+0000","last_active":"2024-09-10T05:59:40.726164+0000","last_peered":"2024-09-10T05:59:40.726164+0000","last_clean":"2024-09-10T05:59:40.726164+0000","last_became_active":"2024-09-10T05:55:28.610594+0000","last_became_peered":"2024-09-10T05:55:28.610594+0000","last_unstale":"2024-09-10T05:59:40.726164+0000","last_undegraded":"2024-09-10T05:59:40.726164+0000","last_fullsized":"2024-09-10T05:59:40.726164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'49","last_scrub_stamp":"2024-09-10T05:59:40.725797+0000","last_deep_scrub":"133'49","last_deep_scrub_stamp":"2024-09-10T05:59:40.725797+0000","last_clean_scrub_stamp":"2024-09-10T05:59:40.725797+0000","objects_scrubbed":10,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:54.396748+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:35.966660+0000","last_change":"2024-09-10T05:59:35.966660+0000","last_active":"2024-09-10T05:59:35.966660+0000","last_peered":"2024-09-10T05:59:35.966660+0000","last_clean":"2024-09-10T05:59:35.966660+0000","last_became_active":"2024-09-10T05:55:30.614500+0000","last_became_peered":"2024-09-10T05:55:30.614500+0000","last_unstale":"2024-09-10T05:59:35.966660+0000","last_undegraded":"2024-09-10T05:59:35.966660+0000","last_fullsized":"2024-09-10T05:59:35.966660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:35.966573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:35.966573+0000","last_clean_scrub_stamp":"2024-09-10T05:59:35.966573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:48.405834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"67'3","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:45.741567+0000","last_change":"2024-09-10T05:59:45.741437+0000","last_active":"2024-09-10T05:59:45.741567+0000","last_peered":"2024-09-10T05:59:45.741567+0000","last_clean":"2024-09-10T05:59:45.741567+0000","last_became_active":"2024-09-10T05:55:32.642641+0000","last_became_peered":"2024-09-10T05:55:32.642641+0000","last_unstale":"2024-09-10T05:59:45.741567+0000","last_undegraded":"2024-09-10T05:59:45.741567+0000","last_fullsized":"2024-09-10T05:59:45.741567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2024-09-10T05:59:45.741253+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2024-09-10T05:59:45.741253+0000","last_clean_scrub_stamp":"2024-09-10T05:59:45.741253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:36.444474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"74'6","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.346355+0000","last_change":"2024-09-10T05:59:20.346192+0000","last_active":"2024-09-10T05:59:20.346355+0000","last_peered":"2024-09-10T05:59:20.346355+0000","last_clean":"2024-09-10T05:59:20.346355+0000","last_became_active":"2024-09-10T05:55:24.577920+0000","last_became_peered":"2024-09-10T05:55:24.577920+0000","last_unstale":"2024-09-10T05:59:20.346355+0000","last_undegraded":"2024-09-10T05:59:20.346355+0000","last_fullsized":"2024-09-10T05:59:20.346355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'6","last_scrub_stamp":"2024-09-10T05:59:20.345996+0000","last_deep_scrub":"74'6","last_deep_scrub_stamp":"2024-09-10T05:59:20.345996+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.345996+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:56.797598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"133'42","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.224830+0000","last_change":"2024-09-10T05:59:19.224830+0000","last_active":"2024-09-10T05:59:19.224830+0000","last_peered":"2024-09-10T05:59:19.224830+0000","last_clean":"2024-09-10T05:59:19.224830+0000","last_became_active":"2024-09-10T05:55:22.570812+0000","last_became_peered":"2024-09-10T05:55:22.570812+0000","last_unstale":"2024-09-10T05:59:19.224830+0000","last_undegraded":"2024-09-10T05:59:19.224830+0000","last_fullsized":"2024-09-10T05:59:19.224830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:19.224654+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:19.224654+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.224654+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:57.810616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.110266+0000","last_change":"2024-09-10T05:59:27.110104+0000","last_active":"2024-09-10T05:59:27.110266+0000","last_peered":"2024-09-10T05:59:27.110266+0000","last_clean":"2024-09-10T05:59:27.110266+0000","last_became_active":"2024-09-10T05:55:26.565752+0000","last_became_peered":"2024-09-10T05:55:26.565752+0000","last_unstale":"2024-09-10T05:59:27.110266+0000","last_undegraded":"2024-09-10T05:59:27.110266+0000","last_fullsized":"2024-09-10T05:59:27.110266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:27.109911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:27.109911+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.109911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:49.714306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"133'31","reported_seq":76,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:48.945954+0000","last_change":"2024-09-10T05:59:48.945954+0000","last_active":"2024-09-10T05:59:48.945954+0000","last_peered":"2024-09-10T05:59:48.945954+0000","last_clean":"2024-09-10T05:59:48.945954+0000","last_became_active":"2024-09-10T05:58:36.078840+0000","last_became_peered":"2024-09-10T05:58:36.078840+0000","last_unstale":"2024-09-10T05:59:48.945954+0000","last_undegraded":"2024-09-10T05:59:48.945954+0000","last_fullsized":"2024-09-10T05:59:48.945954+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'31","last_scrub_stamp":"2024-09-10T05:59:48.945738+0000","last_deep_scrub":"133'31","last_deep_scrub_stamp":"2024-09-10T05:59:48.945738+0000","last_clean_scrub_stamp":"2024-09-10T05:59:48.945738+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:38.632003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:40.024453+0000","last_change":"2024-09-10T05:59:40.024453+0000","last_active":"2024-09-10T05:59:40.024453+0000","last_peered":"2024-09-10T05:59:40.024453+0000","last_clean":"2024-09-10T05:59:40.024453+0000","last_became_active":"2024-09-10T05:58:36.068345+0000","last_became_peered":"2024-09-10T05:58:36.068345+0000","last_unstale":"2024-09-10T05:59:40.024453+0000","last_undegraded":"2024-09-10T05:59:40.024453+0000","last_fullsized":"2024-09-10T05:59:40.024453+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:40.024241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:40.024241+0000","last_clean_scrub_stamp":"2024-09-10T05:59:40.024241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:20.382789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"66'4","reported_seq":221,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:37.687956+0000","last_change":"2024-09-10T05:59:37.687784+0000","last_active":"2024-09-10T05:59:37.687956+0000","last_peered":"2024-09-10T05:59:37.687956+0000","last_clean":"2024-09-10T05:59:37.687956+0000","last_became_active":"2024-09-10T05:55:32.639711+0000","last_became_peered":"2024-09-10T05:55:32.639711+0000","last_unstale":"2024-09-10T05:59:37.687956+0000","last_undegraded":"2024-09-10T05:59:37.687956+0000","last_fullsized":"2024-09-10T05:59:37.687956+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:37.687580+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:37.687580+0000","last_clean_scrub_stamp":"2024-09-10T05:59:37.687580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:56.635491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.504227+0000","last_change":"2024-09-10T05:59:24.504084+0000","last_active":"2024-09-10T05:59:24.504227+0000","last_peered":"2024-09-10T05:59:24.504227+0000","last_clean":"2024-09-10T05:59:24.504227+0000","last_became_active":"2024-09-10T05:55:24.571439+0000","last_became_peered":"2024-09-10T05:55:24.571439+0000","last_unstale":"2024-09-10T05:59:24.504227+0000","last_undegraded":"2024-09-10T05:59:24.504227+0000","last_fullsized":"2024-09-10T05:59:24.504227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-09-10T05:59:24.503907+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-09-10T05:59:24.503907+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.503907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:29:17.200118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"133'46","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.239568+0000","last_change":"2024-09-10T05:59:18.239568+0000","last_active":"2024-09-10T05:59:18.239568+0000","last_peered":"2024-09-10T05:59:18.239568+0000","last_clean":"2024-09-10T05:59:18.239568+0000","last_became_active":"2024-09-10T05:55:22.572615+0000","last_became_peered":"2024-09-10T05:55:22.572615+0000","last_unstale":"2024-09-10T05:59:18.239568+0000","last_undegraded":"2024-09-10T05:59:18.239568+0000","last_fullsized":"2024-09-10T05:59:18.239568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:18.239395+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:18.239395+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.239395+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:20.990720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.078249+0000","last_change":"2024-09-10T05:59:25.078249+0000","last_active":"2024-09-10T05:59:25.078249+0000","last_peered":"2024-09-10T05:59:25.078249+0000","last_clean":"2024-09-10T05:59:25.078249+0000","last_became_active":"2024-09-10T05:55:26.569676+0000","last_became_peered":"2024-09-10T05:55:26.569676+0000","last_unstale":"2024-09-10T05:59:25.078249+0000","last_undegraded":"2024-09-10T05:59:25.078249+0000","last_fullsized":"2024-09-10T05:59:25.078249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:25.078074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:25.078074+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.078074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:26.337074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"133'47","reported_seq":298,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:40.111623+0000","last_change":"2024-09-10T05:59:40.111467+0000","last_active":"2024-09-10T05:59:40.111623+0000","last_peered":"2024-09-10T05:59:40.111623+0000","last_clean":"2024-09-10T05:59:40.111623+0000","last_became_active":"2024-09-10T05:55:28.577833+0000","last_became_peered":"2024-09-10T05:55:28.577833+0000","last_unstale":"2024-09-10T05:59:40.111623+0000","last_undegraded":"2024-09-10T05:59:40.111623+0000","last_fullsized":"2024-09-10T05:59:40.111623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'47","last_scrub_stamp":"2024-09-10T05:59:40.111262+0000","last_deep_scrub":"133'47","last_deep_scrub_stamp":"2024-09-10T05:59:40.111262+0000","last_clean_scrub_stamp":"2024-09-10T05:59:40.111262+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:29:29.189341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"133'138","reported_seq":477,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:37.208226+0000","last_change":"2024-09-10T05:59:37.208069+0000","last_active":"2024-09-10T05:59:37.208226+0000","last_peered":"2024-09-10T05:59:37.208226+0000","last_clean":"2024-09-10T05:59:37.208226+0000","last_became_active":"2024-09-10T05:55:30.627706+0000","last_became_peered":"2024-09-10T05:55:30.627706+0000","last_unstale":"2024-09-10T05:59:37.208226+0000","last_undegraded":"2024-09-10T05:59:37.208226+0000","last_fullsized":"2024-09-10T05:59:37.208226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'138","last_scrub_stamp":"2024-09-10T05:59:37.207871+0000","last_deep_scrub":"133'138","last_deep_scrub_stamp":"2024-09-10T05:59:37.207871+0000","last_clean_scrub_stamp":"2024-09-10T05:59:37.207871+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:42.078558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:43.183335+0000","last_change":"2024-09-10T05:59:43.183160+0000","last_active":"2024-09-10T05:59:43.183335+0000","last_peered":"2024-09-10T05:59:43.183335+0000","last_clean":"2024-09-10T05:59:43.183335+0000","last_became_active":"2024-09-10T05:55:32.634413+0000","last_became_peered":"2024-09-10T05:55:32.634413+0000","last_unstale":"2024-09-10T05:59:43.183335+0000","last_undegraded":"2024-09-10T05:59:43.183335+0000","last_fullsized":"2024-09-10T05:59:43.183335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:43.182970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:43.182970+0000","last_clean_scrub_stamp":"2024-09-10T05:59:43.182970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:02.955367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'6","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.049012+0000","last_change":"2024-09-10T05:59:22.048860+0000","last_active":"2024-09-10T05:59:22.049012+0000","last_peered":"2024-09-10T05:59:22.049012+0000","last_clean":"2024-09-10T05:59:22.049012+0000","last_became_active":"2024-09-10T05:55:24.580244+0000","last_became_peered":"2024-09-10T05:55:24.580244+0000","last_unstale":"2024-09-10T05:59:22.049012+0000","last_undegraded":"2024-09-10T05:59:22.049012+0000","last_fullsized":"2024-09-10T05:59:22.049012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T05:59:22.048665+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T05:59:22.048665+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.048665+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:35.022156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"133'24","reported_seq":211,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.177427+0000","last_change":"2024-09-10T05:59:14.177356+0000","last_active":"2024-09-10T05:59:14.177427+0000","last_peered":"2024-09-10T05:59:14.177427+0000","last_clean":"2024-09-10T05:59:14.177427+0000","last_became_active":"2024-09-10T05:58:36.074261+0000","last_became_peered":"2024-09-10T05:58:36.074261+0000","last_unstale":"2024-09-10T05:59:14.177427+0000","last_undegraded":"2024-09-10T05:59:14.177427+0000","last_fullsized":"2024-09-10T05:59:14.177427+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'24","last_scrub_stamp":"2024-09-10T05:59:14.177259+0000","last_deep_scrub":"133'24","last_deep_scrub_stamp":"2024-09-10T05:59:14.177259+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.177259+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:55:32.433365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.072557+0000","last_change":"2024-09-10T05:59:31.072322+0000","last_active":"2024-09-10T05:59:31.072557+0000","last_peered":"2024-09-10T05:59:31.072557+0000","last_clean":"2024-09-10T05:59:31.072557+0000","last_became_active":"2024-09-10T05:55:26.571712+0000","last_became_peered":"2024-09-10T05:55:26.571712+0000","last_unstale":"2024-09-10T05:59:31.072557+0000","last_undegraded":"2024-09-10T05:59:31.072557+0000","last_fullsized":"2024-09-10T05:59:31.072557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:31.072032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:31.072032+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.072032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:15.179235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"133'51","reported_seq":306,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:36.259118+0000","last_change":"2024-09-10T05:59:36.258893+0000","last_active":"2024-09-10T05:59:36.259118+0000","last_peered":"2024-09-10T05:59:36.259118+0000","last_clean":"2024-09-10T05:59:36.259118+0000","last_became_active":"2024-09-10T05:55:28.575594+0000","last_became_peered":"2024-09-10T05:55:28.575594+0000","last_unstale":"2024-09-10T05:59:36.259118+0000","last_undegraded":"2024-09-10T05:59:36.259118+0000","last_fullsized":"2024-09-10T05:59:36.259118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'51","last_scrub_stamp":"2024-09-10T05:59:36.258661+0000","last_deep_scrub":"133'51","last_deep_scrub_stamp":"2024-09-10T05:59:36.258661+0000","last_clean_scrub_stamp":"2024-09-10T05:59:36.258661+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:12.484417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.089213+0000","last_change":"2024-09-10T05:59:32.088982+0000","last_active":"2024-09-10T05:59:32.089213+0000","last_peered":"2024-09-10T05:59:32.089213+0000","last_clean":"2024-09-10T05:59:32.089213+0000","last_became_active":"2024-09-10T05:55:30.607589+0000","last_became_peered":"2024-09-10T05:55:30.607589+0000","last_unstale":"2024-09-10T05:59:32.089213+0000","last_undegraded":"2024-09-10T05:59:32.089213+0000","last_fullsized":"2024-09-10T05:59:32.089213+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:32.088724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:32.088724+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.088724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:21.779136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"133'6","reported_seq":276,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:36.923499+0000","last_change":"2024-09-10T05:59:36.923339+0000","last_active":"2024-09-10T05:59:36.923499+0000","last_peered":"2024-09-10T05:59:36.923499+0000","last_clean":"2024-09-10T05:59:36.923499+0000","last_became_active":"2024-09-10T05:58:36.086985+0000","last_became_peered":"2024-09-10T05:58:36.086985+0000","last_unstale":"2024-09-10T05:59:36.923499+0000","last_undegraded":"2024-09-10T05:59:36.923499+0000","last_fullsized":"2024-09-10T05:59:36.923499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'6","last_scrub_stamp":"2024-09-10T05:59:36.923163+0000","last_deep_scrub":"133'6","last_deep_scrub_stamp":"2024-09-10T05:59:36.923163+0000","last_clean_scrub_stamp":"2024-09-10T05:59:36.923163+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:11:09.785376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"94'4","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.314167+0000","last_change":"2024-09-10T05:59:21.314015+0000","last_active":"2024-09-10T05:59:21.314167+0000","last_peered":"2024-09-10T05:59:21.314167+0000","last_clean":"2024-09-10T05:59:21.314167+0000","last_became_active":"2024-09-10T05:58:36.081697+0000","last_became_peered":"2024-09-10T05:58:36.081697+0000","last_unstale":"2024-09-10T05:59:21.314167+0000","last_undegraded":"2024-09-10T05:59:21.314167+0000","last_fullsized":"2024-09-10T05:59:21.314167+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T05:59:21.313832+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T05:59:21.313832+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.313832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:34.018244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"133'54","reported_seq":135,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.889841+0000","last_change":"2024-09-10T05:59:13.889841+0000","last_active":"2024-09-10T05:59:13.889841+0000","last_peered":"2024-09-10T05:59:13.889841+0000","last_clean":"2024-09-10T05:59:13.889841+0000","last_became_active":"2024-09-10T05:58:36.077463+0000","last_became_peered":"2024-09-10T05:58:36.077463+0000","last_unstale":"2024-09-10T05:59:13.889841+0000","last_undegraded":"2024-09-10T05:59:13.889841+0000","last_fullsized":"2024-09-10T05:59:13.889841+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:13.889656+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:13.889656+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.889656+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:16:42.591395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":117440512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.077013+0000","last_change":"2024-09-10T05:59:26.077013+0000","last_active":"2024-09-10T05:59:26.077013+0000","last_peered":"2024-09-10T05:59:26.077013+0000","last_clean":"2024-09-10T05:59:26.077013+0000","last_became_active":"2024-09-10T05:55:26.577704+0000","last_became_peered":"2024-09-10T05:55:26.577704+0000","last_unstale":"2024-09-10T05:59:26.077013+0000","last_undegraded":"2024-09-10T05:59:26.077013+0000","last_fullsized":"2024-09-10T05:59:26.077013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:26.076829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:26.076829+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.076829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:44.583940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"133'38","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:39.353510+0000","last_change":"2024-09-10T05:59:39.353510+0000","last_active":"2024-09-10T05:59:39.353510+0000","last_peered":"2024-09-10T05:59:39.353510+0000","last_clean":"2024-09-10T05:59:39.353510+0000","last_became_active":"2024-09-10T05:55:28.580740+0000","last_became_peered":"2024-09-10T05:55:28.580740+0000","last_unstale":"2024-09-10T05:59:39.353510+0000","last_undegraded":"2024-09-10T05:59:39.353510+0000","last_fullsized":"2024-09-10T05:59:39.353510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:39.353309+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:39.353309+0000","last_clean_scrub_stamp":"2024-09-10T05:59:39.353309+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:11.088546+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":264,"num_write":24,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":243,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:38.224069+0000","last_change":"2024-09-10T05:59:38.224069+0000","last_active":"2024-09-10T05:59:38.224069+0000","last_peered":"2024-09-10T05:59:38.224069+0000","last_clean":"2024-09-10T05:59:38.224069+0000","last_became_active":"2024-09-10T05:58:36.080689+0000","last_became_peered":"2024-09-10T05:58:36.080689+0000","last_unstale":"2024-09-10T05:59:38.224069+0000","last_undegraded":"2024-09-10T05:59:38.224069+0000","last_fullsized":"2024-09-10T05:59:38.224069+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:38.223897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:38.223897+0000","last_clean_scrub_stamp":"2024-09-10T05:59:38.223897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:32.838513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"133'2","reported_seq":57,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:44.009611+0000","last_change":"2024-09-10T05:59:44.009611+0000","last_active":"2024-09-10T05:59:44.009611+0000","last_peered":"2024-09-10T05:59:44.009611+0000","last_clean":"2024-09-10T05:59:44.009611+0000","last_became_active":"2024-09-10T05:58:36.088405+0000","last_became_peered":"2024-09-10T05:58:36.088405+0000","last_unstale":"2024-09-10T05:59:44.009611+0000","last_undegraded":"2024-09-10T05:59:44.009611+0000","last_fullsized":"2024-09-10T05:59:44.009611+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:44.009438+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:44.009438+0000","last_clean_scrub_stamp":"2024-09-10T05:59:44.009438+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:33.877153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":11,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.353044+0000","last_change":"2024-09-10T05:59:22.352894+0000","last_active":"2024-09-10T05:59:22.353044+0000","last_peered":"2024-09-10T05:59:22.353044+0000","last_clean":"2024-09-10T05:59:22.353044+0000","last_became_active":"2024-09-10T05:55:24.554902+0000","last_became_peered":"2024-09-10T05:55:24.554902+0000","last_unstale":"2024-09-10T05:59:22.353044+0000","last_undegraded":"2024-09-10T05:59:22.353044+0000","last_fullsized":"2024-09-10T05:59:22.353044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T05:59:22.352679+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T05:59:22.352679+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.352679+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:27:54.767259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"133'50","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.725914+0000","last_change":"2024-09-10T05:59:16.725757+0000","last_active":"2024-09-10T05:59:16.725914+0000","last_peered":"2024-09-10T05:59:16.725914+0000","last_clean":"2024-09-10T05:59:16.725914+0000","last_became_active":"2024-09-10T05:55:22.546709+0000","last_became_peered":"2024-09-10T05:55:22.546709+0000","last_unstale":"2024-09-10T05:59:16.725914+0000","last_undegraded":"2024-09-10T05:59:16.725914+0000","last_fullsized":"2024-09-10T05:59:16.725914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.725575+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.725575+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.725575+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:07.521585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.049490+0000","last_change":"2024-09-10T05:59:29.049490+0000","last_active":"2024-09-10T05:59:29.049490+0000","last_peered":"2024-09-10T05:59:29.049490+0000","last_clean":"2024-09-10T05:59:29.049490+0000","last_became_active":"2024-09-10T05:55:26.578301+0000","last_became_peered":"2024-09-10T05:55:26.578301+0000","last_unstale":"2024-09-10T05:59:29.049490+0000","last_undegraded":"2024-09-10T05:59:29.049490+0000","last_fullsized":"2024-09-10T05:59:29.049490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:29.049294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:29.049294+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.049294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:55.584019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"133'32","reported_seq":357,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.099570+0000","last_change":"2024-09-10T05:59:29.099570+0000","last_active":"2024-09-10T05:59:29.099570+0000","last_peered":"2024-09-10T05:59:29.099570+0000","last_clean":"2024-09-10T05:59:29.099570+0000","last_became_active":"2024-09-10T05:58:36.085416+0000","last_became_peered":"2024-09-10T05:58:36.085416+0000","last_unstale":"2024-09-10T05:59:29.099570+0000","last_undegraded":"2024-09-10T05:59:29.099570+0000","last_fullsized":"2024-09-10T05:59:29.099570+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'32","last_scrub_stamp":"2024-09-10T05:59:29.099357+0000","last_deep_scrub":"133'32","last_deep_scrub_stamp":"2024-09-10T05:59:29.099357+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.099357+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:34.551717+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"133'138","reported_seq":413,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.046449+0000","last_change":"2024-09-10T05:59:30.046449+0000","last_active":"2024-09-10T05:59:30.046449+0000","last_peered":"2024-09-10T05:59:30.046449+0000","last_clean":"2024-09-10T05:59:30.046449+0000","last_became_active":"2024-09-10T05:55:30.621134+0000","last_became_peered":"2024-09-10T05:55:30.621134+0000","last_unstale":"2024-09-10T05:59:30.046449+0000","last_undegraded":"2024-09-10T05:59:30.046449+0000","last_fullsized":"2024-09-10T05:59:30.046449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'138","last_scrub_stamp":"2024-09-10T05:59:30.046270+0000","last_deep_scrub":"133'138","last_deep_scrub_stamp":"2024-09-10T05:59:30.046270+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.046270+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:46:45.058552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:37.950122+0000","last_change":"2024-09-10T05:59:37.949966+0000","last_active":"2024-09-10T05:59:37.950122+0000","last_peered":"2024-09-10T05:59:37.950122+0000","last_clean":"2024-09-10T05:59:37.950122+0000","last_became_active":"2024-09-10T05:55:32.630963+0000","last_became_peered":"2024-09-10T05:55:32.630963+0000","last_unstale":"2024-09-10T05:59:37.950122+0000","last_undegraded":"2024-09-10T05:59:37.950122+0000","last_fullsized":"2024-09-10T05:59:37.950122+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:37.949777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:37.949777+0000","last_clean_scrub_stamp":"2024-09-10T05:59:37.949777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:39.867086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"111'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.308422+0000","last_change":"2024-09-10T05:59:23.308297+0000","last_active":"2024-09-10T05:59:23.308422+0000","last_peered":"2024-09-10T05:59:23.308422+0000","last_clean":"2024-09-10T05:59:23.308422+0000","last_became_active":"2024-09-10T05:55:24.578682+0000","last_became_peered":"2024-09-10T05:55:24.578682+0000","last_unstale":"2024-09-10T05:59:23.308422+0000","last_undegraded":"2024-09-10T05:59:23.308422+0000","last_fullsized":"2024-09-10T05:59:23.308422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:23.308106+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:23.308106+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.308106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:11.272295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"133'46","reported_seq":281,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.323268+0000","last_change":"2024-09-10T05:59:15.323087+0000","last_active":"2024-09-10T05:59:15.323268+0000","last_peered":"2024-09-10T05:59:15.323268+0000","last_clean":"2024-09-10T05:59:15.323268+0000","last_became_active":"2024-09-10T05:55:22.528016+0000","last_became_peered":"2024-09-10T05:55:22.528016+0000","last_unstale":"2024-09-10T05:59:15.323268+0000","last_undegraded":"2024-09-10T05:59:15.323268+0000","last_fullsized":"2024-09-10T05:59:15.323268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:15.322793+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:15.322793+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.322793+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:15:57.069261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"133'4","reported_seq":412,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:35.663678+0000","last_change":"2024-09-10T05:59:35.663678+0000","last_active":"2024-09-10T05:59:35.663678+0000","last_peered":"2024-09-10T05:59:35.663678+0000","last_clean":"2024-09-10T05:59:35.663678+0000","last_became_active":"2024-09-10T05:55:26.582126+0000","last_became_peered":"2024-09-10T05:55:26.582126+0000","last_unstale":"2024-09-10T05:59:35.663678+0000","last_undegraded":"2024-09-10T05:59:35.663678+0000","last_fullsized":"2024-09-10T05:59:35.663678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'4","last_scrub_stamp":"2024-09-10T05:59:35.663488+0000","last_deep_scrub":"133'4","last_deep_scrub_stamp":"2024-09-10T05:59:35.663488+0000","last_clean_scrub_stamp":"2024-09-10T05:59:35.663488+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:16.664207+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"133'15","reported_seq":69,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:38.037559+0000","last_change":"2024-09-10T05:59:38.037559+0000","last_active":"2024-09-10T05:59:38.037559+0000","last_peered":"2024-09-10T05:59:38.037559+0000","last_clean":"2024-09-10T05:59:38.037559+0000","last_became_active":"2024-09-10T05:58:36.072136+0000","last_became_peered":"2024-09-10T05:58:36.072136+0000","last_unstale":"2024-09-10T05:59:38.037559+0000","last_undegraded":"2024-09-10T05:59:38.037559+0000","last_fullsized":"2024-09-10T05:59:38.037559+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'15","last_scrub_stamp":"2024-09-10T05:59:38.037328+0000","last_deep_scrub":"133'15","last_deep_scrub_stamp":"2024-09-10T05:59:38.037328+0000","last_clean_scrub_stamp":"2024-09-10T05:59:38.037328+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:51.267128+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"133'138","reported_seq":445,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.597166+0000","last_change":"2024-09-10T05:59:33.597166+0000","last_active":"2024-09-10T05:59:33.597166+0000","last_peered":"2024-09-10T05:59:33.597166+0000","last_clean":"2024-09-10T05:59:33.597166+0000","last_became_active":"2024-09-10T05:55:30.619004+0000","last_became_peered":"2024-09-10T05:55:30.619004+0000","last_unstale":"2024-09-10T05:59:33.597166+0000","last_undegraded":"2024-09-10T05:59:33.597166+0000","last_fullsized":"2024-09-10T05:59:33.597166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'138","last_scrub_stamp":"2024-09-10T05:59:33.596978+0000","last_deep_scrub":"133'138","last_deep_scrub_stamp":"2024-09-10T05:59:33.596978+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.596978+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:14.655209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"66'2","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:47.283665+0000","last_change":"2024-09-10T05:59:47.283665+0000","last_active":"2024-09-10T05:59:47.283665+0000","last_peered":"2024-09-10T05:59:47.283665+0000","last_clean":"2024-09-10T05:59:47.283665+0000","last_became_active":"2024-09-10T05:55:32.638695+0000","last_became_peered":"2024-09-10T05:55:32.638695+0000","last_unstale":"2024-09-10T05:59:47.283665+0000","last_undegraded":"2024-09-10T05:59:47.283665+0000","last_fullsized":"2024-09-10T05:59:47.283665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'2","last_scrub_stamp":"2024-09-10T05:59:47.283468+0000","last_deep_scrub":"66'2","last_deep_scrub_stamp":"2024-09-10T05:59:47.283468+0000","last_clean_scrub_stamp":"2024-09-10T05:59:47.283468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:09.161204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'4","reported_seq":96,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.765276+0000","last_change":"2024-09-10T05:59:29.765276+0000","last_active":"2024-09-10T05:59:29.765276+0000","last_peered":"2024-09-10T05:59:29.765276+0000","last_clean":"2024-09-10T05:59:29.765276+0000","last_became_active":"2024-09-10T05:58:36.087859+0000","last_became_peered":"2024-09-10T05:58:36.087859+0000","last_unstale":"2024-09-10T05:59:29.765276+0000","last_undegraded":"2024-09-10T05:59:29.765276+0000","last_fullsized":"2024-09-10T05:59:29.765276+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:29.764996+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:29.764996+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.764996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:19.770367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"133'44","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.895942+0000","last_change":"2024-09-10T05:59:16.895942+0000","last_active":"2024-09-10T05:59:16.895942+0000","last_peered":"2024-09-10T05:59:16.895942+0000","last_clean":"2024-09-10T05:59:16.895942+0000","last_became_active":"2024-09-10T05:58:36.080166+0000","last_became_peered":"2024-09-10T05:58:36.080166+0000","last_unstale":"2024-09-10T05:59:16.895942+0000","last_undegraded":"2024-09-10T05:59:16.895942+0000","last_fullsized":"2024-09-10T05:59:16.895942+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:16.895758+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:16.895758+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.895758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:15.815655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:36.387148+0000","last_change":"2024-09-10T05:59:36.387148+0000","last_active":"2024-09-10T05:59:36.387148+0000","last_peered":"2024-09-10T05:59:36.387148+0000","last_clean":"2024-09-10T05:59:36.387148+0000","last_became_active":"2024-09-10T05:55:26.573516+0000","last_became_peered":"2024-09-10T05:55:26.573516+0000","last_unstale":"2024-09-10T05:59:36.387148+0000","last_undegraded":"2024-09-10T05:59:36.387148+0000","last_fullsized":"2024-09-10T05:59:36.387148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:36.386951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:36.386951+0000","last_clean_scrub_stamp":"2024-09-10T05:59:36.386951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:43.558568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"133'36","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:41.719172+0000","last_change":"2024-09-10T05:59:41.719172+0000","last_active":"2024-09-10T05:59:41.719172+0000","last_peered":"2024-09-10T05:59:41.719172+0000","last_clean":"2024-09-10T05:59:41.719172+0000","last_became_active":"2024-09-10T05:55:28.582581+0000","last_became_peered":"2024-09-10T05:55:28.582581+0000","last_unstale":"2024-09-10T05:59:41.719172+0000","last_undegraded":"2024-09-10T05:59:41.719172+0000","last_fullsized":"2024-09-10T05:59:41.719172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'36","last_scrub_stamp":"2024-09-10T05:59:41.718927+0000","last_deep_scrub":"133'36","last_deep_scrub_stamp":"2024-09-10T05:59:41.718927+0000","last_clean_scrub_stamp":"2024-09-10T05:59:41.718927+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:13.431258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.581562+0000","last_change":"2024-09-10T05:59:32.581562+0000","last_active":"2024-09-10T05:59:32.581562+0000","last_peered":"2024-09-10T05:59:32.581562+0000","last_clean":"2024-09-10T05:59:32.581562+0000","last_became_active":"2024-09-10T05:58:36.079812+0000","last_became_peered":"2024-09-10T05:58:36.079812+0000","last_unstale":"2024-09-10T05:59:32.581562+0000","last_undegraded":"2024-09-10T05:59:32.581562+0000","last_fullsized":"2024-09-10T05:59:32.581562+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:32.581297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:32.581297+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.581297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:51:37.201868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:39.926875+0000","last_change":"2024-09-10T05:59:39.926623+0000","last_active":"2024-09-10T05:59:39.926875+0000","last_peered":"2024-09-10T05:59:39.926875+0000","last_clean":"2024-09-10T05:59:39.926875+0000","last_became_active":"2024-09-10T05:55:32.625874+0000","last_became_peered":"2024-09-10T05:55:32.625874+0000","last_unstale":"2024-09-10T05:59:39.926875+0000","last_undegraded":"2024-09-10T05:59:39.926875+0000","last_fullsized":"2024-09-10T05:59:39.926875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:39.926363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:39.926363+0000","last_clean_scrub_stamp":"2024-09-10T05:59:39.926363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:28.568559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"111'12","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.539656+0000","last_change":"2024-09-10T05:59:22.539521+0000","last_active":"2024-09-10T05:59:22.539656+0000","last_peered":"2024-09-10T05:59:22.539656+0000","last_clean":"2024-09-10T05:59:22.539656+0000","last_became_active":"2024-09-10T05:55:24.584032+0000","last_became_peered":"2024-09-10T05:55:24.584032+0000","last_unstale":"2024-09-10T05:59:22.539656+0000","last_undegraded":"2024-09-10T05:59:22.539656+0000","last_fullsized":"2024-09-10T05:59:22.539656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'12","last_scrub_stamp":"2024-09-10T05:59:22.539328+0000","last_deep_scrub":"111'12","last_deep_scrub_stamp":"2024-09-10T05:59:22.539328+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.539328+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:34:10.094325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"133'74","reported_seq":344,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.243617+0000","last_change":"2024-09-10T05:59:16.243617+0000","last_active":"2024-09-10T05:59:16.243617+0000","last_peered":"2024-09-10T05:59:16.243617+0000","last_clean":"2024-09-10T05:59:16.243617+0000","last_became_active":"2024-09-10T05:55:08.798192+0000","last_became_peered":"2024-09-10T05:55:08.798192+0000","last_unstale":"2024-09-10T05:59:16.243617+0000","last_undegraded":"2024-09-10T05:59:16.243617+0000","last_fullsized":"2024-09-10T05:59:16.243617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'74","last_scrub_stamp":"2024-09-10T05:59:16.243416+0000","last_deep_scrub":"133'74","last_deep_scrub_stamp":"2024-09-10T05:59:16.243416+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.243416+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:35.743548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"133'2","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.646741+0000","last_change":"2024-09-10T05:59:15.646611+0000","last_active":"2024-09-10T05:59:15.646741+0000","last_peered":"2024-09-10T05:59:15.646741+0000","last_clean":"2024-09-10T05:59:15.646741+0000","last_became_active":"2024-09-10T05:55:12.248472+0000","last_became_peered":"2024-09-10T05:55:12.248472+0000","last_unstale":"2024-09-10T05:59:15.646741+0000","last_undegraded":"2024-09-10T05:59:15.646741+0000","last_fullsized":"2024-09-10T05:59:15.646741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:15.646413+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:15.646413+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.646413+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:45.901294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001311771,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"133'56","reported_seq":138,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.926657+0000","last_change":"2024-09-10T05:59:15.926657+0000","last_active":"2024-09-10T05:59:15.926657+0000","last_peered":"2024-09-10T05:59:15.926657+0000","last_clean":"2024-09-10T05:59:15.926657+0000","last_became_active":"2024-09-10T05:58:36.079969+0000","last_became_peered":"2024-09-10T05:58:36.079969+0000","last_unstale":"2024-09-10T05:59:15.926657+0000","last_undegraded":"2024-09-10T05:59:15.926657+0000","last_fullsized":"2024-09-10T05:59:15.926657+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'56","last_scrub_stamp":"2024-09-10T05:59:15.926475+0000","last_deep_scrub":"133'56","last_deep_scrub_stamp":"2024-09-10T05:59:15.926475+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.926475+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:13.197420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":229,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.176754+0000","last_change":"2024-09-10T05:59:34.176591+0000","last_active":"2024-09-10T05:59:34.176754+0000","last_peered":"2024-09-10T05:59:34.176754+0000","last_clean":"2024-09-10T05:59:34.176754+0000","last_became_active":"2024-09-10T05:55:26.581702+0000","last_became_peered":"2024-09-10T05:55:26.581702+0000","last_unstale":"2024-09-10T05:59:34.176754+0000","last_undegraded":"2024-09-10T05:59:34.176754+0000","last_fullsized":"2024-09-10T05:59:34.176754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.176395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.176395+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.176395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:19.243458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"133'58","reported_seq":393,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:39.688875+0000","last_change":"2024-09-10T05:59:39.688730+0000","last_active":"2024-09-10T05:59:39.688875+0000","last_peered":"2024-09-10T05:59:39.688875+0000","last_clean":"2024-09-10T05:59:39.688875+0000","last_became_active":"2024-09-10T05:58:36.087382+0000","last_became_peered":"2024-09-10T05:58:36.087382+0000","last_unstale":"2024-09-10T05:59:39.688875+0000","last_undegraded":"2024-09-10T05:59:39.688875+0000","last_fullsized":"2024-09-10T05:59:39.688875+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'58","last_scrub_stamp":"2024-09-10T05:59:39.688517+0000","last_deep_scrub":"133'58","last_deep_scrub_stamp":"2024-09-10T05:59:39.688517+0000","last_clean_scrub_stamp":"2024-09-10T05:59:39.688517+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:25.438450+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:41.219543+0000","last_change":"2024-09-10T05:59:41.219379+0000","last_active":"2024-09-10T05:59:41.219543+0000","last_peered":"2024-09-10T05:59:41.219543+0000","last_clean":"2024-09-10T05:59:41.219543+0000","last_became_active":"2024-09-10T05:55:30.627079+0000","last_became_peered":"2024-09-10T05:55:30.627079+0000","last_unstale":"2024-09-10T05:59:41.219543+0000","last_undegraded":"2024-09-10T05:59:41.219543+0000","last_fullsized":"2024-09-10T05:59:41.219543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:41.219200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:41.219200+0000","last_clean_scrub_stamp":"2024-09-10T05:59:41.219200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:41:16.643345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"111'2","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:38.644660+0000","last_change":"2024-09-10T05:59:38.644660+0000","last_active":"2024-09-10T05:59:38.644660+0000","last_peered":"2024-09-10T05:59:38.644660+0000","last_clean":"2024-09-10T05:59:38.644660+0000","last_became_active":"2024-09-10T05:55:32.630532+0000","last_became_peered":"2024-09-10T05:55:32.630532+0000","last_unstale":"2024-09-10T05:59:38.644660+0000","last_undegraded":"2024-09-10T05:59:38.644660+0000","last_fullsized":"2024-09-10T05:59:38.644660+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'2","last_scrub_stamp":"2024-09-10T05:59:38.644415+0000","last_deep_scrub":"111'2","last_deep_scrub_stamp":"2024-09-10T05:59:38.644415+0000","last_clean_scrub_stamp":"2024-09-10T05:59:38.644415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:07.521160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.075344+0000","last_change":"2024-09-10T05:59:23.075198+0000","last_active":"2024-09-10T05:59:23.075344+0000","last_peered":"2024-09-10T05:59:23.075344+0000","last_clean":"2024-09-10T05:59:23.075344+0000","last_became_active":"2024-09-10T05:55:24.564716+0000","last_became_peered":"2024-09-10T05:55:24.564716+0000","last_unstale":"2024-09-10T05:59:23.075344+0000","last_undegraded":"2024-09-10T05:59:23.075344+0000","last_fullsized":"2024-09-10T05:59:23.075344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:23.075016+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:23.075016+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.075016+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:53.671303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.292569+0000","last_change":"2024-09-10T05:59:23.292569+0000","last_active":"2024-09-10T05:59:23.292569+0000","last_peered":"2024-09-10T05:59:23.292569+0000","last_clean":"2024-09-10T05:59:23.292569+0000","last_became_active":"2024-09-10T05:55:12.249690+0000","last_became_peered":"2024-09-10T05:55:12.249690+0000","last_unstale":"2024-09-10T05:59:23.292569+0000","last_undegraded":"2024-09-10T05:59:23.292569+0000","last_fullsized":"2024-09-10T05:59:23.292569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:23.292366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:23.292366+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.292366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:38.097881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092964399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"133'38","reported_seq":274,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.205509+0000","last_change":"2024-09-10T05:59:14.205465+0000","last_active":"2024-09-10T05:59:14.205509+0000","last_peered":"2024-09-10T05:59:14.205509+0000","last_clean":"2024-09-10T05:59:14.205509+0000","last_became_active":"2024-09-10T05:55:22.565891+0000","last_became_peered":"2024-09-10T05:55:22.565891+0000","last_unstale":"2024-09-10T05:59:14.205509+0000","last_undegraded":"2024-09-10T05:59:14.205509+0000","last_fullsized":"2024-09-10T05:59:14.205509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:14.205402+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:14.205402+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.205402+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:57.869179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.687605+0000","last_change":"2024-09-10T05:59:34.687371+0000","last_active":"2024-09-10T05:59:34.687605+0000","last_peered":"2024-09-10T05:59:34.687605+0000","last_clean":"2024-09-10T05:59:34.687605+0000","last_became_active":"2024-09-10T05:55:26.572065+0000","last_became_peered":"2024-09-10T05:55:26.572065+0000","last_unstale":"2024-09-10T05:59:34.687605+0000","last_undegraded":"2024-09-10T05:59:34.687605+0000","last_fullsized":"2024-09-10T05:59:34.687605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.687151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.687151+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.687151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:38.862368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"133'162","reported_seq":507,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.042786+0000","last_change":"2024-09-10T05:59:33.042645+0000","last_active":"2024-09-10T05:59:33.042786+0000","last_peered":"2024-09-10T05:59:33.042786+0000","last_clean":"2024-09-10T05:59:33.042786+0000","last_became_active":"2024-09-10T05:55:28.584760+0000","last_became_peered":"2024-09-10T05:55:28.584760+0000","last_unstale":"2024-09-10T05:59:33.042786+0000","last_undegraded":"2024-09-10T05:59:33.042786+0000","last_fullsized":"2024-09-10T05:59:33.042786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'162","last_scrub_stamp":"2024-09-10T05:59:33.042447+0000","last_deep_scrub":"133'162","last_deep_scrub_stamp":"2024-09-10T05:59:33.042447+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.042447+0000","objects_scrubbed":11,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:28:05.457027+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":209,"num_read_kb":199,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":221,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:44.054328+0000","last_change":"2024-09-10T05:59:44.054328+0000","last_active":"2024-09-10T05:59:44.054328+0000","last_peered":"2024-09-10T05:59:44.054328+0000","last_clean":"2024-09-10T05:59:44.054328+0000","last_became_active":"2024-09-10T05:55:30.602870+0000","last_became_peered":"2024-09-10T05:55:30.602870+0000","last_unstale":"2024-09-10T05:59:44.054328+0000","last_undegraded":"2024-09-10T05:59:44.054328+0000","last_fullsized":"2024-09-10T05:59:44.054328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:44.054131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:44.054131+0000","last_clean_scrub_stamp":"2024-09-10T05:59:44.054131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:35.552948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"67'6","reported_seq":224,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:38.967905+0000","last_change":"2024-09-10T05:59:38.967651+0000","last_active":"2024-09-10T05:59:38.967905+0000","last_peered":"2024-09-10T05:59:38.967905+0000","last_clean":"2024-09-10T05:59:38.967905+0000","last_became_active":"2024-09-10T05:55:32.861933+0000","last_became_peered":"2024-09-10T05:55:32.861933+0000","last_unstale":"2024-09-10T05:59:38.967905+0000","last_undegraded":"2024-09-10T05:59:38.967905+0000","last_fullsized":"2024-09-10T05:59:38.967905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T05:59:38.967406+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T05:59:38.967406+0000","last_clean_scrub_stamp":"2024-09-10T05:59:38.967406+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:08.689853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"103'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.981835+0000","last_change":"2024-09-10T05:59:22.981529+0000","last_active":"2024-09-10T05:59:22.981835+0000","last_peered":"2024-09-10T05:59:22.981835+0000","last_clean":"2024-09-10T05:59:22.981835+0000","last_became_active":"2024-09-10T05:55:24.560929+0000","last_became_peered":"2024-09-10T05:55:24.560929+0000","last_unstale":"2024-09-10T05:59:22.981835+0000","last_undegraded":"2024-09-10T05:59:22.981835+0000","last_fullsized":"2024-09-10T05:59:22.981835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'4","last_scrub_stamp":"2024-09-10T05:59:22.981296+0000","last_deep_scrub":"103'4","last_deep_scrub_stamp":"2024-09-10T05:59:22.981296+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.981296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:50.386060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.147695+0000","last_change":"2024-09-10T05:59:13.147566+0000","last_active":"2024-09-10T05:59:13.147695+0000","last_peered":"2024-09-10T05:59:13.147695+0000","last_clean":"2024-09-10T05:59:13.147695+0000","last_became_active":"2024-09-10T05:58:36.063383+0000","last_became_peered":"2024-09-10T05:58:36.063383+0000","last_unstale":"2024-09-10T05:59:13.147695+0000","last_undegraded":"2024-09-10T05:59:13.147695+0000","last_fullsized":"2024-09-10T05:59:13.147695+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:13.147335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:13.147335+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.147335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:49.739019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"133'44","reported_seq":279,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.996627+0000","last_change":"2024-09-10T05:59:14.996552+0000","last_active":"2024-09-10T05:59:14.996627+0000","last_peered":"2024-09-10T05:59:14.996627+0000","last_clean":"2024-09-10T05:59:14.996627+0000","last_became_active":"2024-09-10T05:55:22.554388+0000","last_became_peered":"2024-09-10T05:55:22.554388+0000","last_unstale":"2024-09-10T05:59:14.996627+0000","last_undegraded":"2024-09-10T05:59:14.996627+0000","last_fullsized":"2024-09-10T05:59:14.996627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:14.996448+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:14.996448+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.996448+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:17:47.774831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"133'2","reported_seq":230,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.098472+0000","last_change":"2024-09-10T05:59:22.098311+0000","last_active":"2024-09-10T05:59:22.098472+0000","last_peered":"2024-09-10T05:59:22.098472+0000","last_clean":"2024-09-10T05:59:22.098472+0000","last_became_active":"2024-09-10T05:55:26.577555+0000","last_became_peered":"2024-09-10T05:55:26.577555+0000","last_unstale":"2024-09-10T05:59:22.098472+0000","last_undegraded":"2024-09-10T05:59:22.098472+0000","last_fullsized":"2024-09-10T05:59:22.098472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:22.098112+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:22.098112+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.098112+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:05:14.941418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"133'24","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:39.108419+0000","last_change":"2024-09-10T05:59:39.108279+0000","last_active":"2024-09-10T05:59:39.108419+0000","last_peered":"2024-09-10T05:59:39.108419+0000","last_clean":"2024-09-10T05:59:39.108419+0000","last_became_active":"2024-09-10T05:55:28.614052+0000","last_became_peered":"2024-09-10T05:55:28.614052+0000","last_unstale":"2024-09-10T05:59:39.108419+0000","last_undegraded":"2024-09-10T05:59:39.108419+0000","last_fullsized":"2024-09-10T05:59:39.108419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'24","last_scrub_stamp":"2024-09-10T05:59:39.108078+0000","last_deep_scrub":"133'24","last_deep_scrub_stamp":"2024-09-10T05:59:39.108078+0000","last_clean_scrub_stamp":"2024-09-10T05:59:39.108078+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:46:33.259279+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.147084+0000","last_change":"2024-09-10T05:59:33.146930+0000","last_active":"2024-09-10T05:59:33.147084+0000","last_peered":"2024-09-10T05:59:33.147084+0000","last_clean":"2024-09-10T05:59:33.147084+0000","last_became_active":"2024-09-10T05:55:30.617222+0000","last_became_peered":"2024-09-10T05:55:30.617222+0000","last_unstale":"2024-09-10T05:59:33.147084+0000","last_undegraded":"2024-09-10T05:59:33.147084+0000","last_fullsized":"2024-09-10T05:59:33.147084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:33.146746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:33.146746+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.146746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:03:13.729577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:53.836323+0000","last_change":"2024-09-10T05:59:53.836323+0000","last_active":"2024-09-10T05:59:53.836323+0000","last_peered":"2024-09-10T05:59:53.836323+0000","last_clean":"2024-09-10T05:59:53.836323+0000","last_became_active":"2024-09-10T05:58:36.087008+0000","last_became_peered":"2024-09-10T05:58:36.087008+0000","last_unstale":"2024-09-10T05:59:53.836323+0000","last_undegraded":"2024-09-10T05:59:53.836323+0000","last_fullsized":"2024-09-10T05:59:53.836323+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:53.836121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:53.836121+0000","last_clean_scrub_stamp":"2024-09-10T05:59:53.836121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:49.698975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"103'6","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.985701+0000","last_change":"2024-09-10T05:59:21.985568+0000","last_active":"2024-09-10T05:59:21.985701+0000","last_peered":"2024-09-10T05:59:21.985701+0000","last_clean":"2024-09-10T05:59:21.985701+0000","last_became_active":"2024-09-10T05:55:24.582025+0000","last_became_peered":"2024-09-10T05:55:24.582025+0000","last_unstale":"2024-09-10T05:59:21.985701+0000","last_undegraded":"2024-09-10T05:59:21.985701+0000","last_fullsized":"2024-09-10T05:59:21.985701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'6","last_scrub_stamp":"2024-09-10T05:59:21.985378+0000","last_deep_scrub":"103'6","last_deep_scrub_stamp":"2024-09-10T05:59:21.985378+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.985378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:59.699711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"133'3","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.651486+0000","last_change":"2024-09-10T05:59:14.651339+0000","last_active":"2024-09-10T05:59:14.651486+0000","last_peered":"2024-09-10T05:59:14.651486+0000","last_clean":"2024-09-10T05:59:14.651486+0000","last_became_active":"2024-09-10T05:55:12.247219+0000","last_became_peered":"2024-09-10T05:55:12.247219+0000","last_unstale":"2024-09-10T05:59:14.651486+0000","last_undegraded":"2024-09-10T05:59:14.651486+0000","last_fullsized":"2024-09-10T05:59:14.651486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'3","last_scrub_stamp":"2024-09-10T05:59:14.651126+0000","last_deep_scrub":"133'3","last_deep_scrub_stamp":"2024-09-10T05:59:14.651126+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.651126+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:50.020791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023715149999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"133'70","reported_seq":305,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.312434+0000","last_change":"2024-09-10T05:59:14.312294+0000","last_active":"2024-09-10T05:59:14.312434+0000","last_peered":"2024-09-10T05:59:14.312434+0000","last_clean":"2024-09-10T05:59:14.312434+0000","last_became_active":"2024-09-10T05:55:22.543033+0000","last_became_peered":"2024-09-10T05:55:22.543033+0000","last_unstale":"2024-09-10T05:59:14.312434+0000","last_undegraded":"2024-09-10T05:59:14.312434+0000","last_fullsized":"2024-09-10T05:59:14.312434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'70","last_scrub_stamp":"2024-09-10T05:59:14.312107+0000","last_deep_scrub":"133'70","last_deep_scrub_stamp":"2024-09-10T05:59:14.312107+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.312107+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:41.908033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.109333+0000","last_change":"2024-09-10T05:59:30.109196+0000","last_active":"2024-09-10T05:59:30.109333+0000","last_peered":"2024-09-10T05:59:30.109333+0000","last_clean":"2024-09-10T05:59:30.109333+0000","last_became_active":"2024-09-10T05:55:26.565431+0000","last_became_peered":"2024-09-10T05:55:26.565431+0000","last_unstale":"2024-09-10T05:59:30.109333+0000","last_undegraded":"2024-09-10T05:59:30.109333+0000","last_fullsized":"2024-09-10T05:59:30.109333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:30.108975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:30.108975+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.108975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:12.258423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"133'18","reported_seq":72,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.998682+0000","last_change":"2024-09-10T05:59:33.998682+0000","last_active":"2024-09-10T05:59:33.998682+0000","last_peered":"2024-09-10T05:59:33.998682+0000","last_clean":"2024-09-10T05:59:33.998682+0000","last_became_active":"2024-09-10T05:58:36.079626+0000","last_became_peered":"2024-09-10T05:58:36.079626+0000","last_unstale":"2024-09-10T05:59:33.998682+0000","last_undegraded":"2024-09-10T05:59:33.998682+0000","last_fullsized":"2024-09-10T05:59:33.998682+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'18","last_scrub_stamp":"2024-09-10T05:59:33.998580+0000","last_deep_scrub":"133'18","last_deep_scrub_stamp":"2024-09-10T05:59:33.998580+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.998580+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:47.716605+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.539261+0000","last_change":"2024-09-10T05:59:31.539110+0000","last_active":"2024-09-10T05:59:31.539261+0000","last_peered":"2024-09-10T05:59:31.539261+0000","last_clean":"2024-09-10T05:59:31.539261+0000","last_became_active":"2024-09-10T05:55:30.631477+0000","last_became_peered":"2024-09-10T05:55:30.631477+0000","last_unstale":"2024-09-10T05:59:31.539261+0000","last_undegraded":"2024-09-10T05:59:31.539261+0000","last_fullsized":"2024-09-10T05:59:31.539261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:31.538934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:31.538934+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.538934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:02:49.076780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"66'2","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:46.738194+0000","last_change":"2024-09-10T05:59:46.738194+0000","last_active":"2024-09-10T05:59:46.738194+0000","last_peered":"2024-09-10T05:59:46.738194+0000","last_clean":"2024-09-10T05:59:46.738194+0000","last_became_active":"2024-09-10T05:58:36.085773+0000","last_became_peered":"2024-09-10T05:58:36.085773+0000","last_unstale":"2024-09-10T05:59:46.738194+0000","last_undegraded":"2024-09-10T05:59:46.738194+0000","last_fullsized":"2024-09-10T05:59:46.738194+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'2","last_scrub_stamp":"2024-09-10T05:59:46.738001+0000","last_deep_scrub":"66'2","last_deep_scrub_stamp":"2024-09-10T05:59:46.738001+0000","last_clean_scrub_stamp":"2024-09-10T05:59:46.738001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:35:28.250695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"103'2","reported_seq":205,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.173582+0000","last_change":"2024-09-10T05:59:17.173582+0000","last_active":"2024-09-10T05:59:17.173582+0000","last_peered":"2024-09-10T05:59:17.173582+0000","last_clean":"2024-09-10T05:59:17.173582+0000","last_became_active":"2024-09-10T05:55:59.081080+0000","last_became_peered":"2024-09-10T05:55:59.081080+0000","last_unstale":"2024-09-10T05:59:17.173582+0000","last_undegraded":"2024-09-10T05:59:17.173582+0000","last_fullsized":"2024-09-10T05:59:17.173582+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-10T05:59:17.173395+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-10T05:59:17.173395+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.173395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:57.083250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"133'50","reported_seq":365,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.658984+0000","last_change":"2024-09-10T05:59:16.658850+0000","last_active":"2024-09-10T05:59:16.658984+0000","last_peered":"2024-09-10T05:59:16.658984+0000","last_clean":"2024-09-10T05:59:16.658984+0000","last_became_active":"2024-09-10T05:58:36.076406+0000","last_became_peered":"2024-09-10T05:58:36.076406+0000","last_unstale":"2024-09-10T05:59:16.658984+0000","last_undegraded":"2024-09-10T05:59:16.658984+0000","last_fullsized":"2024-09-10T05:59:16.658984+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.658656+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.658656+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.658656+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:48.622648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:13.956764+0000","last_change":"2024-09-10T05:59:13.956712+0000","last_active":"2024-09-10T05:59:13.956764+0000","last_peered":"2024-09-10T05:59:13.956764+0000","last_clean":"2024-09-10T05:59:13.956764+0000","last_became_active":"2024-09-10T05:55:12.625493+0000","last_became_peered":"2024-09-10T05:55:12.625493+0000","last_unstale":"2024-09-10T05:59:13.956764+0000","last_undegraded":"2024-09-10T05:59:13.956764+0000","last_fullsized":"2024-09-10T05:59:13.956764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:13.956649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:13.956649+0000","last_clean_scrub_stamp":"2024-09-10T05:59:13.956649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:28.951619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00100669,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"133'2","reported_seq":321,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.143861+0000","last_change":"2024-09-10T05:59:31.143675+0000","last_active":"2024-09-10T05:59:31.143861+0000","last_peered":"2024-09-10T05:59:31.143861+0000","last_clean":"2024-09-10T05:59:31.143861+0000","last_became_active":"2024-09-10T05:55:26.569845+0000","last_became_peered":"2024-09-10T05:55:26.569845+0000","last_unstale":"2024-09-10T05:59:31.143861+0000","last_undegraded":"2024-09-10T05:59:31.143861+0000","last_fullsized":"2024-09-10T05:59:31.143861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:31.143491+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:31.143491+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.143491+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:11.212450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"133'61","reported_seq":431,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:35.215667+0000","last_change":"2024-09-10T05:59:35.215667+0000","last_active":"2024-09-10T05:59:35.215667+0000","last_peered":"2024-09-10T05:59:35.215667+0000","last_clean":"2024-09-10T05:59:35.215667+0000","last_became_active":"2024-09-10T05:58:36.078736+0000","last_became_peered":"2024-09-10T05:58:36.078736+0000","last_unstale":"2024-09-10T05:59:35.215667+0000","last_undegraded":"2024-09-10T05:59:35.215667+0000","last_fullsized":"2024-09-10T05:59:35.215667+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'61","last_scrub_stamp":"2024-09-10T05:59:35.215476+0000","last_deep_scrub":"133'61","last_deep_scrub_stamp":"2024-09-10T05:59:35.215476+0000","last_clean_scrub_stamp":"2024-09-10T05:59:35.215476+0000","objects_scrubbed":10,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:26.454369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":50,"num_write":36,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":243,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:43.270090+0000","last_change":"2024-09-10T05:59:43.270090+0000","last_active":"2024-09-10T05:59:43.270090+0000","last_peered":"2024-09-10T05:59:43.270090+0000","last_clean":"2024-09-10T05:59:43.270090+0000","last_became_active":"2024-09-10T05:58:36.064219+0000","last_became_peered":"2024-09-10T05:58:36.064219+0000","last_unstale":"2024-09-10T05:59:43.270090+0000","last_undegraded":"2024-09-10T05:59:43.270090+0000","last_fullsized":"2024-09-10T05:59:43.270090+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:43.269916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:43.269916+0000","last_clean_scrub_stamp":"2024-09-10T05:59:43.269916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:32.424925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":215,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:46.187397+0000","last_change":"2024-09-10T05:59:46.187397+0000","last_active":"2024-09-10T05:59:46.187397+0000","last_peered":"2024-09-10T05:59:46.187397+0000","last_clean":"2024-09-10T05:59:46.187397+0000","last_became_active":"2024-09-10T05:55:32.861923+0000","last_became_peered":"2024-09-10T05:55:32.861923+0000","last_unstale":"2024-09-10T05:59:46.187397+0000","last_undegraded":"2024-09-10T05:59:46.187397+0000","last_fullsized":"2024-09-10T05:59:46.187397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:46.187207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:46.187207+0000","last_clean_scrub_stamp":"2024-09-10T05:59:46.187207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:52.475227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"66'2","reported_seq":241,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.058820+0000","last_change":"2024-09-10T05:59:21.058560+0000","last_active":"2024-09-10T05:59:21.058820+0000","last_peered":"2024-09-10T05:59:21.058820+0000","last_clean":"2024-09-10T05:59:21.058820+0000","last_became_active":"2024-09-10T05:55:24.561786+0000","last_became_peered":"2024-09-10T05:55:24.561786+0000","last_unstale":"2024-09-10T05:59:21.058820+0000","last_undegraded":"2024-09-10T05:59:21.058820+0000","last_fullsized":"2024-09-10T05:59:21.058820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'2","last_scrub_stamp":"2024-09-10T05:59:21.058279+0000","last_deep_scrub":"66'2","last_deep_scrub_stamp":"2024-09-10T05:59:21.058279+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.058279+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:46.067602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"133'62","reported_seq":297,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.977790+0000","last_change":"2024-09-10T05:59:17.977542+0000","last_active":"2024-09-10T05:59:17.977790+0000","last_peered":"2024-09-10T05:59:17.977790+0000","last_clean":"2024-09-10T05:59:17.977790+0000","last_became_active":"2024-09-10T05:55:22.549727+0000","last_became_peered":"2024-09-10T05:55:22.549727+0000","last_unstale":"2024-09-10T05:59:17.977790+0000","last_undegraded":"2024-09-10T05:59:17.977790+0000","last_fullsized":"2024-09-10T05:59:17.977790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'62","last_scrub_stamp":"2024-09-10T05:59:17.977309+0000","last_deep_scrub":"133'62","last_deep_scrub_stamp":"2024-09-10T05:59:17.977309+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.977309+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:48.319064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":250,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.284301+0000","last_change":"2024-09-10T05:59:17.284171+0000","last_active":"2024-09-10T05:59:17.284301+0000","last_peered":"2024-09-10T05:59:17.284301+0000","last_clean":"2024-09-10T05:59:17.284301+0000","last_became_active":"2024-09-10T05:55:12.622040+0000","last_became_peered":"2024-09-10T05:55:12.622040+0000","last_unstale":"2024-09-10T05:59:17.284301+0000","last_undegraded":"2024-09-10T05:59:17.284301+0000","last_fullsized":"2024-09-10T05:59:17.284301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:17.283992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:17.283992+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.283992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:49.937579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090188400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.555351+0000","last_change":"2024-09-10T05:59:27.555162+0000","last_active":"2024-09-10T05:59:27.555351+0000","last_peered":"2024-09-10T05:59:27.555351+0000","last_clean":"2024-09-10T05:59:27.555351+0000","last_became_active":"2024-09-10T05:55:26.569600+0000","last_became_peered":"2024-09-10T05:55:26.569600+0000","last_unstale":"2024-09-10T05:59:27.555351+0000","last_undegraded":"2024-09-10T05:59:27.555351+0000","last_fullsized":"2024-09-10T05:59:27.555351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:27.554987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:27.554987+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.554987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:04.244956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"133'28","reported_seq":264,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.022917+0000","last_change":"2024-09-10T05:59:31.022773+0000","last_active":"2024-09-10T05:59:31.022917+0000","last_peered":"2024-09-10T05:59:31.022917+0000","last_clean":"2024-09-10T05:59:31.022917+0000","last_became_active":"2024-09-10T05:55:28.614493+0000","last_became_peered":"2024-09-10T05:55:28.614493+0000","last_unstale":"2024-09-10T05:59:31.022917+0000","last_undegraded":"2024-09-10T05:59:31.022917+0000","last_fullsized":"2024-09-10T05:59:31.022917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'28","last_scrub_stamp":"2024-09-10T05:59:31.022575+0000","last_deep_scrub":"133'28","last_deep_scrub_stamp":"2024-09-10T05:59:31.022575+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.022575+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:07.474177+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"133'139","reported_seq":399,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:44.785442+0000","last_change":"2024-09-10T05:59:44.785442+0000","last_active":"2024-09-10T05:59:44.785442+0000","last_peered":"2024-09-10T05:59:44.785442+0000","last_clean":"2024-09-10T05:59:44.785442+0000","last_became_active":"2024-09-10T05:55:30.620480+0000","last_became_peered":"2024-09-10T05:55:30.620480+0000","last_unstale":"2024-09-10T05:59:44.785442+0000","last_undegraded":"2024-09-10T05:59:44.785442+0000","last_fullsized":"2024-09-10T05:59:44.785442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'139","last_scrub_stamp":"2024-09-10T05:59:44.785216+0000","last_deep_scrub":"133'139","last_deep_scrub_stamp":"2024-09-10T05:59:44.785216+0000","last_clean_scrub_stamp":"2024-09-10T05:59:44.785216+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:18.982318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"94'2","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:46.925934+0000","last_change":"2024-09-10T05:59:46.925934+0000","last_active":"2024-09-10T05:59:46.925934+0000","last_peered":"2024-09-10T05:59:46.925934+0000","last_clean":"2024-09-10T05:59:46.925934+0000","last_became_active":"2024-09-10T05:58:36.084047+0000","last_became_peered":"2024-09-10T05:58:36.084047+0000","last_unstale":"2024-09-10T05:59:46.925934+0000","last_undegraded":"2024-09-10T05:59:46.925934+0000","last_fullsized":"2024-09-10T05:59:46.925934+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T05:59:46.925747+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T05:59:46.925747+0000","last_clean_scrub_stamp":"2024-09-10T05:59:46.925747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:41:17.402128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"111'2","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.007281+0000","last_change":"2024-09-10T05:59:25.007281+0000","last_active":"2024-09-10T05:59:25.007281+0000","last_peered":"2024-09-10T05:59:25.007281+0000","last_clean":"2024-09-10T05:59:25.007281+0000","last_became_active":"2024-09-10T05:58:36.074264+0000","last_became_peered":"2024-09-10T05:58:36.074264+0000","last_unstale":"2024-09-10T05:59:25.007281+0000","last_undegraded":"2024-09-10T05:59:25.007281+0000","last_fullsized":"2024-09-10T05:59:25.007281+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'2","last_scrub_stamp":"2024-09-10T05:59:25.007085+0000","last_deep_scrub":"111'2","last_deep_scrub_stamp":"2024-09-10T05:59:25.007085+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.007085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:26.835195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"133'44","reported_seq":120,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:14.898747+0000","last_change":"2024-09-10T05:59:14.898747+0000","last_active":"2024-09-10T05:59:14.898747+0000","last_peered":"2024-09-10T05:59:14.898747+0000","last_clean":"2024-09-10T05:59:14.898747+0000","last_became_active":"2024-09-10T05:58:36.084149+0000","last_became_peered":"2024-09-10T05:58:36.084149+0000","last_unstale":"2024-09-10T05:59:14.898747+0000","last_undegraded":"2024-09-10T05:59:14.898747+0000","last_fullsized":"2024-09-10T05:59:14.898747+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:14.898657+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:14.898657+0000","last_clean_scrub_stamp":"2024-09-10T05:59:14.898657+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:16.081466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:12.989458+0000","last_change":"2024-09-10T05:59:12.989341+0000","last_active":"2024-09-10T05:59:12.989458+0000","last_peered":"2024-09-10T05:59:12.989458+0000","last_clean":"2024-09-10T05:59:12.989458+0000","last_became_active":"2024-09-10T05:55:12.251514+0000","last_became_peered":"2024-09-10T05:55:12.251514+0000","last_unstale":"2024-09-10T05:59:12.989458+0000","last_undegraded":"2024-09-10T05:59:12.989458+0000","last_fullsized":"2024-09-10T05:59:12.989458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:12.989167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:12.989167+0000","last_clean_scrub_stamp":"2024-09-10T05:59:12.989167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:24.216589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011410789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":251,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.401869+0000","last_change":"2024-09-10T05:59:34.401740+0000","last_active":"2024-09-10T05:59:34.401869+0000","last_peered":"2024-09-10T05:59:34.401869+0000","last_clean":"2024-09-10T05:59:34.401869+0000","last_became_active":"2024-09-10T05:58:36.064476+0000","last_became_peered":"2024-09-10T05:58:36.064476+0000","last_unstale":"2024-09-10T05:59:34.401869+0000","last_undegraded":"2024-09-10T05:59:34.401869+0000","last_fullsized":"2024-09-10T05:59:34.401869+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.401559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.401559+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.401559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:37.806614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"133'22","reported_seq":336,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:40.345760+0000","last_change":"2024-09-10T05:59:40.345760+0000","last_active":"2024-09-10T05:59:40.345760+0000","last_peered":"2024-09-10T05:59:40.345760+0000","last_clean":"2024-09-10T05:59:40.345760+0000","last_became_active":"2024-09-10T05:58:36.073330+0000","last_became_peered":"2024-09-10T05:58:36.073330+0000","last_unstale":"2024-09-10T05:59:40.345760+0000","last_undegraded":"2024-09-10T05:59:40.345760+0000","last_fullsized":"2024-09-10T05:59:40.345760+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'22","last_scrub_stamp":"2024-09-10T05:59:40.345581+0000","last_deep_scrub":"133'22","last_deep_scrub_stamp":"2024-09-10T05:59:40.345581+0000","last_clean_scrub_stamp":"2024-09-10T05:59:40.345581+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:47:13.998127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"133'146","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:51.881197+0000","last_change":"2024-09-10T05:59:51.881197+0000","last_active":"2024-09-10T05:59:51.881197+0000","last_peered":"2024-09-10T05:59:51.881197+0000","last_clean":"2024-09-10T05:59:51.881197+0000","last_became_active":"2024-09-10T05:58:42.102067+0000","last_became_peered":"2024-09-10T05:58:42.102067+0000","last_unstale":"2024-09-10T05:59:51.881197+0000","last_undegraded":"2024-09-10T05:59:51.881197+0000","last_fullsized":"2024-09-10T05:59:51.881197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'146","last_scrub_stamp":"2024-09-10T05:59:51.881015+0000","last_deep_scrub":"133'146","last_deep_scrub_stamp":"2024-09-10T05:59:51.881015+0000","last_clean_scrub_stamp":"2024-09-10T05:59:51.881015+0000","objects_scrubbed":1,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:11.649810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:45.140797+0000","last_change":"2024-09-10T05:59:45.140797+0000","last_active":"2024-09-10T05:59:45.140797+0000","last_peered":"2024-09-10T05:59:45.140797+0000","last_clean":"2024-09-10T05:59:45.140797+0000","last_became_active":"2024-09-10T05:58:36.070985+0000","last_became_peered":"2024-09-10T05:58:36.070985+0000","last_unstale":"2024-09-10T05:59:45.140797+0000","last_undegraded":"2024-09-10T05:59:45.140797+0000","last_fullsized":"2024-09-10T05:59:45.140797+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:45.140605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:45.140605+0000","last_clean_scrub_stamp":"2024-09-10T05:59:45.140605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:25:31.938147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'2","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.372707+0000","last_change":"2024-09-10T05:59:19.372463+0000","last_active":"2024-09-10T05:59:19.372707+0000","last_peered":"2024-09-10T05:59:19.372707+0000","last_clean":"2024-09-10T05:59:19.372707+0000","last_became_active":"2024-09-10T05:55:24.574717+0000","last_became_peered":"2024-09-10T05:55:24.574717+0000","last_unstale":"2024-09-10T05:59:19.372707+0000","last_undegraded":"2024-09-10T05:59:19.372707+0000","last_fullsized":"2024-09-10T05:59:19.372707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:19.372187+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:19.372187+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.372187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:24.297278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"133'42","reported_seq":278,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:12.250810+0000","last_change":"2024-09-10T05:59:12.250756+0000","last_active":"2024-09-10T05:59:12.250810+0000","last_peered":"2024-09-10T05:59:12.250810+0000","last_clean":"2024-09-10T05:59:12.250810+0000","last_became_active":"2024-09-10T05:55:22.544226+0000","last_became_peered":"2024-09-10T05:55:22.544226+0000","last_unstale":"2024-09-10T05:59:12.250810+0000","last_undegraded":"2024-09-10T05:59:12.250810+0000","last_fullsized":"2024-09-10T05:59:12.250810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:12.250666+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:12.250666+0000","last_clean_scrub_stamp":"2024-09-10T05:59:12.250666+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:45.112879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.735191+0000","last_change":"2024-09-10T05:59:15.735047+0000","last_active":"2024-09-10T05:59:15.735191+0000","last_peered":"2024-09-10T05:59:15.735191+0000","last_clean":"2024-09-10T05:59:15.735191+0000","last_became_active":"2024-09-10T05:55:12.250259+0000","last_became_peered":"2024-09-10T05:55:12.250259+0000","last_unstale":"2024-09-10T05:59:15.735191+0000","last_undegraded":"2024-09-10T05:59:15.735191+0000","last_fullsized":"2024-09-10T05:59:15.735191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:15.734857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:15.734857+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.734857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:21.882735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090027399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.050236+0000","last_change":"2024-09-10T05:59:32.050236+0000","last_active":"2024-09-10T05:59:32.050236+0000","last_peered":"2024-09-10T05:59:32.050236+0000","last_clean":"2024-09-10T05:59:32.050236+0000","last_became_active":"2024-09-10T05:58:36.072904+0000","last_became_peered":"2024-09-10T05:58:36.072904+0000","last_unstale":"2024-09-10T05:59:32.050236+0000","last_undegraded":"2024-09-10T05:59:32.050236+0000","last_fullsized":"2024-09-10T05:59:32.050236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:32.050051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:32.050051+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.050051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:47.153096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"133'65","reported_seq":325,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:38.107447+0000","last_change":"2024-09-10T05:59:38.107297+0000","last_active":"2024-09-10T05:59:38.107447+0000","last_peered":"2024-09-10T05:59:38.107447+0000","last_clean":"2024-09-10T05:59:38.107447+0000","last_became_active":"2024-09-10T05:55:28.612194+0000","last_became_peered":"2024-09-10T05:55:28.612194+0000","last_unstale":"2024-09-10T05:59:38.107447+0000","last_undegraded":"2024-09-10T05:59:38.107447+0000","last_fullsized":"2024-09-10T05:59:38.107447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'65","last_scrub_stamp":"2024-09-10T05:59:38.107066+0000","last_deep_scrub":"133'65","last_deep_scrub_stamp":"2024-09-10T05:59:38.107066+0000","last_clean_scrub_stamp":"2024-09-10T05:59:38.107066+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:14.822733+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":51,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:36.035037+0000","last_change":"2024-09-10T05:59:36.035037+0000","last_active":"2024-09-10T05:59:36.035037+0000","last_peered":"2024-09-10T05:59:36.035037+0000","last_clean":"2024-09-10T05:59:36.035037+0000","last_became_active":"2024-09-10T05:58:36.068513+0000","last_became_peered":"2024-09-10T05:58:36.068513+0000","last_unstale":"2024-09-10T05:59:36.035037+0000","last_undegraded":"2024-09-10T05:59:36.035037+0000","last_fullsized":"2024-09-10T05:59:36.035037+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:36.034965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:36.034965+0000","last_clean_scrub_stamp":"2024-09-10T05:59:36.034965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:40.057716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'3","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:47.772157+0000","last_change":"2024-09-10T05:59:47.772157+0000","last_active":"2024-09-10T05:59:47.772157+0000","last_peered":"2024-09-10T05:59:47.772157+0000","last_clean":"2024-09-10T05:59:47.772157+0000","last_became_active":"2024-09-10T05:55:32.627296+0000","last_became_peered":"2024-09-10T05:55:32.627296+0000","last_unstale":"2024-09-10T05:59:47.772157+0000","last_undegraded":"2024-09-10T05:59:47.772157+0000","last_fullsized":"2024-09-10T05:59:47.772157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2024-09-10T05:59:47.771954+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2024-09-10T05:59:47.771954+0000","last_clean_scrub_stamp":"2024-09-10T05:59:47.771954+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:17.522500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:50.076734+0000","last_change":"2024-09-10T05:59:50.076734+0000","last_active":"2024-09-10T05:59:50.076734+0000","last_peered":"2024-09-10T05:59:50.076734+0000","last_clean":"2024-09-10T05:59:50.076734+0000","last_became_active":"2024-09-10T05:55:32.634867+0000","last_became_peered":"2024-09-10T05:55:32.634867+0000","last_unstale":"2024-09-10T05:59:50.076734+0000","last_undegraded":"2024-09-10T05:59:50.076734+0000","last_fullsized":"2024-09-10T05:59:50.076734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:50.076531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:50.076531+0000","last_clean_scrub_stamp":"2024-09-10T05:59:50.076531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:20.508400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"66'8","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.292024+0000","last_change":"2024-09-10T05:59:24.292024+0000","last_active":"2024-09-10T05:59:24.292024+0000","last_peered":"2024-09-10T05:59:24.292024+0000","last_clean":"2024-09-10T05:59:24.292024+0000","last_became_active":"2024-09-10T05:55:24.576782+0000","last_became_peered":"2024-09-10T05:55:24.576782+0000","last_unstale":"2024-09-10T05:59:24.292024+0000","last_undegraded":"2024-09-10T05:59:24.292024+0000","last_fullsized":"2024-09-10T05:59:24.292024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-09-10T05:59:24.291839+0000","last_deep_scrub":"66'8","last_deep_scrub_stamp":"2024-09-10T05:59:24.291839+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.291839+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:14.719010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"133'52","reported_seq":286,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.396804+0000","last_change":"2024-09-10T05:59:17.396804+0000","last_active":"2024-09-10T05:59:17.396804+0000","last_peered":"2024-09-10T05:59:17.396804+0000","last_clean":"2024-09-10T05:59:17.396804+0000","last_became_active":"2024-09-10T05:55:22.534107+0000","last_became_peered":"2024-09-10T05:55:22.534107+0000","last_unstale":"2024-09-10T05:59:17.396804+0000","last_undegraded":"2024-09-10T05:59:17.396804+0000","last_fullsized":"2024-09-10T05:59:17.396804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'52","last_scrub_stamp":"2024-09-10T05:59:17.396634+0000","last_deep_scrub":"133'52","last_deep_scrub_stamp":"2024-09-10T05:59:17.396634+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.396634+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:21.444487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.977761+0000","last_change":"2024-09-10T05:59:25.977761+0000","last_active":"2024-09-10T05:59:25.977761+0000","last_peered":"2024-09-10T05:59:25.977761+0000","last_clean":"2024-09-10T05:59:25.977761+0000","last_became_active":"2024-09-10T05:55:26.575665+0000","last_became_peered":"2024-09-10T05:55:26.575665+0000","last_unstale":"2024-09-10T05:59:25.977761+0000","last_undegraded":"2024-09-10T05:59:25.977761+0000","last_fullsized":"2024-09-10T05:59:25.977761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:25.977575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:25.977575+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.977575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:16:07.724043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"133'35","reported_seq":79,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:45.968428+0000","last_change":"2024-09-10T05:59:45.968428+0000","last_active":"2024-09-10T05:59:45.968428+0000","last_peered":"2024-09-10T05:59:45.968428+0000","last_clean":"2024-09-10T05:59:45.968428+0000","last_became_active":"2024-09-10T05:58:36.061077+0000","last_became_peered":"2024-09-10T05:58:36.061077+0000","last_unstale":"2024-09-10T05:59:45.968428+0000","last_undegraded":"2024-09-10T05:59:45.968428+0000","last_fullsized":"2024-09-10T05:59:45.968428+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'35","last_scrub_stamp":"2024-09-10T05:59:45.968217+0000","last_deep_scrub":"133'35","last_deep_scrub_stamp":"2024-09-10T05:59:45.968217+0000","last_clean_scrub_stamp":"2024-09-10T05:59:45.968217+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:16.539832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":26,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:42.016649+0000","last_change":"2024-09-10T05:59:42.016649+0000","last_active":"2024-09-10T05:59:42.016649+0000","last_peered":"2024-09-10T05:59:42.016649+0000","last_clean":"2024-09-10T05:59:42.016649+0000","last_became_active":"2024-09-10T05:58:36.075610+0000","last_became_peered":"2024-09-10T05:58:36.075610+0000","last_unstale":"2024-09-10T05:59:42.016649+0000","last_undegraded":"2024-09-10T05:59:42.016649+0000","last_fullsized":"2024-09-10T05:59:42.016649+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:42.016433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:42.016433+0000","last_clean_scrub_stamp":"2024-09-10T05:59:42.016433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:55.403927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"111'4","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:50.906076+0000","last_change":"2024-09-10T05:59:50.906076+0000","last_active":"2024-09-10T05:59:50.906076+0000","last_peered":"2024-09-10T05:59:50.906076+0000","last_clean":"2024-09-10T05:59:50.906076+0000","last_became_active":"2024-09-10T05:58:36.060859+0000","last_became_peered":"2024-09-10T05:58:36.060859+0000","last_unstale":"2024-09-10T05:59:50.906076+0000","last_undegraded":"2024-09-10T05:59:50.906076+0000","last_fullsized":"2024-09-10T05:59:50.906076+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:50.905893+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:50.905893+0000","last_clean_scrub_stamp":"2024-09-10T05:59:50.905893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:49.269664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"66'8","reported_seq":252,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.001760+0000","last_change":"2024-09-10T05:59:21.001760+0000","last_active":"2024-09-10T05:59:21.001760+0000","last_peered":"2024-09-10T05:59:21.001760+0000","last_clean":"2024-09-10T05:59:21.001760+0000","last_became_active":"2024-09-10T05:55:24.570715+0000","last_became_peered":"2024-09-10T05:55:24.570715+0000","last_unstale":"2024-09-10T05:59:21.001760+0000","last_undegraded":"2024-09-10T05:59:21.001760+0000","last_fullsized":"2024-09-10T05:59:21.001760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'8","last_scrub_stamp":"2024-09-10T05:59:21.001469+0000","last_deep_scrub":"66'8","last_deep_scrub_stamp":"2024-09-10T05:59:21.001469+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.001469+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:29.886601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"133'50","reported_seq":374,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.285863+0000","last_change":"2024-09-10T05:59:21.285863+0000","last_active":"2024-09-10T05:59:21.285863+0000","last_peered":"2024-09-10T05:59:21.285863+0000","last_clean":"2024-09-10T05:59:21.285863+0000","last_became_active":"2024-09-10T05:58:36.068122+0000","last_became_peered":"2024-09-10T05:58:36.068122+0000","last_unstale":"2024-09-10T05:59:21.285863+0000","last_undegraded":"2024-09-10T05:59:21.285863+0000","last_fullsized":"2024-09-10T05:59:21.285863+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:21.285688+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:21.285688+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.285688+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:53.196589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":125829120,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:45.002494+0000","last_change":"2024-09-10T05:59:45.002494+0000","last_active":"2024-09-10T05:59:45.002494+0000","last_peered":"2024-09-10T05:59:45.002494+0000","last_clean":"2024-09-10T05:59:45.002494+0000","last_became_active":"2024-09-10T05:58:36.082023+0000","last_became_peered":"2024-09-10T05:58:36.082023+0000","last_unstale":"2024-09-10T05:59:45.002494+0000","last_undegraded":"2024-09-10T05:59:45.002494+0000","last_fullsized":"2024-09-10T05:59:45.002494+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:45.002337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:45.002337+0000","last_clean_scrub_stamp":"2024-09-10T05:59:45.002337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:36.773025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"133'13","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:40.189820+0000","last_change":"2024-09-10T05:59:40.189820+0000","last_active":"2024-09-10T05:59:40.189820+0000","last_peered":"2024-09-10T05:59:40.189820+0000","last_clean":"2024-09-10T05:59:40.189820+0000","last_became_active":"2024-09-10T05:55:28.575106+0000","last_became_peered":"2024-09-10T05:55:28.575106+0000","last_unstale":"2024-09-10T05:59:40.189820+0000","last_undegraded":"2024-09-10T05:59:40.189820+0000","last_fullsized":"2024-09-10T05:59:40.189820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'13","last_scrub_stamp":"2024-09-10T05:59:40.189630+0000","last_deep_scrub":"133'13","last_deep_scrub_stamp":"2024-09-10T05:59:40.189630+0000","last_clean_scrub_stamp":"2024-09-10T05:59:40.189630+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:31.303551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:45.097975+0000","last_change":"2024-09-10T05:59:45.097975+0000","last_active":"2024-09-10T05:59:45.097975+0000","last_peered":"2024-09-10T05:59:45.097975+0000","last_clean":"2024-09-10T05:59:45.097975+0000","last_became_active":"2024-09-10T05:55:30.612824+0000","last_became_peered":"2024-09-10T05:55:30.612824+0000","last_unstale":"2024-09-10T05:59:45.097975+0000","last_undegraded":"2024-09-10T05:59:45.097975+0000","last_fullsized":"2024-09-10T05:59:45.097975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:45.097787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:45.097787+0000","last_clean_scrub_stamp":"2024-09-10T05:59:45.097787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:03.139186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"67'3","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:48.110656+0000","last_change":"2024-09-10T05:59:48.110656+0000","last_active":"2024-09-10T05:59:48.110656+0000","last_peered":"2024-09-10T05:59:48.110656+0000","last_clean":"2024-09-10T05:59:48.110656+0000","last_became_active":"2024-09-10T05:55:32.633901+0000","last_became_peered":"2024-09-10T05:55:32.633901+0000","last_unstale":"2024-09-10T05:59:48.110656+0000","last_undegraded":"2024-09-10T05:59:48.110656+0000","last_fullsized":"2024-09-10T05:59:48.110656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'3","last_scrub_stamp":"2024-09-10T05:59:48.110437+0000","last_deep_scrub":"67'3","last_deep_scrub_stamp":"2024-09-10T05:59:48.110437+0000","last_clean_scrub_stamp":"2024-09-10T05:59:48.110437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:38.666151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"94'6","reported_seq":60,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.058934+0000","last_change":"2024-09-10T05:59:27.058934+0000","last_active":"2024-09-10T05:59:27.058934+0000","last_peered":"2024-09-10T05:59:27.058934+0000","last_clean":"2024-09-10T05:59:27.058934+0000","last_became_active":"2024-09-10T05:58:36.061724+0000","last_became_peered":"2024-09-10T05:58:36.061724+0000","last_unstale":"2024-09-10T05:59:27.058934+0000","last_undegraded":"2024-09-10T05:59:27.058934+0000","last_fullsized":"2024-09-10T05:59:27.058934+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-09-10T05:59:27.058742+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-09-10T05:59:27.058742+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.058742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:28.781032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"133'46","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.646364+0000","last_change":"2024-09-10T05:59:17.646364+0000","last_active":"2024-09-10T05:59:17.646364+0000","last_peered":"2024-09-10T05:59:17.646364+0000","last_clean":"2024-09-10T05:59:17.646364+0000","last_became_active":"2024-09-10T05:55:22.567719+0000","last_became_peered":"2024-09-10T05:55:22.567719+0000","last_unstale":"2024-09-10T05:59:17.646364+0000","last_undegraded":"2024-09-10T05:59:17.646364+0000","last_fullsized":"2024-09-10T05:59:17.646364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:17.646148+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:17.646148+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.646148+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:40.120177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:35.182474+0000","last_change":"2024-09-10T05:59:35.182474+0000","last_active":"2024-09-10T05:59:35.182474+0000","last_peered":"2024-09-10T05:59:35.182474+0000","last_clean":"2024-09-10T05:59:35.182474+0000","last_became_active":"2024-09-10T05:55:26.575330+0000","last_became_peered":"2024-09-10T05:55:26.575330+0000","last_unstale":"2024-09-10T05:59:35.182474+0000","last_undegraded":"2024-09-10T05:59:35.182474+0000","last_fullsized":"2024-09-10T05:59:35.182474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:35.182298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:35.182298+0000","last_clean_scrub_stamp":"2024-09-10T05:59:35.182298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:26.848807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"133'29","reported_seq":76,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:49.959111+0000","last_change":"2024-09-10T05:59:49.959111+0000","last_active":"2024-09-10T05:59:49.959111+0000","last_peered":"2024-09-10T05:59:49.959111+0000","last_clean":"2024-09-10T05:59:49.959111+0000","last_became_active":"2024-09-10T05:58:36.079229+0000","last_became_peered":"2024-09-10T05:58:36.079229+0000","last_unstale":"2024-09-10T05:59:49.959111+0000","last_undegraded":"2024-09-10T05:59:49.959111+0000","last_fullsized":"2024-09-10T05:59:49.959111+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'29","last_scrub_stamp":"2024-09-10T05:59:49.958918+0000","last_deep_scrub":"133'29","last_deep_scrub_stamp":"2024-09-10T05:59:49.958918+0000","last_clean_scrub_stamp":"2024-09-10T05:59:49.958918+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:35.092909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:35.681553+0000","last_change":"2024-09-10T05:59:35.681553+0000","last_active":"2024-09-10T05:59:35.681553+0000","last_peered":"2024-09-10T05:59:35.681553+0000","last_clean":"2024-09-10T05:59:35.681553+0000","last_became_active":"2024-09-10T05:55:30.624981+0000","last_became_peered":"2024-09-10T05:55:30.624981+0000","last_unstale":"2024-09-10T05:59:35.681553+0000","last_undegraded":"2024-09-10T05:59:35.681553+0000","last_fullsized":"2024-09-10T05:59:35.681553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:35.681346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:35.681346+0000","last_clean_scrub_stamp":"2024-09-10T05:59:35.681346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:26.572537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"103'8","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:50.756543+0000","last_change":"2024-09-10T05:59:50.756543+0000","last_active":"2024-09-10T05:59:50.756543+0000","last_peered":"2024-09-10T05:59:50.756543+0000","last_clean":"2024-09-10T05:59:50.756543+0000","last_became_active":"2024-09-10T05:55:32.623542+0000","last_became_peered":"2024-09-10T05:55:32.623542+0000","last_unstale":"2024-09-10T05:59:50.756543+0000","last_undegraded":"2024-09-10T05:59:50.756543+0000","last_fullsized":"2024-09-10T05:59:50.756543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'8","last_scrub_stamp":"2024-09-10T05:59:50.756307+0000","last_deep_scrub":"103'8","last_deep_scrub_stamp":"2024-09-10T05:59:50.756307+0000","last_clean_scrub_stamp":"2024-09-10T05:59:50.756307+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:43.292451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"67'4","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.032588+0000","last_change":"2024-09-10T05:59:26.032588+0000","last_active":"2024-09-10T05:59:26.032588+0000","last_peered":"2024-09-10T05:59:26.032588+0000","last_clean":"2024-09-10T05:59:26.032588+0000","last_became_active":"2024-09-10T05:58:36.083060+0000","last_became_peered":"2024-09-10T05:58:36.083060+0000","last_unstale":"2024-09-10T05:59:26.032588+0000","last_undegraded":"2024-09-10T05:59:26.032588+0000","last_fullsized":"2024-09-10T05:59:26.032588+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:26.032398+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:26.032398+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.032398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:47.140938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"133'60","reported_seq":295,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.185107+0000","last_change":"2024-09-10T05:59:16.185107+0000","last_active":"2024-09-10T05:59:16.185107+0000","last_peered":"2024-09-10T05:59:16.185107+0000","last_clean":"2024-09-10T05:59:16.185107+0000","last_became_active":"2024-09-10T05:55:22.560769+0000","last_became_peered":"2024-09-10T05:55:22.560769+0000","last_unstale":"2024-09-10T05:59:16.185107+0000","last_undegraded":"2024-09-10T05:59:16.185107+0000","last_fullsized":"2024-09-10T05:59:16.185107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:16.184898+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:16.184898+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.184898+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:20.614025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.493504+0000","last_change":"2024-09-10T05:59:30.493504+0000","last_active":"2024-09-10T05:59:30.493504+0000","last_peered":"2024-09-10T05:59:30.493504+0000","last_clean":"2024-09-10T05:59:30.493504+0000","last_became_active":"2024-09-10T05:55:26.575758+0000","last_became_peered":"2024-09-10T05:55:26.575758+0000","last_unstale":"2024-09-10T05:59:30.493504+0000","last_undegraded":"2024-09-10T05:59:30.493504+0000","last_fullsized":"2024-09-10T05:59:30.493504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:30.493327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:30.493327+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.493327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:51.950474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"133'24","reported_seq":259,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:41.122246+0000","last_change":"2024-09-10T05:59:41.122246+0000","last_active":"2024-09-10T05:59:41.122246+0000","last_peered":"2024-09-10T05:59:41.122246+0000","last_clean":"2024-09-10T05:59:41.122246+0000","last_became_active":"2024-09-10T05:55:28.576405+0000","last_became_peered":"2024-09-10T05:55:28.576405+0000","last_unstale":"2024-09-10T05:59:41.122246+0000","last_undegraded":"2024-09-10T05:59:41.122246+0000","last_fullsized":"2024-09-10T05:59:41.122246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'24","last_scrub_stamp":"2024-09-10T05:59:41.122044+0000","last_deep_scrub":"133'24","last_deep_scrub_stamp":"2024-09-10T05:59:41.122044+0000","last_clean_scrub_stamp":"2024-09-10T05:59:41.122044+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:17.071124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:42.223874+0000","last_change":"2024-09-10T05:59:42.223874+0000","last_active":"2024-09-10T05:59:42.223874+0000","last_peered":"2024-09-10T05:59:42.223874+0000","last_clean":"2024-09-10T05:59:42.223874+0000","last_became_active":"2024-09-10T05:55:30.618627+0000","last_became_peered":"2024-09-10T05:55:30.618627+0000","last_unstale":"2024-09-10T05:59:42.223874+0000","last_undegraded":"2024-09-10T05:59:42.223874+0000","last_fullsized":"2024-09-10T05:59:42.223874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:42.223690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:42.223690+0000","last_clean_scrub_stamp":"2024-09-10T05:59:42.223690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:37.394245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"94'6","reported_seq":258,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.543903+0000","last_change":"2024-09-10T05:59:28.543767+0000","last_active":"2024-09-10T05:59:28.543903+0000","last_peered":"2024-09-10T05:59:28.543903+0000","last_clean":"2024-09-10T05:59:28.543903+0000","last_became_active":"2024-09-10T05:55:24.568137+0000","last_became_peered":"2024-09-10T05:55:24.568137+0000","last_unstale":"2024-09-10T05:59:28.543903+0000","last_undegraded":"2024-09-10T05:59:28.543903+0000","last_fullsized":"2024-09-10T05:59:28.543903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-09-10T05:59:28.543579+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-09-10T05:59:28.543579+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.543579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:27.084544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"133'50","reported_seq":129,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.952941+0000","last_change":"2024-09-10T05:59:18.952941+0000","last_active":"2024-09-10T05:59:18.952941+0000","last_peered":"2024-09-10T05:59:18.952941+0000","last_clean":"2024-09-10T05:59:18.952941+0000","last_became_active":"2024-09-10T05:58:36.076028+0000","last_became_peered":"2024-09-10T05:58:36.076028+0000","last_unstale":"2024-09-10T05:59:18.952941+0000","last_undegraded":"2024-09-10T05:59:18.952941+0000","last_fullsized":"2024-09-10T05:59:18.952941+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:18.952748+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:18.952748+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.952748+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:50.656154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":138412032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.163573+0000","last_change":"2024-09-10T05:59:34.163573+0000","last_active":"2024-09-10T05:59:34.163573+0000","last_peered":"2024-09-10T05:59:34.163573+0000","last_clean":"2024-09-10T05:59:34.163573+0000","last_became_active":"2024-09-10T05:55:26.577581+0000","last_became_peered":"2024-09-10T05:55:26.577581+0000","last_unstale":"2024-09-10T05:59:34.163573+0000","last_undegraded":"2024-09-10T05:59:34.163573+0000","last_fullsized":"2024-09-10T05:59:34.163573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.163369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.163369+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.163369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:21.050407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"133'49","reported_seq":296,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.003921+0000","last_change":"2024-09-10T05:59:32.003921+0000","last_active":"2024-09-10T05:59:32.003921+0000","last_peered":"2024-09-10T05:59:32.003921+0000","last_clean":"2024-09-10T05:59:32.003921+0000","last_became_active":"2024-09-10T05:55:28.582935+0000","last_became_peered":"2024-09-10T05:55:28.582935+0000","last_unstale":"2024-09-10T05:59:32.003921+0000","last_undegraded":"2024-09-10T05:59:32.003921+0000","last_fullsized":"2024-09-10T05:59:32.003921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'49","last_scrub_stamp":"2024-09-10T05:59:32.003669+0000","last_deep_scrub":"133'49","last_deep_scrub_stamp":"2024-09-10T05:59:32.003669+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.003669+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:44.708081+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":159,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":242,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:43.774778+0000","last_change":"2024-09-10T05:59:43.774778+0000","last_active":"2024-09-10T05:59:43.774778+0000","last_peered":"2024-09-10T05:59:43.774778+0000","last_clean":"2024-09-10T05:59:43.774778+0000","last_became_active":"2024-09-10T05:58:36.081361+0000","last_became_peered":"2024-09-10T05:58:36.081361+0000","last_unstale":"2024-09-10T05:59:43.774778+0000","last_undegraded":"2024-09-10T05:59:43.774778+0000","last_fullsized":"2024-09-10T05:59:43.774778+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:43.774598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:43.774598+0000","last_clean_scrub_stamp":"2024-09-10T05:59:43.774598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:34.325157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:54.807270+0000","last_change":"2024-09-10T05:59:54.807270+0000","last_active":"2024-09-10T05:59:54.807270+0000","last_peered":"2024-09-10T05:59:54.807270+0000","last_clean":"2024-09-10T05:59:54.807270+0000","last_became_active":"2024-09-10T05:58:36.086568+0000","last_became_peered":"2024-09-10T05:58:36.086568+0000","last_unstale":"2024-09-10T05:59:54.807270+0000","last_undegraded":"2024-09-10T05:59:54.807270+0000","last_fullsized":"2024-09-10T05:59:54.807270+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:54.806997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:54.806997+0000","last_clean_scrub_stamp":"2024-09-10T05:59:54.806997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:45.875933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"67'2","reported_seq":240,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.137747+0000","last_change":"2024-09-10T05:59:25.137747+0000","last_active":"2024-09-10T05:59:25.137747+0000","last_peered":"2024-09-10T05:59:25.137747+0000","last_clean":"2024-09-10T05:59:25.137747+0000","last_became_active":"2024-09-10T05:55:24.573224+0000","last_became_peered":"2024-09-10T05:55:24.573224+0000","last_unstale":"2024-09-10T05:59:25.137747+0000","last_undegraded":"2024-09-10T05:59:25.137747+0000","last_fullsized":"2024-09-10T05:59:25.137747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:25.137550+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:25.137550+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.137550+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:20.763077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"133'50","reported_seq":378,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.933819+0000","last_change":"2024-09-10T05:59:16.933819+0000","last_active":"2024-09-10T05:59:16.933819+0000","last_peered":"2024-09-10T05:59:16.933819+0000","last_clean":"2024-09-10T05:59:16.933819+0000","last_became_active":"2024-09-10T05:58:36.072749+0000","last_became_peered":"2024-09-10T05:58:36.072749+0000","last_unstale":"2024-09-10T05:59:16.933819+0000","last_undegraded":"2024-09-10T05:59:16.933819+0000","last_fullsized":"2024-09-10T05:59:16.933819+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.933620+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.933620+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.933620+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:57.079640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":227,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.542479+0000","last_change":"2024-09-10T05:59:29.542345+0000","last_active":"2024-09-10T05:59:29.542479+0000","last_peered":"2024-09-10T05:59:29.542479+0000","last_clean":"2024-09-10T05:59:29.542479+0000","last_became_active":"2024-09-10T05:55:26.577752+0000","last_became_peered":"2024-09-10T05:55:26.577752+0000","last_unstale":"2024-09-10T05:59:29.542479+0000","last_undegraded":"2024-09-10T05:59:29.542479+0000","last_fullsized":"2024-09-10T05:59:29.542479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:29.542161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:29.542161+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.542161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:00.556891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"133'33","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:43.101954+0000","last_change":"2024-09-10T05:59:43.101954+0000","last_active":"2024-09-10T05:59:43.101954+0000","last_peered":"2024-09-10T05:59:43.101954+0000","last_clean":"2024-09-10T05:59:43.101954+0000","last_became_active":"2024-09-10T05:55:28.576722+0000","last_became_peered":"2024-09-10T05:55:28.576722+0000","last_unstale":"2024-09-10T05:59:43.101954+0000","last_undegraded":"2024-09-10T05:59:43.101954+0000","last_fullsized":"2024-09-10T05:59:43.101954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'33","last_scrub_stamp":"2024-09-10T05:59:43.101732+0000","last_deep_scrub":"133'33","last_deep_scrub_stamp":"2024-09-10T05:59:43.101732+0000","last_clean_scrub_stamp":"2024-09-10T05:59:43.101732+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:46.677369+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.972734+0000","last_change":"2024-09-10T05:59:34.972734+0000","last_active":"2024-09-10T05:59:34.972734+0000","last_peered":"2024-09-10T05:59:34.972734+0000","last_clean":"2024-09-10T05:59:34.972734+0000","last_became_active":"2024-09-10T05:55:30.621990+0000","last_became_peered":"2024-09-10T05:55:30.621990+0000","last_unstale":"2024-09-10T05:59:34.972734+0000","last_undegraded":"2024-09-10T05:59:34.972734+0000","last_fullsized":"2024-09-10T05:59:34.972734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.972551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.972551+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.972551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:25.399721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":214,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:39.599880+0000","last_change":"2024-09-10T05:59:39.599880+0000","last_active":"2024-09-10T05:59:39.599880+0000","last_peered":"2024-09-10T05:59:39.599880+0000","last_clean":"2024-09-10T05:59:39.599880+0000","last_became_active":"2024-09-10T05:55:32.627059+0000","last_became_peered":"2024-09-10T05:55:32.627059+0000","last_unstale":"2024-09-10T05:59:39.599880+0000","last_undegraded":"2024-09-10T05:59:39.599880+0000","last_fullsized":"2024-09-10T05:59:39.599880+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:39.599699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:39.599699+0000","last_clean_scrub_stamp":"2024-09-10T05:59:39.599699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:52.753174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"74'6","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.066824+0000","last_change":"2024-09-10T05:59:29.066824+0000","last_active":"2024-09-10T05:59:29.066824+0000","last_peered":"2024-09-10T05:59:29.066824+0000","last_clean":"2024-09-10T05:59:29.066824+0000","last_became_active":"2024-09-10T05:58:36.068448+0000","last_became_peered":"2024-09-10T05:58:36.068448+0000","last_unstale":"2024-09-10T05:59:29.066824+0000","last_undegraded":"2024-09-10T05:59:29.066824+0000","last_fullsized":"2024-09-10T05:59:29.066824+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'6","last_scrub_stamp":"2024-09-10T05:59:29.066624+0000","last_deep_scrub":"74'6","last_deep_scrub_stamp":"2024-09-10T05:59:29.066624+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.066624+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:58.964077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"133'38","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.366911+0000","last_change":"2024-09-10T05:59:16.366911+0000","last_active":"2024-09-10T05:59:16.366911+0000","last_peered":"2024-09-10T05:59:16.366911+0000","last_clean":"2024-09-10T05:59:16.366911+0000","last_became_active":"2024-09-10T05:55:22.539888+0000","last_became_peered":"2024-09-10T05:55:22.539888+0000","last_unstale":"2024-09-10T05:59:16.366911+0000","last_undegraded":"2024-09-10T05:59:16.366911+0000","last_fullsized":"2024-09-10T05:59:16.366911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:16.366739+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:16.366739+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.366739+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:09.340629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"133'2","reported_seq":359,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:38.367482+0000","last_change":"2024-09-10T05:59:38.367482+0000","last_active":"2024-09-10T05:59:38.367482+0000","last_peered":"2024-09-10T05:59:38.367482+0000","last_clean":"2024-09-10T05:59:38.367482+0000","last_became_active":"2024-09-10T05:58:36.081615+0000","last_became_peered":"2024-09-10T05:58:36.081615+0000","last_unstale":"2024-09-10T05:59:38.367482+0000","last_undegraded":"2024-09-10T05:59:38.367482+0000","last_fullsized":"2024-09-10T05:59:38.367482+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:38.367299+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:38.367299+0000","last_clean_scrub_stamp":"2024-09-10T05:59:38.367299+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:01.130613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"133'38","reported_seq":80,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:43.024964+0000","last_change":"2024-09-10T05:59:43.024964+0000","last_active":"2024-09-10T05:59:43.024964+0000","last_peered":"2024-09-10T05:59:43.024964+0000","last_clean":"2024-09-10T05:59:43.024964+0000","last_became_active":"2024-09-10T05:58:36.084652+0000","last_became_peered":"2024-09-10T05:58:36.084652+0000","last_unstale":"2024-09-10T05:59:43.024964+0000","last_undegraded":"2024-09-10T05:59:43.024964+0000","last_fullsized":"2024-09-10T05:59:43.024964+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:43.024709+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:43.024709+0000","last_clean_scrub_stamp":"2024-09-10T05:59:43.024709+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:42:39.623992+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":156,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":59592,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":243,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.004061+0000","last_change":"2024-09-10T05:59:34.004061+0000","last_active":"2024-09-10T05:59:34.004061+0000","last_peered":"2024-09-10T05:59:34.004061+0000","last_clean":"2024-09-10T05:59:34.004061+0000","last_became_active":"2024-09-10T05:58:36.072898+0000","last_became_peered":"2024-09-10T05:58:36.072898+0000","last_unstale":"2024-09-10T05:59:34.004061+0000","last_undegraded":"2024-09-10T05:59:34.004061+0000","last_fullsized":"2024-09-10T05:59:34.004061+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.003990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.003990+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.003990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:21.968179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"66'4","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:48.784142+0000","last_change":"2024-09-10T05:59:48.784142+0000","last_active":"2024-09-10T05:59:48.784142+0000","last_peered":"2024-09-10T05:59:48.784142+0000","last_clean":"2024-09-10T05:59:48.784142+0000","last_became_active":"2024-09-10T05:55:32.626875+0000","last_became_peered":"2024-09-10T05:55:32.626875+0000","last_unstale":"2024-09-10T05:59:48.784142+0000","last_undegraded":"2024-09-10T05:59:48.784142+0000","last_fullsized":"2024-09-10T05:59:48.784142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:48.783886+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:48.783886+0000","last_clean_scrub_stamp":"2024-09-10T05:59:48.783886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:01.674999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"66'4","reported_seq":249,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.107185+0000","last_change":"2024-09-10T05:59:23.107185+0000","last_active":"2024-09-10T05:59:23.107185+0000","last_peered":"2024-09-10T05:59:23.107185+0000","last_clean":"2024-09-10T05:59:23.107185+0000","last_became_active":"2024-09-10T05:55:24.566683+0000","last_became_peered":"2024-09-10T05:55:24.566683+0000","last_unstale":"2024-09-10T05:59:23.107185+0000","last_undegraded":"2024-09-10T05:59:23.107185+0000","last_fullsized":"2024-09-10T05:59:23.107185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:23.107001+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:23.107001+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.107001+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:53.546690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"133'52","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.214420+0000","last_change":"2024-09-10T05:59:15.214420+0000","last_active":"2024-09-10T05:59:15.214420+0000","last_peered":"2024-09-10T05:59:15.214420+0000","last_clean":"2024-09-10T05:59:15.214420+0000","last_became_active":"2024-09-10T05:55:22.561152+0000","last_became_peered":"2024-09-10T05:55:22.561152+0000","last_unstale":"2024-09-10T05:59:15.214420+0000","last_undegraded":"2024-09-10T05:59:15.214420+0000","last_fullsized":"2024-09-10T05:59:15.214420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'52","last_scrub_stamp":"2024-09-10T05:59:15.214350+0000","last_deep_scrub":"133'52","last_deep_scrub_stamp":"2024-09-10T05:59:15.214350+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.214350+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:33.989680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.052320+0000","last_change":"2024-09-10T05:59:28.052320+0000","last_active":"2024-09-10T05:59:28.052320+0000","last_peered":"2024-09-10T05:59:28.052320+0000","last_clean":"2024-09-10T05:59:28.052320+0000","last_became_active":"2024-09-10T05:55:26.578249+0000","last_became_peered":"2024-09-10T05:55:26.578249+0000","last_unstale":"2024-09-10T05:59:28.052320+0000","last_undegraded":"2024-09-10T05:59:28.052320+0000","last_fullsized":"2024-09-10T05:59:28.052320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:28.052109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:28.052109+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.052109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:32.099961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"133'22","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:42.303905+0000","last_change":"2024-09-10T05:59:42.303905+0000","last_active":"2024-09-10T05:59:42.303905+0000","last_peered":"2024-09-10T05:59:42.303905+0000","last_clean":"2024-09-10T05:59:42.303905+0000","last_became_active":"2024-09-10T05:55:28.610671+0000","last_became_peered":"2024-09-10T05:55:28.610671+0000","last_unstale":"2024-09-10T05:59:42.303905+0000","last_undegraded":"2024-09-10T05:59:42.303905+0000","last_fullsized":"2024-09-10T05:59:42.303905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'22","last_scrub_stamp":"2024-09-10T05:59:42.303717+0000","last_deep_scrub":"133'22","last_deep_scrub_stamp":"2024-09-10T05:59:42.303717+0000","last_clean_scrub_stamp":"2024-09-10T05:59:42.303717+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:27.029600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"133'138","reported_seq":398,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:36.710782+0000","last_change":"2024-09-10T05:59:36.710645+0000","last_active":"2024-09-10T05:59:36.710782+0000","last_peered":"2024-09-10T05:59:36.710782+0000","last_clean":"2024-09-10T05:59:36.710782+0000","last_became_active":"2024-09-10T05:55:30.609684+0000","last_became_peered":"2024-09-10T05:55:30.609684+0000","last_unstale":"2024-09-10T05:59:36.710782+0000","last_undegraded":"2024-09-10T05:59:36.710782+0000","last_fullsized":"2024-09-10T05:59:36.710782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'138","last_scrub_stamp":"2024-09-10T05:59:36.710457+0000","last_deep_scrub":"133'138","last_deep_scrub_stamp":"2024-09-10T05:59:36.710457+0000","last_clean_scrub_stamp":"2024-09-10T05:59:36.710457+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:37.957413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"66'4","reported_seq":224,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:47.160571+0000","last_change":"2024-09-10T05:59:47.160571+0000","last_active":"2024-09-10T05:59:47.160571+0000","last_peered":"2024-09-10T05:59:47.160571+0000","last_clean":"2024-09-10T05:59:47.160571+0000","last_became_active":"2024-09-10T05:55:32.624078+0000","last_became_peered":"2024-09-10T05:55:32.624078+0000","last_unstale":"2024-09-10T05:59:47.160571+0000","last_undegraded":"2024-09-10T05:59:47.160571+0000","last_fullsized":"2024-09-10T05:59:47.160571+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:47.160339+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:47.160339+0000","last_clean_scrub_stamp":"2024-09-10T05:59:47.160339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:41.145674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"67'4","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.398758+0000","last_change":"2024-09-10T05:59:27.398758+0000","last_active":"2024-09-10T05:59:27.398758+0000","last_peered":"2024-09-10T05:59:27.398758+0000","last_clean":"2024-09-10T05:59:27.398758+0000","last_became_active":"2024-09-10T05:58:36.081399+0000","last_became_peered":"2024-09-10T05:58:36.081399+0000","last_unstale":"2024-09-10T05:59:27.398758+0000","last_undegraded":"2024-09-10T05:59:27.398758+0000","last_fullsized":"2024-09-10T05:59:27.398758+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:27.398538+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:27.398538+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.398538+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:13:29.315847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"133'32","reported_seq":267,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.716003+0000","last_change":"2024-09-10T05:59:19.716003+0000","last_active":"2024-09-10T05:59:19.716003+0000","last_peered":"2024-09-10T05:59:19.716003+0000","last_clean":"2024-09-10T05:59:19.716003+0000","last_became_active":"2024-09-10T05:55:22.571598+0000","last_became_peered":"2024-09-10T05:55:22.571598+0000","last_unstale":"2024-09-10T05:59:19.716003+0000","last_undegraded":"2024-09-10T05:59:19.716003+0000","last_fullsized":"2024-09-10T05:59:19.716003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'32","last_scrub_stamp":"2024-09-10T05:59:19.715807+0000","last_deep_scrub":"133'32","last_deep_scrub_stamp":"2024-09-10T05:59:19.715807+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.715807+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:47.160496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":40,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:37.102590+0000","last_change":"2024-09-10T05:59:37.102590+0000","last_active":"2024-09-10T05:59:37.102590+0000","last_peered":"2024-09-10T05:59:37.102590+0000","last_clean":"2024-09-10T05:59:37.102590+0000","last_became_active":"2024-09-10T05:55:26.580828+0000","last_became_peered":"2024-09-10T05:55:26.580828+0000","last_unstale":"2024-09-10T05:59:37.102590+0000","last_undegraded":"2024-09-10T05:59:37.102590+0000","last_fullsized":"2024-09-10T05:59:37.102590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:37.102348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:37.102348+0000","last_clean_scrub_stamp":"2024-09-10T05:59:37.102348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:55.934602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"133'63","reported_seq":323,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:42.768989+0000","last_change":"2024-09-10T05:59:42.768989+0000","last_active":"2024-09-10T05:59:42.768989+0000","last_peered":"2024-09-10T05:59:42.768989+0000","last_clean":"2024-09-10T05:59:42.768989+0000","last_became_active":"2024-09-10T05:55:28.581276+0000","last_became_peered":"2024-09-10T05:55:28.581276+0000","last_unstale":"2024-09-10T05:59:42.768989+0000","last_undegraded":"2024-09-10T05:59:42.768989+0000","last_fullsized":"2024-09-10T05:59:42.768989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'63","last_scrub_stamp":"2024-09-10T05:59:42.768777+0000","last_deep_scrub":"133'63","last_deep_scrub_stamp":"2024-09-10T05:59:42.768777+0000","last_clean_scrub_stamp":"2024-09-10T05:59:42.768777+0000","objects_scrubbed":11,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:29:33.711839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":73,"num_read_kb":292,"num_write":46,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:51.090929+0000","last_change":"2024-09-10T05:59:51.090929+0000","last_active":"2024-09-10T05:59:51.090929+0000","last_peered":"2024-09-10T05:59:51.090929+0000","last_clean":"2024-09-10T05:59:51.090929+0000","last_became_active":"2024-09-10T05:55:30.618131+0000","last_became_peered":"2024-09-10T05:55:30.618131+0000","last_unstale":"2024-09-10T05:59:51.090929+0000","last_undegraded":"2024-09-10T05:59:51.090929+0000","last_fullsized":"2024-09-10T05:59:51.090929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:51.090742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:51.090742+0000","last_clean_scrub_stamp":"2024-09-10T05:59:51.090742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:26.393299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":216,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:50.156544+0000","last_change":"2024-09-10T05:59:50.156544+0000","last_active":"2024-09-10T05:59:50.156544+0000","last_peered":"2024-09-10T05:59:50.156544+0000","last_clean":"2024-09-10T05:59:50.156544+0000","last_became_active":"2024-09-10T05:55:32.628299+0000","last_became_peered":"2024-09-10T05:55:32.628299+0000","last_unstale":"2024-09-10T05:59:50.156544+0000","last_undegraded":"2024-09-10T05:59:50.156544+0000","last_fullsized":"2024-09-10T05:59:50.156544+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:50.156373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:50.156373+0000","last_clean_scrub_stamp":"2024-09-10T05:59:50.156373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:11:25.494746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"103'6","reported_seq":301,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.378981+0000","last_change":"2024-09-10T05:59:26.378981+0000","last_active":"2024-09-10T05:59:26.378981+0000","last_peered":"2024-09-10T05:59:26.378981+0000","last_clean":"2024-09-10T05:59:26.378981+0000","last_became_active":"2024-09-10T05:58:36.072797+0000","last_became_peered":"2024-09-10T05:58:36.072797+0000","last_unstale":"2024-09-10T05:59:26.378981+0000","last_undegraded":"2024-09-10T05:59:26.378981+0000","last_fullsized":"2024-09-10T05:59:26.378981+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'6","last_scrub_stamp":"2024-09-10T05:59:26.378791+0000","last_deep_scrub":"103'6","last_deep_scrub_stamp":"2024-09-10T05:59:26.378791+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.378791+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:59.241004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"133'46","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.668876+0000","last_change":"2024-09-10T05:59:18.668876+0000","last_active":"2024-09-10T05:59:18.668876+0000","last_peered":"2024-09-10T05:59:18.668876+0000","last_clean":"2024-09-10T05:59:18.668876+0000","last_became_active":"2024-09-10T05:55:22.571451+0000","last_became_peered":"2024-09-10T05:55:22.571451+0000","last_unstale":"2024-09-10T05:59:18.668876+0000","last_undegraded":"2024-09-10T05:59:18.668876+0000","last_fullsized":"2024-09-10T05:59:18.668876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:18.668620+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:18.668620+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.668620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:05:10.335130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:38.643515+0000","last_change":"2024-09-10T05:59:38.643515+0000","last_active":"2024-09-10T05:59:38.643515+0000","last_peered":"2024-09-10T05:59:38.643515+0000","last_clean":"2024-09-10T05:59:38.643515+0000","last_became_active":"2024-09-10T05:55:26.572432+0000","last_became_peered":"2024-09-10T05:55:26.572432+0000","last_unstale":"2024-09-10T05:59:38.643515+0000","last_undegraded":"2024-09-10T05:59:38.643515+0000","last_fullsized":"2024-09-10T05:59:38.643515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:38.643290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:38.643290+0000","last_clean_scrub_stamp":"2024-09-10T05:59:38.643290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:44:38.147162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"133'31","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:47.159710+0000","last_change":"2024-09-10T05:59:47.159710+0000","last_active":"2024-09-10T05:59:47.159710+0000","last_peered":"2024-09-10T05:59:47.159710+0000","last_clean":"2024-09-10T05:59:47.159710+0000","last_became_active":"2024-09-10T05:55:28.583510+0000","last_became_peered":"2024-09-10T05:55:28.583510+0000","last_unstale":"2024-09-10T05:59:47.159710+0000","last_undegraded":"2024-09-10T05:59:47.159710+0000","last_fullsized":"2024-09-10T05:59:47.159710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'31","last_scrub_stamp":"2024-09-10T05:59:47.159503+0000","last_deep_scrub":"133'31","last_deep_scrub_stamp":"2024-09-10T05:59:47.159503+0000","last_clean_scrub_stamp":"2024-09-10T05:59:47.159503+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:43:49.960748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:34.634711+0000","last_change":"2024-09-10T05:59:34.634711+0000","last_active":"2024-09-10T05:59:34.634711+0000","last_peered":"2024-09-10T05:59:34.634711+0000","last_clean":"2024-09-10T05:59:34.634711+0000","last_became_active":"2024-09-10T05:55:30.607126+0000","last_became_peered":"2024-09-10T05:55:30.607126+0000","last_unstale":"2024-09-10T05:59:34.634711+0000","last_undegraded":"2024-09-10T05:59:34.634711+0000","last_fullsized":"2024-09-10T05:59:34.634711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:34.634500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:34.634500+0000","last_clean_scrub_stamp":"2024-09-10T05:59:34.634500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:23:55.518696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"66'4","reported_seq":56,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:47.904946+0000","last_change":"2024-09-10T05:59:47.904946+0000","last_active":"2024-09-10T05:59:47.904946+0000","last_peered":"2024-09-10T05:59:47.904946+0000","last_clean":"2024-09-10T05:59:47.904946+0000","last_became_active":"2024-09-10T05:58:36.066899+0000","last_became_peered":"2024-09-10T05:58:36.066899+0000","last_unstale":"2024-09-10T05:59:47.904946+0000","last_undegraded":"2024-09-10T05:59:47.904946+0000","last_fullsized":"2024-09-10T05:59:47.904946+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:47.904756+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:47.904756+0000","last_clean_scrub_stamp":"2024-09-10T05:59:47.904756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:17.614326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"66'4","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.105900+0000","last_change":"2024-09-10T05:59:28.105900+0000","last_active":"2024-09-10T05:59:28.105900+0000","last_peered":"2024-09-10T05:59:28.105900+0000","last_clean":"2024-09-10T05:59:28.105900+0000","last_became_active":"2024-09-10T05:58:36.067793+0000","last_became_peered":"2024-09-10T05:58:36.067793+0000","last_unstale":"2024-09-10T05:59:28.105900+0000","last_undegraded":"2024-09-10T05:59:28.105900+0000","last_fullsized":"2024-09-10T05:59:28.105900+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:28.105721+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:28.105721+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.105721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:57.586721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"133'60","reported_seq":144,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:17.926684+0000","last_change":"2024-09-10T05:59:17.926684+0000","last_active":"2024-09-10T05:59:17.926684+0000","last_peered":"2024-09-10T05:59:17.926684+0000","last_clean":"2024-09-10T05:59:17.926684+0000","last_became_active":"2024-09-10T05:58:36.061963+0000","last_became_peered":"2024-09-10T05:58:36.061963+0000","last_unstale":"2024-09-10T05:59:17.926684+0000","last_undegraded":"2024-09-10T05:59:17.926684+0000","last_fullsized":"2024-09-10T05:59:17.926684+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:17.926486+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:17.926486+0000","last_clean_scrub_stamp":"2024-09-10T05:59:17.926486+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:05.537251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:37.389337+0000","last_change":"2024-09-10T05:59:37.389337+0000","last_active":"2024-09-10T05:59:37.389337+0000","last_peered":"2024-09-10T05:59:37.389337+0000","last_clean":"2024-09-10T05:59:37.389337+0000","last_became_active":"2024-09-10T05:55:26.567909+0000","last_became_peered":"2024-09-10T05:55:26.567909+0000","last_unstale":"2024-09-10T05:59:37.389337+0000","last_undegraded":"2024-09-10T05:59:37.389337+0000","last_fullsized":"2024-09-10T05:59:37.389337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:37.389156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:37.389156+0000","last_clean_scrub_stamp":"2024-09-10T05:59:37.389156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:25.860464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"133'25","reported_seq":70,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:52.860643+0000","last_change":"2024-09-10T05:59:52.860643+0000","last_active":"2024-09-10T05:59:52.860643+0000","last_peered":"2024-09-10T05:59:52.860643+0000","last_clean":"2024-09-10T05:59:52.860643+0000","last_became_active":"2024-09-10T05:58:36.082871+0000","last_became_peered":"2024-09-10T05:58:36.082871+0000","last_unstale":"2024-09-10T05:59:52.860643+0000","last_undegraded":"2024-09-10T05:59:52.860643+0000","last_fullsized":"2024-09-10T05:59:52.860643+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'25","last_scrub_stamp":"2024-09-10T05:59:52.860452+0000","last_deep_scrub":"133'25","last_deep_scrub_stamp":"2024-09-10T05:59:52.860452+0000","last_clean_scrub_stamp":"2024-09-10T05:59:52.860452+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:35.366714+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":218,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:46.243324+0000","last_change":"2024-09-10T05:59:46.243324+0000","last_active":"2024-09-10T05:59:46.243324+0000","last_peered":"2024-09-10T05:59:46.243324+0000","last_clean":"2024-09-10T05:59:46.243324+0000","last_became_active":"2024-09-10T05:55:30.609447+0000","last_became_peered":"2024-09-10T05:55:30.609447+0000","last_unstale":"2024-09-10T05:59:46.243324+0000","last_undegraded":"2024-09-10T05:59:46.243324+0000","last_fullsized":"2024-09-10T05:59:46.243324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:46.243103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:46.243103+0000","last_clean_scrub_stamp":"2024-09-10T05:59:46.243103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:52.068916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"67'2","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:49.164369+0000","last_change":"2024-09-10T05:59:49.164369+0000","last_active":"2024-09-10T05:59:49.164369+0000","last_peered":"2024-09-10T05:59:49.164369+0000","last_clean":"2024-09-10T05:59:49.164369+0000","last_became_active":"2024-09-10T05:55:32.624523+0000","last_became_peered":"2024-09-10T05:55:32.624523+0000","last_unstale":"2024-09-10T05:59:49.164369+0000","last_undegraded":"2024-09-10T05:59:49.164369+0000","last_fullsized":"2024-09-10T05:59:49.164369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:49.164179+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:49.164179+0000","last_clean_scrub_stamp":"2024-09-10T05:59:49.164179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:51:09.862266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"67'2","reported_seq":238,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.329942+0000","last_change":"2024-09-10T05:59:25.329942+0000","last_active":"2024-09-10T05:59:25.329942+0000","last_peered":"2024-09-10T05:59:25.329942+0000","last_clean":"2024-09-10T05:59:25.329942+0000","last_became_active":"2024-09-10T05:55:24.579053+0000","last_became_peered":"2024-09-10T05:55:24.579053+0000","last_unstale":"2024-09-10T05:59:25.329942+0000","last_undegraded":"2024-09-10T05:59:25.329942+0000","last_fullsized":"2024-09-10T05:59:25.329942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:25.329737+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:25.329737+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.329737+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:59.621742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"133'50","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:16.162924+0000","last_change":"2024-09-10T05:59:16.162924+0000","last_active":"2024-09-10T05:59:16.162924+0000","last_peered":"2024-09-10T05:59:16.162924+0000","last_clean":"2024-09-10T05:59:16.162924+0000","last_became_active":"2024-09-10T05:55:59.085855+0000","last_became_peered":"2024-09-10T05:55:59.085855+0000","last_unstale":"2024-09-10T05:59:16.162924+0000","last_undegraded":"2024-09-10T05:59:16.162924+0000","last_fullsized":"2024-09-10T05:59:16.162924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:16.162653+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:16.162653+0000","last_clean_scrub_stamp":"2024-09-10T05:59:16.162653+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:01.267884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"133'2","reported_seq":228,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.012220+0000","last_change":"2024-09-10T05:59:30.012220+0000","last_active":"2024-09-10T05:59:30.012220+0000","last_peered":"2024-09-10T05:59:30.012220+0000","last_clean":"2024-09-10T05:59:30.012220+0000","last_became_active":"2024-09-10T05:55:26.586029+0000","last_became_peered":"2024-09-10T05:55:26.586029+0000","last_unstale":"2024-09-10T05:59:30.012220+0000","last_undegraded":"2024-09-10T05:59:30.012220+0000","last_fullsized":"2024-09-10T05:59:30.012220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'2","last_scrub_stamp":"2024-09-10T05:59:30.012044+0000","last_deep_scrub":"133'2","last_deep_scrub_stamp":"2024-09-10T05:59:30.012044+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.012044+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:34.937135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"133'40","reported_seq":285,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:41.307988+0000","last_change":"2024-09-10T05:59:41.307988+0000","last_active":"2024-09-10T05:59:41.307988+0000","last_peered":"2024-09-10T05:59:41.307988+0000","last_clean":"2024-09-10T05:59:41.307988+0000","last_became_active":"2024-09-10T05:55:28.572580+0000","last_became_peered":"2024-09-10T05:55:28.572580+0000","last_unstale":"2024-09-10T05:59:41.307988+0000","last_undegraded":"2024-09-10T05:59:41.307988+0000","last_fullsized":"2024-09-10T05:59:41.307988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'40","last_scrub_stamp":"2024-09-10T05:59:41.307786+0000","last_deep_scrub":"133'40","last_deep_scrub_stamp":"2024-09-10T05:59:41.307786+0000","last_clean_scrub_stamp":"2024-09-10T05:59:41.307786+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:19.290627+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":44,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":219,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:44.163737+0000","last_change":"2024-09-10T05:59:44.163737+0000","last_active":"2024-09-10T05:59:44.163737+0000","last_peered":"2024-09-10T05:59:44.163737+0000","last_clean":"2024-09-10T05:59:44.163737+0000","last_became_active":"2024-09-10T05:55:30.627500+0000","last_became_peered":"2024-09-10T05:55:30.627500+0000","last_unstale":"2024-09-10T05:59:44.163737+0000","last_undegraded":"2024-09-10T05:59:44.163737+0000","last_fullsized":"2024-09-10T05:59:44.163737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:44.163557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:44.163557+0000","last_clean_scrub_stamp":"2024-09-10T05:59:44.163557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:22:00.556158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"66'4","reported_seq":220,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:48.276645+0000","last_change":"2024-09-10T05:59:48.276645+0000","last_active":"2024-09-10T05:59:48.276645+0000","last_peered":"2024-09-10T05:59:48.276645+0000","last_clean":"2024-09-10T05:59:48.276645+0000","last_became_active":"2024-09-10T05:55:32.638796+0000","last_became_peered":"2024-09-10T05:55:32.638796+0000","last_unstale":"2024-09-10T05:59:48.276645+0000","last_undegraded":"2024-09-10T05:59:48.276645+0000","last_fullsized":"2024-09-10T05:59:48.276645+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'4","last_scrub_stamp":"2024-09-10T05:59:48.276453+0000","last_deep_scrub":"66'4","last_deep_scrub_stamp":"2024-09-10T05:59:48.276453+0000","last_clean_scrub_stamp":"2024-09-10T05:59:48.276453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:21:35.163491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"111'6","reported_seq":256,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.014411+0000","last_change":"2024-09-10T05:59:27.014273+0000","last_active":"2024-09-10T05:59:27.014411+0000","last_peered":"2024-09-10T05:59:27.014411+0000","last_clean":"2024-09-10T05:59:27.014411+0000","last_became_active":"2024-09-10T05:55:24.570800+0000","last_became_peered":"2024-09-10T05:55:24.570800+0000","last_unstale":"2024-09-10T05:59:27.014411+0000","last_undegraded":"2024-09-10T05:59:27.014411+0000","last_fullsized":"2024-09-10T05:59:27.014411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'6","last_scrub_stamp":"2024-09-10T05:59:27.014056+0000","last_deep_scrub":"111'6","last_deep_scrub_stamp":"2024-09-10T05:59:27.014056+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.014056+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:19.987945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"133'60","reported_seq":295,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.670008+0000","last_change":"2024-09-10T05:59:18.669875+0000","last_active":"2024-09-10T05:59:18.670008+0000","last_peered":"2024-09-10T05:59:18.670008+0000","last_clean":"2024-09-10T05:59:18.670008+0000","last_became_active":"2024-09-10T05:55:22.577059+0000","last_became_peered":"2024-09-10T05:55:22.577059+0000","last_unstale":"2024-09-10T05:59:18.670008+0000","last_undegraded":"2024-09-10T05:59:18.670008+0000","last_fullsized":"2024-09-10T05:59:18.670008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:18.669682+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:18.669682+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.669682+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:10.494023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"67'8","reported_seq":263,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.962544+0000","last_change":"2024-09-10T05:59:23.962289+0000","last_active":"2024-09-10T05:59:23.962544+0000","last_peered":"2024-09-10T05:59:23.962544+0000","last_clean":"2024-09-10T05:59:23.962544+0000","last_became_active":"2024-09-10T05:55:24.577741+0000","last_became_peered":"2024-09-10T05:55:24.577741+0000","last_unstale":"2024-09-10T05:59:23.962544+0000","last_undegraded":"2024-09-10T05:59:23.962544+0000","last_fullsized":"2024-09-10T05:59:23.962544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T05:59:23.962005+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T05:59:23.962005+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.962005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:10:36.747611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"133'44","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.195969+0000","last_change":"2024-09-10T05:59:15.195909+0000","last_active":"2024-09-10T05:59:15.195969+0000","last_peered":"2024-09-10T05:59:15.195969+0000","last_clean":"2024-09-10T05:59:15.195969+0000","last_became_active":"2024-09-10T05:55:22.554513+0000","last_became_peered":"2024-09-10T05:55:22.554513+0000","last_unstale":"2024-09-10T05:59:15.195969+0000","last_undegraded":"2024-09-10T05:59:15.195969+0000","last_fullsized":"2024-09-10T05:59:15.195969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:15.195818+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:15.195818+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.195818+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:50.050428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"111'6","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:31.753199+0000","last_change":"2024-09-10T05:59:31.752912+0000","last_active":"2024-09-10T05:59:31.753199+0000","last_peered":"2024-09-10T05:59:31.753199+0000","last_clean":"2024-09-10T05:59:31.753199+0000","last_became_active":"2024-09-10T05:55:24.549884+0000","last_became_peered":"2024-09-10T05:55:24.549884+0000","last_unstale":"2024-09-10T05:59:31.753199+0000","last_undegraded":"2024-09-10T05:59:31.753199+0000","last_fullsized":"2024-09-10T05:59:31.753199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'6","last_scrub_stamp":"2024-09-10T05:59:31.752692+0000","last_deep_scrub":"111'6","last_deep_scrub_stamp":"2024-09-10T05:59:31.752692+0000","last_clean_scrub_stamp":"2024-09-10T05:59:31.752692+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:06:25.006090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"133'40","reported_seq":348,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.688142+0000","last_change":"2024-09-10T05:59:20.688005+0000","last_active":"2024-09-10T05:59:20.688142+0000","last_peered":"2024-09-10T05:59:20.688142+0000","last_clean":"2024-09-10T05:59:20.688142+0000","last_became_active":"2024-09-10T05:58:36.076114+0000","last_became_peered":"2024-09-10T05:58:36.076114+0000","last_unstale":"2024-09-10T05:59:20.688142+0000","last_undegraded":"2024-09-10T05:59:20.688142+0000","last_fullsized":"2024-09-10T05:59:20.688142+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'40","last_scrub_stamp":"2024-09-10T05:59:20.687816+0000","last_deep_scrub":"133'40","last_deep_scrub_stamp":"2024-09-10T05:59:20.687816+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.687816+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:39.520070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":48,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"111'2","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.964196+0000","last_change":"2024-09-10T05:59:24.964033+0000","last_active":"2024-09-10T05:59:24.964196+0000","last_peered":"2024-09-10T05:59:24.964196+0000","last_clean":"2024-09-10T05:59:24.964196+0000","last_became_active":"2024-09-10T05:55:24.574861+0000","last_became_peered":"2024-09-10T05:55:24.574861+0000","last_unstale":"2024-09-10T05:59:24.964196+0000","last_undegraded":"2024-09-10T05:59:24.964196+0000","last_fullsized":"2024-09-10T05:59:24.964196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'2","last_scrub_stamp":"2024-09-10T05:59:24.963835+0000","last_deep_scrub":"111'2","last_deep_scrub_stamp":"2024-09-10T05:59:24.963835+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.963835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:52.559761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"133'44","reported_seq":360,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.078089+0000","last_change":"2024-09-10T05:59:20.077927+0000","last_active":"2024-09-10T05:59:20.078089+0000","last_peered":"2024-09-10T05:59:20.078089+0000","last_clean":"2024-09-10T05:59:20.078089+0000","last_became_active":"2024-09-10T05:58:36.077881+0000","last_became_peered":"2024-09-10T05:58:36.077881+0000","last_unstale":"2024-09-10T05:59:20.078089+0000","last_undegraded":"2024-09-10T05:59:20.078089+0000","last_fullsized":"2024-09-10T05:59:20.078089+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'44","last_scrub_stamp":"2024-09-10T05:59:20.077742+0000","last_deep_scrub":"133'44","last_deep_scrub_stamp":"2024-09-10T05:59:20.077742+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.077742+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:54.834780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"67'2","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.125225+0000","last_change":"2024-09-10T05:59:26.125225+0000","last_active":"2024-09-10T05:59:26.125225+0000","last_peered":"2024-09-10T05:59:26.125225+0000","last_clean":"2024-09-10T05:59:26.125225+0000","last_became_active":"2024-09-10T05:58:36.079788+0000","last_became_peered":"2024-09-10T05:58:36.079788+0000","last_unstale":"2024-09-10T05:59:26.125225+0000","last_undegraded":"2024-09-10T05:59:26.125225+0000","last_fullsized":"2024-09-10T05:59:26.125225+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:26.125044+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:26.125044+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.125044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:59.777590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"133'60","reported_seq":144,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.007306+0000","last_change":"2024-09-10T05:59:21.007306+0000","last_active":"2024-09-10T05:59:21.007306+0000","last_peered":"2024-09-10T05:59:21.007306+0000","last_clean":"2024-09-10T05:59:21.007306+0000","last_became_active":"2024-09-10T05:58:36.070936+0000","last_became_peered":"2024-09-10T05:58:36.070936+0000","last_unstale":"2024-09-10T05:59:21.007306+0000","last_undegraded":"2024-09-10T05:59:21.007306+0000","last_fullsized":"2024-09-10T05:59:21.007306+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'60","last_scrub_stamp":"2024-09-10T05:59:21.007124+0000","last_deep_scrub":"133'60","last_deep_scrub_stamp":"2024-09-10T05:59:21.007124+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.007124+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:15.336800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":155189248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"103'12","reported_seq":269,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.425638+0000","last_change":"2024-09-10T05:59:29.425501+0000","last_active":"2024-09-10T05:59:29.425638+0000","last_peered":"2024-09-10T05:59:29.425638+0000","last_clean":"2024-09-10T05:59:29.425638+0000","last_became_active":"2024-09-10T05:55:24.575057+0000","last_became_peered":"2024-09-10T05:55:24.575057+0000","last_unstale":"2024-09-10T05:59:29.425638+0000","last_undegraded":"2024-09-10T05:59:29.425638+0000","last_fullsized":"2024-09-10T05:59:29.425638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-10T05:59:29.425313+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-10T05:59:29.425313+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.425313+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:18.067509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"133'56","reported_seq":389,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:15.951045+0000","last_change":"2024-09-10T05:59:15.950881+0000","last_active":"2024-09-10T05:59:15.951045+0000","last_peered":"2024-09-10T05:59:15.951045+0000","last_clean":"2024-09-10T05:59:15.951045+0000","last_became_active":"2024-09-10T05:58:36.073108+0000","last_became_peered":"2024-09-10T05:58:36.073108+0000","last_unstale":"2024-09-10T05:59:15.951045+0000","last_undegraded":"2024-09-10T05:59:15.951045+0000","last_fullsized":"2024-09-10T05:59:15.951045+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'56","last_scrub_stamp":"2024-09-10T05:59:15.950679+0000","last_deep_scrub":"133'56","last_deep_scrub_stamp":"2024-09-10T05:59:15.950679+0000","last_clean_scrub_stamp":"2024-09-10T05:59:15.950679+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:18.246035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":146800640,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":52,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:33.021789+0000","last_change":"2024-09-10T05:59:33.021789+0000","last_active":"2024-09-10T05:59:33.021789+0000","last_peered":"2024-09-10T05:59:33.021789+0000","last_clean":"2024-09-10T05:59:33.021789+0000","last_became_active":"2024-09-10T05:58:36.072068+0000","last_became_peered":"2024-09-10T05:58:36.072068+0000","last_unstale":"2024-09-10T05:59:33.021789+0000","last_undegraded":"2024-09-10T05:59:33.021789+0000","last_fullsized":"2024-09-10T05:59:33.021789+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:33.021597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:33.021597+0000","last_clean_scrub_stamp":"2024-09-10T05:59:33.021597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:03.671499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"133'38","reported_seq":273,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:20.629776+0000","last_change":"2024-09-10T05:59:20.629600+0000","last_active":"2024-09-10T05:59:20.629776+0000","last_peered":"2024-09-10T05:59:20.629776+0000","last_clean":"2024-09-10T05:59:20.629776+0000","last_became_active":"2024-09-10T05:55:22.577863+0000","last_became_peered":"2024-09-10T05:55:22.577863+0000","last_unstale":"2024-09-10T05:59:20.629776+0000","last_undegraded":"2024-09-10T05:59:20.629776+0000","last_fullsized":"2024-09-10T05:59:20.629776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'38","last_scrub_stamp":"2024-09-10T05:59:20.629379+0000","last_deep_scrub":"133'38","last_deep_scrub_stamp":"2024-09-10T05:59:20.629379+0000","last_clean_scrub_stamp":"2024-09-10T05:59:20.629379+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:28.096617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:25.553060+0000","last_change":"2024-09-10T05:59:25.552815+0000","last_active":"2024-09-10T05:59:25.553060+0000","last_peered":"2024-09-10T05:59:25.553060+0000","last_clean":"2024-09-10T05:59:25.553060+0000","last_became_active":"2024-09-10T05:55:24.575864+0000","last_became_peered":"2024-09-10T05:55:24.575864+0000","last_unstale":"2024-09-10T05:59:25.553060+0000","last_undegraded":"2024-09-10T05:59:25.553060+0000","last_fullsized":"2024-09-10T05:59:25.553060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:25.552579+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:25.552579+0000","last_clean_scrub_stamp":"2024-09-10T05:59:25.552579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:38.929496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"133'42","reported_seq":117,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.995820+0000","last_change":"2024-09-10T05:59:19.995820+0000","last_active":"2024-09-10T05:59:19.995820+0000","last_peered":"2024-09-10T05:59:19.995820+0000","last_clean":"2024-09-10T05:59:19.995820+0000","last_became_active":"2024-09-10T05:58:36.083008+0000","last_became_peered":"2024-09-10T05:58:36.083008+0000","last_unstale":"2024-09-10T05:59:19.995820+0000","last_undegraded":"2024-09-10T05:59:19.995820+0000","last_fullsized":"2024-09-10T05:59:19.995820+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:19.995635+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:19.995635+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.995635+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:24:35.542512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":271,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.155537+0000","last_change":"2024-09-10T05:59:29.155537+0000","last_active":"2024-09-10T05:59:29.155537+0000","last_peered":"2024-09-10T05:59:29.155537+0000","last_clean":"2024-09-10T05:59:29.155537+0000","last_became_active":"2024-09-10T05:58:36.085332+0000","last_became_peered":"2024-09-10T05:58:36.085332+0000","last_unstale":"2024-09-10T05:59:29.155537+0000","last_undegraded":"2024-09-10T05:59:29.155537+0000","last_fullsized":"2024-09-10T05:59:29.155537+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:29.155322+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:29.155322+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.155322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:18.310331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"133'54","reported_seq":378,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.727264+0000","last_change":"2024-09-10T05:59:21.726965+0000","last_active":"2024-09-10T05:59:21.727264+0000","last_peered":"2024-09-10T05:59:21.727264+0000","last_clean":"2024-09-10T05:59:21.727264+0000","last_became_active":"2024-09-10T05:58:36.084939+0000","last_became_peered":"2024-09-10T05:58:36.084939+0000","last_unstale":"2024-09-10T05:59:21.727264+0000","last_undegraded":"2024-09-10T05:59:21.727264+0000","last_fullsized":"2024-09-10T05:59:21.727264+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'54","last_scrub_stamp":"2024-09-10T05:59:21.726738+0000","last_deep_scrub":"133'54","last_deep_scrub_stamp":"2024-09-10T05:59:21.726738+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.726738+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:14.969501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":62,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":121634816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"94'12","reported_seq":268,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.454193+0000","last_change":"2024-09-10T05:59:32.454193+0000","last_active":"2024-09-10T05:59:32.454193+0000","last_peered":"2024-09-10T05:59:32.454193+0000","last_clean":"2024-09-10T05:59:32.454193+0000","last_became_active":"2024-09-10T05:55:24.572787+0000","last_became_peered":"2024-09-10T05:55:24.572787+0000","last_unstale":"2024-09-10T05:59:32.454193+0000","last_undegraded":"2024-09-10T05:59:32.454193+0000","last_fullsized":"2024-09-10T05:59:32.454193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T05:59:32.454003+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T05:59:32.454003+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.454003+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:21.811889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"133'42","reported_seq":117,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.961660+0000","last_change":"2024-09-10T05:59:21.961660+0000","last_active":"2024-09-10T05:59:21.961660+0000","last_peered":"2024-09-10T05:59:21.961660+0000","last_clean":"2024-09-10T05:59:21.961660+0000","last_became_active":"2024-09-10T05:58:36.085013+0000","last_became_peered":"2024-09-10T05:58:36.085013+0000","last_unstale":"2024-09-10T05:59:21.961660+0000","last_undegraded":"2024-09-10T05:59:21.961660+0000","last_fullsized":"2024-09-10T05:59:21.961660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:21.961477+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:21.961477+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.961477+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:44:51.923232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":232,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:24.098876+0000","last_change":"2024-09-10T05:59:24.098740+0000","last_active":"2024-09-10T05:59:24.098876+0000","last_peered":"2024-09-10T05:59:24.098876+0000","last_clean":"2024-09-10T05:59:24.098876+0000","last_became_active":"2024-09-10T05:55:24.570589+0000","last_became_peered":"2024-09-10T05:55:24.570589+0000","last_unstale":"2024-09-10T05:59:24.098876+0000","last_undegraded":"2024-09-10T05:59:24.098876+0000","last_fullsized":"2024-09-10T05:59:24.098876+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:24.098563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:24.098563+0000","last_clean_scrub_stamp":"2024-09-10T05:59:24.098563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:29.274071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"133'66","reported_seq":300,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:22.771457+0000","last_change":"2024-09-10T05:59:22.771457+0000","last_active":"2024-09-10T05:59:22.771457+0000","last_peered":"2024-09-10T05:59:22.771457+0000","last_clean":"2024-09-10T05:59:22.771457+0000","last_became_active":"2024-09-10T05:55:22.578458+0000","last_became_peered":"2024-09-10T05:55:22.578458+0000","last_unstale":"2024-09-10T05:59:22.771457+0000","last_undegraded":"2024-09-10T05:59:22.771457+0000","last_fullsized":"2024-09-10T05:59:22.771457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'66","last_scrub_stamp":"2024-09-10T05:59:22.771156+0000","last_deep_scrub":"133'66","last_deep_scrub_stamp":"2024-09-10T05:59:22.771156+0000","last_clean_scrub_stamp":"2024-09-10T05:59:22.771156+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:19.382437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.389151+0000","last_change":"2024-09-10T05:59:28.388988+0000","last_active":"2024-09-10T05:59:28.389151+0000","last_peered":"2024-09-10T05:59:28.389151+0000","last_clean":"2024-09-10T05:59:28.389151+0000","last_became_active":"2024-09-10T05:55:24.575000+0000","last_became_peered":"2024-09-10T05:55:24.575000+0000","last_unstale":"2024-09-10T05:59:28.389151+0000","last_undegraded":"2024-09-10T05:59:28.389151+0000","last_fullsized":"2024-09-10T05:59:28.389151+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T05:59:28.388786+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T05:59:28.388786+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.388786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:58.111233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"133'36","reported_seq":272,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.094903+0000","last_change":"2024-09-10T05:59:19.094723+0000","last_active":"2024-09-10T05:59:19.094903+0000","last_peered":"2024-09-10T05:59:19.094903+0000","last_clean":"2024-09-10T05:59:19.094903+0000","last_became_active":"2024-09-10T05:55:22.560820+0000","last_became_peered":"2024-09-10T05:55:22.560820+0000","last_unstale":"2024-09-10T05:59:19.094903+0000","last_undegraded":"2024-09-10T05:59:19.094903+0000","last_fullsized":"2024-09-10T05:59:19.094903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'36","last_scrub_stamp":"2024-09-10T05:59:19.094491+0000","last_deep_scrub":"133'36","last_deep_scrub_stamp":"2024-09-10T05:59:19.094491+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.094491+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.499546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"111'4","reported_seq":283,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:28.301219+0000","last_change":"2024-09-10T05:59:28.301219+0000","last_active":"2024-09-10T05:59:28.301219+0000","last_peered":"2024-09-10T05:59:28.301219+0000","last_clean":"2024-09-10T05:59:28.301219+0000","last_became_active":"2024-09-10T05:58:36.083583+0000","last_became_peered":"2024-09-10T05:58:36.083583+0000","last_unstale":"2024-09-10T05:59:28.301219+0000","last_undegraded":"2024-09-10T05:59:28.301219+0000","last_fullsized":"2024-09-10T05:59:28.301219+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'4","last_scrub_stamp":"2024-09-10T05:59:28.301033+0000","last_deep_scrub":"111'4","last_deep_scrub_stamp":"2024-09-10T05:59:28.301033+0000","last_clean_scrub_stamp":"2024-09-10T05:59:28.301033+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:28:11.113069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"133'42","reported_seq":282,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:21.583347+0000","last_change":"2024-09-10T05:59:21.583347+0000","last_active":"2024-09-10T05:59:21.583347+0000","last_peered":"2024-09-10T05:59:21.583347+0000","last_clean":"2024-09-10T05:59:21.583347+0000","last_became_active":"2024-09-10T05:55:58.835151+0000","last_became_peered":"2024-09-10T05:55:58.835151+0000","last_unstale":"2024-09-10T05:59:21.583347+0000","last_undegraded":"2024-09-10T05:59:21.583347+0000","last_fullsized":"2024-09-10T05:59:21.583347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'42","last_scrub_stamp":"2024-09-10T05:59:21.583092+0000","last_deep_scrub":"133'42","last_deep_scrub_stamp":"2024-09-10T05:59:21.583092+0000","last_clean_scrub_stamp":"2024-09-10T05:59:21.583092+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:50:00.386473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"67'4","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:27.164412+0000","last_change":"2024-09-10T05:59:27.164278+0000","last_active":"2024-09-10T05:59:27.164412+0000","last_peered":"2024-09-10T05:59:27.164412+0000","last_clean":"2024-09-10T05:59:27.164412+0000","last_became_active":"2024-09-10T05:55:24.580339+0000","last_became_peered":"2024-09-10T05:55:24.580339+0000","last_unstale":"2024-09-10T05:59:27.164412+0000","last_undegraded":"2024-09-10T05:59:27.164412+0000","last_fullsized":"2024-09-10T05:59:27.164412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:27.164066+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:27.164066+0000","last_clean_scrub_stamp":"2024-09-10T05:59:27.164066+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:05.146906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"133'48","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:29.253540+0000","last_change":"2024-09-10T05:59:29.253540+0000","last_active":"2024-09-10T05:59:29.253540+0000","last_peered":"2024-09-10T05:59:29.253540+0000","last_clean":"2024-09-10T05:59:29.253540+0000","last_became_active":"2024-09-10T05:55:22.573286+0000","last_became_peered":"2024-09-10T05:55:22.573286+0000","last_unstale":"2024-09-10T05:59:29.253540+0000","last_undegraded":"2024-09-10T05:59:29.253540+0000","last_fullsized":"2024-09-10T05:59:29.253540+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'48","last_scrub_stamp":"2024-09-10T05:59:29.253329+0000","last_deep_scrub":"133'48","last_deep_scrub_stamp":"2024-09-10T05:59:29.253329+0000","last_clean_scrub_stamp":"2024-09-10T05:59:29.253329+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:21.358493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":58,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:39.024486+0000","last_change":"2024-09-10T05:59:39.024486+0000","last_active":"2024-09-10T05:59:39.024486+0000","last_peered":"2024-09-10T05:59:39.024486+0000","last_clean":"2024-09-10T05:59:39.024486+0000","last_became_active":"2024-09-10T05:58:36.060340+0000","last_became_peered":"2024-09-10T05:58:36.060340+0000","last_unstale":"2024-09-10T05:59:39.024486+0000","last_undegraded":"2024-09-10T05:59:39.024486+0000","last_fullsized":"2024-09-10T05:59:39.024486+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-09-10T05:59:39.024257+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-09-10T05:59:39.024257+0000","last_clean_scrub_stamp":"2024-09-10T05:59:39.024257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:53.033319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"133'40","reported_seq":275,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:18.133105+0000","last_change":"2024-09-10T05:59:18.133105+0000","last_active":"2024-09-10T05:59:18.133105+0000","last_peered":"2024-09-10T05:59:18.133105+0000","last_clean":"2024-09-10T05:59:18.133105+0000","last_became_active":"2024-09-10T05:55:22.559010+0000","last_became_peered":"2024-09-10T05:55:22.559010+0000","last_unstale":"2024-09-10T05:59:18.133105+0000","last_undegraded":"2024-09-10T05:59:18.133105+0000","last_fullsized":"2024-09-10T05:59:18.133105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'40","last_scrub_stamp":"2024-09-10T05:59:18.132912+0000","last_deep_scrub":"133'40","last_deep_scrub_stamp":"2024-09-10T05:59:18.132912+0000","last_clean_scrub_stamp":"2024-09-10T05:59:18.132912+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:47.899139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":257,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:26.287604+0000","last_change":"2024-09-10T05:59:26.287465+0000","last_active":"2024-09-10T05:59:26.287604+0000","last_peered":"2024-09-10T05:59:26.287604+0000","last_clean":"2024-09-10T05:59:26.287604+0000","last_became_active":"2024-09-10T05:58:36.078688+0000","last_became_peered":"2024-09-10T05:58:36.078688+0000","last_unstale":"2024-09-10T05:59:26.287604+0000","last_undegraded":"2024-09-10T05:59:26.287604+0000","last_fullsized":"2024-09-10T05:59:26.287604+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T05:59:26.287277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T05:59:26.287277+0000","last_clean_scrub_stamp":"2024-09-10T05:59:26.287277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:08.927353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"133'50","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:23.817941+0000","last_change":"2024-09-10T05:59:23.817941+0000","last_active":"2024-09-10T05:59:23.817941+0000","last_peered":"2024-09-10T05:59:23.817941+0000","last_clean":"2024-09-10T05:59:23.817941+0000","last_became_active":"2024-09-10T05:55:22.569378+0000","last_became_peered":"2024-09-10T05:55:22.569378+0000","last_unstale":"2024-09-10T05:59:23.817941+0000","last_undegraded":"2024-09-10T05:59:23.817941+0000","last_fullsized":"2024-09-10T05:59:23.817941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'50","last_scrub_stamp":"2024-09-10T05:59:23.817761+0000","last_deep_scrub":"133'50","last_deep_scrub_stamp":"2024-09-10T05:59:23.817761+0000","last_clean_scrub_stamp":"2024-09-10T05:59:23.817761+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:48.642303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"133'48","reported_seq":192,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.096374+0000","last_change":"2024-09-10T05:59:19.096078+0000","last_active":"2024-09-10T05:59:19.096374+0000","last_peered":"2024-09-10T05:59:19.096374+0000","last_clean":"2024-09-10T05:59:19.096374+0000","last_became_active":"2024-09-10T05:56:59.842450+0000","last_became_peered":"2024-09-10T05:56:59.842450+0000","last_unstale":"2024-09-10T05:59:19.096374+0000","last_undegraded":"2024-09-10T05:59:19.096374+0000","last_fullsized":"2024-09-10T05:59:19.096374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'48","last_scrub_stamp":"2024-09-10T05:59:19.095788+0000","last_deep_scrub":"133'48","last_deep_scrub_stamp":"2024-09-10T05:59:19.095788+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.095788+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:40.566520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"103'4","reported_seq":287,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:32.111276+0000","last_change":"2024-09-10T05:59:32.111276+0000","last_active":"2024-09-10T05:59:32.111276+0000","last_peered":"2024-09-10T05:59:32.111276+0000","last_clean":"2024-09-10T05:59:32.111276+0000","last_became_active":"2024-09-10T05:58:36.084900+0000","last_became_peered":"2024-09-10T05:58:36.084900+0000","last_unstale":"2024-09-10T05:59:32.111276+0000","last_undegraded":"2024-09-10T05:59:32.111276+0000","last_fullsized":"2024-09-10T05:59:32.111276+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'4","last_scrub_stamp":"2024-09-10T05:59:32.110974+0000","last_deep_scrub":"103'4","last_deep_scrub_stamp":"2024-09-10T05:59:32.110974+0000","last_clean_scrub_stamp":"2024-09-10T05:59:32.110974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:27.071303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"133'46","reported_seq":280,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:19.958937+0000","last_change":"2024-09-10T05:59:19.958937+0000","last_active":"2024-09-10T05:59:19.958937+0000","last_peered":"2024-09-10T05:59:19.958937+0000","last_clean":"2024-09-10T05:59:19.958937+0000","last_became_active":"2024-09-10T05:55:22.564238+0000","last_became_peered":"2024-09-10T05:55:22.564238+0000","last_unstale":"2024-09-10T05:59:19.958937+0000","last_undegraded":"2024-09-10T05:59:19.958937+0000","last_fullsized":"2024-09-10T05:59:19.958937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"133'46","last_scrub_stamp":"2024-09-10T05:59:19.958755+0000","last_deep_scrub":"133'46","last_deep_scrub_stamp":"2024-09-10T05:59:19.958755+0000","last_clean_scrub_stamp":"2024-09-10T05:59:19.958755+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.314013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"67'4","reported_seq":247,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T05:59:30.728513+0000","last_change":"2024-09-10T05:59:30.728513+0000","last_active":"2024-09-10T05:59:30.728513+0000","last_peered":"2024-09-10T05:59:30.728513+0000","last_clean":"2024-09-10T05:59:30.728513+0000","last_became_active":"2024-09-10T05:55:24.558545+0000","last_became_peered":"2024-09-10T05:55:24.558545+0000","last_unstale":"2024-09-10T05:59:30.728513+0000","last_undegraded":"2024-09-10T05:59:30.728513+0000","last_fullsized":"2024-09-10T05:59:30.728513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T05:59:30.728323+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T05:59:30.728323+0000","last_clean_scrub_stamp":"2024-09-10T05:59:30.728323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:24.713658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":359,"num_read_kb":339,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1405,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1122,"ondisk_log_size":1122,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":211,"num_object_clones":0,"num_object_copies":422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":211,"num_whiteouts":0,"num_read":1348,"num_read_kb":1798,"num_write":733,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":63332,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1255,"ondisk_log_size":1255,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3972,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1432,"num_read_kb":1400,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3088,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":544,"num_bytes_recovered":2262827008,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37524,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334316,"statfs":{"total":96636764160,"available":96598339584,"internally_reserved":0,"allocated":2232320,"data_stored":1535013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509502,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1617920,"data_stored":944421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36972,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334868,"statfs":{"total":96636764160,"available":96598904832,"internally_reserved":0,"allocated":1667072,"data_stored":944843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542206,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":1605632,"data_stored":944476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36948,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334892,"statfs":{"total":96636764160,"available":96598929408,"internally_reserved":0,"allocated":1642496,"data_stored":945777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542207,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41068,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330772,"statfs":{"total":96636764160,"available":96594710528,"internally_reserved":0,"allocated":1601536,"data_stored":943547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542206,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41104,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330736,"statfs":{"total":96636764160,"available":96594673664,"internally_reserved":0,"allocated":1638400,"data_stored":944646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542206,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41668,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330172,"statfs":{"total":96636764160,"available":96594096128,"internally_reserved":0,"allocated":2215936,"data_stored":1534855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T05:59:56.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T05:59:56.892 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T05:59:56.892 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T05:59:56.892 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T05:59:56.892 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:59:56.960 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T05:59:56.960 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T05:59:56.960 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:59:57.036 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T05:59:57.036 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T05:59:57.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:59:57.125 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T05:59:57.125 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T05:59:57.125 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T05:59:59.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-10T06:00:03.227 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T06:00:03.227 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T06:00:03.227 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:03.293 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T06:00:03.293 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T06:00:03.293 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:04.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-10T06:00:04.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-10T06:00:09.395 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T06:00:09.396 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T06:00:09.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:09.454 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T06:00:09.454 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T06:00:09.454 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:09.532 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T06:00:09.532 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T06:00:09.533 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T06:00:09.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:09.561 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T06:00:09.561 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T06:00:09.561 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:09.592 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T06:00:09.592 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T06:00:09.593 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T06:00:09.593 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:09.623 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T06:00:09.623 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T06:00:09.623 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:09.681 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T06:00:09.681 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T06:00:09.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:00:09.697 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T06:00:09.697 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T06:00:09.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-10T06:00:09.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T06:00:09.744 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T06:00:09.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-10T06:00:10.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T06:00:10.034 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T06:00:10.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T06:00:10.303 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T06:00:10.506 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T06:00:10.506 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T06:00:10.683 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T06:00:10.683 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T06:00:11.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T06:00:11.208 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T06:00:11.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T06:00:11.437 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T06:00:11.636 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T06:00:11.637 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T06:00:11.839 INFO:tasks.ceph:Archiving mon data... 2024-09-10T06:00:11.840 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/data/mon.a.tgz 2024-09-10T06:00:11.841 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-10T06:00:11.847 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.N7GkcjccaV 2024-09-10T06:00:11.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.N7GkcjccaV 2024-09-10T06:00:12.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.N7GkcjccaV 2024-09-10T06:00:12.095 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.N7GkcjccaV is 629KB 2024-09-10T06:00:12.163 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.N7GkcjccaV 2024-09-10T06:00:12.168 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/data/mon.c.tgz 2024-09-10T06:00:12.168 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-10T06:00:12.215 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.RIcBdkTMUf 2024-09-10T06:00:12.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RIcBdkTMUf 2024-09-10T06:00:12.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.RIcBdkTMUf 2024-09-10T06:00:12.507 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.RIcBdkTMUf is 802KB 2024-09-10T06:00:12.569 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.RIcBdkTMUf 2024-09-10T06:00:12.577 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/data/mon.b.tgz 2024-09-10T06:00:12.577 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-10T06:00:12.583 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.7EU95RMU70 2024-09-10T06:00:12.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7EU95RMU70 2024-09-10T06:00:12.817 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.7EU95RMU70 2024-09-10T06:00:12.879 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.7EU95RMU70 is 802KB 2024-09-10T06:00:12.949 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.7EU95RMU70 2024-09-10T06:00:12.955 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T06:00:12.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T06:00:12.958 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T06:00:13.018 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T06:00:13.059 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T06:00:13.059 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T06:00:13.061 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/remote/smithi070/crash 2024-09-10T06:00:13.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T06:00:13.076 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/remote/smithi098/crash 2024-09-10T06:00:13.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T06:00:13.114 INFO:tasks.ceph:Compressing logs... 2024-09-10T06:00:13.114 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T06:00:13.124 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T06:00:13.148 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66023.log 2024-09-10T06:00:13.149 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56684.log 2024-09-10T06:00:13.149 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66023.log.gz 2024-09-10T06:00:13.149 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67385.log 2024-09-10T06:00:13.149 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56684.log.gz 2024-09-10T06:00:13.149 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66231.log 2024-09-10T06:00:13.150 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30640.log 2024-09-10T06:00:13.150 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67385.log: /var/log/ceph/ceph-client.admin.66231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66231.log.gz 2024-09-10T06:00:13.150 INFO:teuthology.orchestra.run.smithi070.stderr:gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.67385.log.gz -- 2024-09-10T06:00:13.150 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.57083.log 2024-09-10T06:00:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-10T06:00:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30640.log.gz 2024-09-10T06:00:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57083.log.gz 2024-09-10T06:00:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33576.log 2024-09-10T06:00:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30920.log 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31346.log 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33576.log.gz 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr: 87.7% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30920.log.gz 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42990.log 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34056.log 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31346.log.gz 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42990.log.gz 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58764.log 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.34056.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33965.log 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34056.log.gz 2024-09-10T06:00:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33800.log 2024-09-10T06:00:13.156 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58764.log.gz 2024-09-10T06:00:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33965.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33965.log.gz 2024-09-10T06:00:13.156 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-mgr.y.log 2024-09-10T06:00:13.161 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31550.log 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33800.log.gz 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26496.log 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31550.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31550.log.gz -5 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34404.log 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60548.log 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26496.log.gz 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32356.log 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34404.log.gz 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57344.log 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60548.log.gz 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32356.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32356.log.gz 2024-09-10T06:00:13.162 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.67904.log 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57344.log.gz 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57288.log 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67749.log 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67904.log.gz 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33511.log 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57288.log.gz 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34120.log 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67749.log.gz 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33511.log: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65542.log 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33511.log.gz 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52731.log 2024-09-10T06:00:13.163 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34120.log.gz 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58671.log 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65542.log.gz 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67333.log 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52731.log.gz 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56833.log 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58671.log.gz 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67333.log.gz 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30717.log 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56833.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56833.log.gz 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67880.log 2024-09-10T06:00:13.164 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30717.log.gz 2024-09-10T06:00:13.178 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34785.log 2024-09-10T06:00:13.178 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67880.log.gz 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32502.log 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.34785.log: /var/log/ceph/ceph-client.admin.31337.log 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34785.log.gz 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32502.log.gz 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31600.log 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30713.log 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31337.log.gz 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33168.log 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31600.log.gz 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52638.log 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30713.log.gz 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32731.log 2024-09-10T06:00:13.179 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33168.log.gz 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52638.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21457.log 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52638.log.gz 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32731.log.gz 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.21457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66634.log 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21457.log.gz 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53620.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.65854.log 2024-09-10T06:00:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66634.log.gz 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34304.log 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65854.log.gz 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34304.log.gz 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54294.log 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53912.log 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66246.log 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54294.log.gz 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53912.log.gz 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58622.log 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30902.log 2024-09-10T06:00:13.181 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66246.log.gz 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52847.log 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58622.log.gz 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30588.log 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30902.log.gz 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34825.log 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52847.log.gz 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30907.log 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30588.log.gz 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67463.log 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34825.log.gz 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30907.log.gz 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31119.log 2024-09-10T06:00:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66245.log 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67463.log.gz 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.31119.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35034.log 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31119.log.gz 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38792.log 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66245.log.gz 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.35034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30908.log 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35034.log.gz 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66437.log 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38792.log.gz 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48954.log 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30908.log.gz 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67671.log 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66437.log.gz 2024-09-10T06:00:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66444.log 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48954.log.gz 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32689.log 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67671.log.gz 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67307.log 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66444.log.gz 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32689.log.gz 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57178.log 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67307.log.gz 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67854.log 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2024-09-10T06:00:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61540.log 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57178.log.gz 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33703.log 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67854.log.gz 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65698.log 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61540.log.gz 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33703.log: /var/log/ceph/ceph-client.admin.65932.log 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33703.log.gz 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65698.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65698.log.gz 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64654.log 2024-09-10T06:00:13.185 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65932.log.gz 2024-09-10T06:00:13.194 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26306.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26306.log.gz 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26450.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26282.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.26450.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26450.log.gz 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26354.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26282.log.gz 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26354.log: gzip -5 0.0% --verbose -- /var/log/ceph/ceph.log -- replaced with /var/log/ceph/ceph-client.admin.26354.log.gz 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-10T06:00:13.195 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26378.log 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26330.log 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26378.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26378.log.gz 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26426.log 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26330.log.gz 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.26426.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26426.log.gz 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.b.log: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26402.log 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.26402.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T06:00:13.196 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26402.log.gz 2024-09-10T06:00:13.220 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61685.log 2024-09-10T06:00:13.220 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64431.log 2024-09-10T06:00:13.220 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64654.log.gz 2024-09-10T06:00:13.220 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61685.log.gz 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60825.log 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64431.log.gz 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66232.log 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34459.log 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60825.log.gz 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66232.log.gz 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61800.log 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31136.log 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34459.log.gz 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61800.log.gz 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31320.log 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58440.log 2024-09-10T06:00:13.221 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31136.log.gz 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31320.log.gz 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31576.log 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30915.log 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58440.log.gz 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31576.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31576.log.gz 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30915.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30915.log.gz 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.46594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33481.log 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30708.log 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33481.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.33481.log.gz -- 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.54114.log 2024-09-10T06:00:13.222 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30708.log.gz 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32986.log 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66452.log 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54114.log.gz 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32986.log.gz 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35812.log 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63201.log 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66452.log.gz 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.35812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35812.log.gz 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32464.log 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63201.log.gz 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52612.log 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60700.log 2024-09-10T06:00:13.223 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32464.log.gz 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31112.log 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52612.log.gz 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60700.log.gz 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57318.log 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31676.log 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31112.log.gz 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57318.log.gz 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67411.log 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31676.log.gz 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66035.log 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5/var/log/ceph/ceph-client.admin.67411.log: --verbose -- /var/log/ceph/ceph-client.admin.65958.log 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67411.log.gz 2024-09-10T06:00:13.224 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66035.log.gz 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32508.log 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65958.log.gz 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32508.log.gz 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67567.log 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30614.log 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.67567.log: -- /var/log/ceph/ceph-client.admin.66454.log 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67567.log.gz 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49544.log 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30614.log.gz 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66454.log.gz 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61606.log 2024-09-10T06:00:13.225 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65802.log 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.49544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49544.log.gz 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61606.log.gz 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38194.log 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65802.log.gz 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26249.log 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38194.log.gz 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67541.log 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26249.log.gz 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67515.log 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34706.log 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67541.log.gz 2024-09-10T06:00:13.226 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67515.log.gz 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30710.log 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34706.log.gz 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30710.log.gz 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53657.log 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66032.log 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53657.log.gz 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42395.log 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30543.log 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66032.log.gz 2024-09-10T06:00:13.227 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42395.log.gz 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53871.log 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58480.log 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30543.log.gz 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33876.log 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53871.log.gz 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58480.log.gz 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52946.log 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32882.log 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33876.log.gz 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52946.log.gz 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57578.log 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65984.log 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32882.log.gz 2024-09-10T06:00:13.228 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57578.log.gz 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61867.log 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53776.log 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65984.log.gz 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61867.log.gz 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57058.log 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63791.log 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53776.log.gz 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57058.log.gz 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64391.log 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.63791.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63791.log.gz 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64391.log.gz 2024-09-10T06:00:13.229 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30568.log 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65433.log 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.30568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30568.log.gz 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60888.log 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57006.log 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65433.log.gz 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60888.log.gz 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41796.log 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30926.log 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57006.log.gz 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.41796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61502.log 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41796.log.gz 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30926.log.gz 2024-09-10T06:00:13.230 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66038.log 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34237.log 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61502.log.gz 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33671.log 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66038.log.gz 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67619.log 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34237.log.gz 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33671.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33671.log.gz -5 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67593.log 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67619.log.gz 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65880.log 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67593.log.gz 2024-09-10T06:00:13.231 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34641.log 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65880.log.gz 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55491.log 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66686.log 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34641.log.gz 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67489.log 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55491.log.gz 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65646.log 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66686.log.gz 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67489.log.gz 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33440.log 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53723.log 2024-09-10T06:00:13.232 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65646.log.gz 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33440.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33440.log.gz -5 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30928.log 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr:gzip/var/log/ceph/ceph-client.admin.53723.log: -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53723.log.gz 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35197.log 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30928.log.gz 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67697.log 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.35197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59952.log 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35197.log.gz 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64498.log 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67697.log.gz 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66029.log 2024-09-10T06:00:13.233 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59952.log.gz 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64498.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.64498.log.gz 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr: /var/log/ceph/ceph-client.admin.30719.log 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60886.log 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66029.log.gz 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33230.log 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30719.log.gz 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60886.log.gz 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32503.log 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65828.log 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33230.log.gz 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56771.log 2024-09-10T06:00:13.234 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32503.log.gz 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65828.log.gz 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56097.log 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33142.log 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56771.log.gz 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56097.log.gz 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64759.log 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33142.log.gz 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51417.log 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2024-09-10T06:00:13.235 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64759.log.gz 2024-09-10T06:00:13.252 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33015.log 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.51417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31340.log 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51417.log.gz 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34900.log 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33015.log.gz 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30720.log 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31340.log.gz 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32916.log 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34900.log.gz 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34924.log 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30720.log.gz/var/log/ceph/ceph-client.admin.32916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45375.log 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32916.log.gz 2024-09-10T06:00:13.253 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34924.log.gz 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66714.log 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45375.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.66714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34985.log 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66714.log.gz 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33081.log 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.34985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59358.log 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34985.log.gz 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33081.log.gz 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52011.log 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.59358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53961.log 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59358.log.gz 2024-09-10T06:00:13.254 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52011.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31338.log 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61841.log 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53961.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31338.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53802.log 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65594.log 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61841.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58713.log 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53802.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65511.log 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65594.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58713.log.gz 2024-09-10T06:00:13.255 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66033.log 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64737.log 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65511.log.gz 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66033.log.gz 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33879.log 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64539.log 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64737.log.gz 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32648.log 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33879.log.gz 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64539.log.gz 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31128.log 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34263.log 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32648.log.gz 2024-09-10T06:00:13.256 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60573.log 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31128.log.gz 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34263.log.gz 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58280.log 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57503.log 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60573.log.gz 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67359.log 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58280.log.gz 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35131.log 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57503.log.gz 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67359.log.gz 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64679.log 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.35131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66660.log 2024-09-10T06:00:13.257 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35131.log.gz 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31650.log 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64679.log.gz 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66660.log.gz 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45997.log 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36403.log 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31650.log.gz 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.45997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33833.log 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45997.log.gz 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.36403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36403.log.gz 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52664.log 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65672.log 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33833.log.gz 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52664.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52664.log.gz -5 2024-09-10T06:00:13.258 INFO:teuthology.orchestra.run.smithi070.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66034.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65672.log.gz 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48364.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66034.log.gz 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57237.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60651.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.48364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48364.log.gz 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57237.log.gz 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32434.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31626.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60651.log.gz 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32434.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56923.log 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.259 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31626.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66238.log 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31626.log.gz 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31135.log 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56923.log.gz/var/log/ceph/ceph-client.admin.66238.log: 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66238.log.gz 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57179.log 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54217.log 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31135.log.gz 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30666.log 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57179.log.gz 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54217.log.gz 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65485.log 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30714.log 2024-09-10T06:00:13.260 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30666.log.gz 2024-09-10T06:00:13.261 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65485.log.gz 2024-09-10T06:00:13.261 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42988.log 2024-09-10T06:00:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30709.log 2024-09-10T06:00:13.271 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30714.log.gz 2024-09-10T06:00:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.42988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30518.log 2024-09-10T06:00:13.271 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42988.log.gz 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30709.log.gz 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53962.log 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32830.log 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30518.log.gz 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53962.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31111.log 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53962.log.gz 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58523.log 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32830.log.gz/var/log/ceph/ceph-client.admin.31111.log: 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31111.log.gz 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58587.log 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58523.log.gz 2024-09-10T06:00:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58587.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31334.log 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 92.1% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30456.log 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61952.log 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31334.log.gz 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30456.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26396.log 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30456.log.gz 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61952.log.gz 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50755.log 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.26396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26396.log.gz 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50755.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50751.log 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50755.log.gz 2024-09-10T06:00:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57128.log 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66453.log 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50751.log.gz 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30916.log 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57128.log.gz 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66453.log.gz 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61981.log 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54073.log 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30916.log.gz 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67827.log 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61981.log.gz 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65776.log 2024-09-10T06:00:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54073.log: /var/log/ceph/ceph-client.admin.67827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54073.log.gz 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67827.log.gz 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66224.log 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37000.log 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65776.log: /var/log/ceph/ceph-client.admin.66224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65776.log.gz 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66224.log.gz 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47774.log 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64733.log 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.37000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37000.log.gz 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.47774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47774.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32796.log 2024-09-10T06:00:13.275 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64733.log.gz 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66426.log 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32796.log: /var/log/ceph/ceph-client.admin.66426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32796.log.gz 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66426.log.gz 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57370.log 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35221.log 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57370.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57370.log.gz 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.35221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35221.log.gz 2024-09-10T06:00:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65750.log 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54140.log 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31524.log: /var/log/ceph/ceph-client.admin.65750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65750.log.gz 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57374.log 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60730.log 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.54140.log: /var/log/ceph/ceph-client.admin.57374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54140.log.gz 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57374.log.gz 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34052.log 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39411.log 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60730.log: /var/log/ceph/ceph-client.admin.34052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60730.log.gz 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34052.log.gz 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52785.log 2024-09-10T06:00:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33753.log 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.39411.log: /var/log/ceph/ceph-client.admin.52785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39411.log.gz 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52785.log.gz 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52942.log 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33753.log: /var/log/ceph/ceph-client.admin.43600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33753.log.gz 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52668.log 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52942.log.gz 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52668.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32382.log 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.284 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.44781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2024-09-10T06:00:13.289 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33969.log 2024-09-10T06:00:13.289 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32408.log 2024-09-10T06:00:13.289 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32382.log: /var/log/ceph/ceph-client.admin.33969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32382.log.gz 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33969.log.gz 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65620.log 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61630.log 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.32408.log: /var/log/ceph/ceph-client.admin.65620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32408.log.gz 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65620.log.gz 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67775.log 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31316.log 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61630.log: /var/log/ceph/ceph-client.admin.67775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61630.log.gz 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67775.log.gz 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67645.log 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56868.log 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31316.log.gz 2024-09-10T06:00:13.290 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67645.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65459.log 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67645.log.gz 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56868.log.gz 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66218.log 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66237.log 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65459.log: /var/log/ceph/ceph-client.admin.66218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65459.log.gz 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66218.log.gz 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62021.log 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64581.log 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66237.log.gz 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62021.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61730.log 2024-09-10T06:00:13.291 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.292 INFO:teuthology.orchestra.run.smithi098.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.64581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64581.log.gz 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66451.log 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66448.log 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.61730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61730.log.gz 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66451.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66037.log 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66451.log.gz 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66448.log.gz 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53027.log 2024-09-10T06:00:13.296 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58325.log 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.66037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66037.log.gz 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.53027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53027.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52872.log 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58325.log.gz 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40013.log 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67437.log 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.52872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52872.log.gz 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40013.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67801.log 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40013.log.gz 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67437.log.gz 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38738.log 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57010.log 2024-09-10T06:00:13.297 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.67801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67801.log.gz 2024-09-10T06:00:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.38738.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33325.log 2024-09-10T06:00:13.301 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38738.log.gz 2024-09-10T06:00:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57010.log.gz 2024-09-10T06:00:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57622.log 2024-09-10T06:00:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57388.log 2024-09-10T06:00:13.301 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33325.log.gz 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57622.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65568.log 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57388.log.gz 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31339.log 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58358.log 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65568.log: /var/log/ceph/ceph-client.admin.31339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65568.log.gz 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31339.log.gz 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47184.log 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33927.log 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58358.log: /var/log/ceph/ceph-client.admin.47184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58358.log.gz 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47184.log.gz 2024-09-10T06:00:13.302 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56792.log 2024-09-10T06:00:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2024-09-10T06:00:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33927.log.gz 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56792.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31126.log 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.50134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67723.log 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57552.log 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.31126.log: /var/log/ceph/ceph-client.admin.67723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31126.log.gz 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67723.log.gz 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58234.log 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65724.log 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.57552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57552.log.gz 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.58234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58234.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56922.log 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65724.log.gz 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34562.log 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60775.log 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.56922.log: /var/log/ceph/ceph-client.admin.34562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56922.log.gz 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gz 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65906.log 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.60775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60775.log.gz 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45376.log 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62611.log 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.65906.log: /var/log/ceph/ceph-client.admin.45376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65906.log.gz 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45376.log.gz 2024-09-10T06:00:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34492.log 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.62611.log: /var/log/ceph/ceph-client.admin.34492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62611.log.gz 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34492.log.gz 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31127.log 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55417.log 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.40612.log: /var/log/ceph/ceph-client.admin.31127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31127.log.gz 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33622.log 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34603.log 2024-09-10T06:00:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.55417.log: /var/log/ceph/ceph-client.admin.33622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55417.log.gz 2024-09-10T06:00:13.313 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33622.log.gz 2024-09-10T06:00:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34144.log 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34187.log 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34603.log: /var/log/ceph/ceph-client.admin.34144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34603.log.gz 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34144.log.gz 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41202.log 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33349.log 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.34187.log: /var/log/ceph/ceph-client.admin.41202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34187.log.gz 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41202.log.gz 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54255.log 2024-09-10T06:00:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.33349.log: /var/log/ceph/ceph-client.admin.54255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33349.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54255.log.gz 2024-09-10T06:00:13.316 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:13.390 INFO:teuthology.orchestra.run.smithi098.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T06:00:13.460 INFO:teuthology.orchestra.run.smithi070.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T06:00:13.544 INFO:teuthology.orchestra.run.smithi070.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T06:00:13.986 INFO:teuthology.orchestra.run.smithi098.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T06:00:14.007 INFO:teuthology.orchestra.run.smithi070.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T06:00:14.073 INFO:teuthology.orchestra.run.smithi098.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T06:00:14.111 INFO:teuthology.orchestra.run.smithi070.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T06:00:14.142 INFO:teuthology.orchestra.run.smithi098.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T06:00:14.163 INFO:teuthology.orchestra.run.smithi070.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T06:00:14.223 INFO:teuthology.orchestra.run.smithi098.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T06:00:14.224 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-10T06:00:14.224 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m1.056s 2024-09-10T06:00:14.225 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m3.849s 2024-09-10T06:00:14.225 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.172s 2024-09-10T06:00:14.370 INFO:teuthology.orchestra.run.smithi070.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T06:00:14.371 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-10T06:00:14.371 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m1.245s 2024-09-10T06:00:14.371 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m4.538s 2024-09-10T06:00:14.371 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.279s 2024-09-10T06:00:14.372 INFO:tasks.ceph:Archiving logs... 2024-09-10T06:00:14.372 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/remote/smithi070/log 2024-09-10T06:00:14.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T06:00:15.172 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/remote/smithi098/log 2024-09-10T06:00:15.173 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T06:00:15.644 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T06:00:15.653 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T06:00:15.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T06:00:15.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T06:00:15.732 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T06:00:15.741 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T06:00:15.742 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:00:15.744 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:00:15.753 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:00:15.754 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-10T06:00:15.754 INFO:teuthology.orchestra.run.smithi070.stdout:+hv01.front.sepi 67.205.162.81 3 u - 64 377 0.117 -1.728 1.224 2024-09-10T06:00:15.754 INFO:teuthology.orchestra.run.smithi070.stdout:*hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.132 -1.645 1.268 2024-09-10T06:00:15.754 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.083 -1.265 1.343 2024-09-10T06:00:15.754 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:00:15.756 INFO:teuthology.orchestra.run.smithi098.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:00:15.756 INFO:teuthology.orchestra.run.smithi098.stdout:============================================================================== 2024-09-10T06:00:15.756 INFO:teuthology.orchestra.run.smithi098.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.064 -1.536 0.771 2024-09-10T06:00:15.757 INFO:teuthology.orchestra.run.smithi098.stdout:+hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.079 -0.193 0.667 2024-09-10T06:00:15.757 INFO:teuthology.orchestra.run.smithi098.stdout:*hv03.front.sepi 74.6.168.72 3 u 15 64 377 0.092 -0.044 0.573 2024-09-10T06:00:15.757 INFO:teuthology.orchestra.run.smithi098.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:00:15.758 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T06:00:15.776 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T06:00:15.777 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T06:00:15.827 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T06:00:15.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T06:00:15.927 INFO:teuthology.task.internal:Duration was 923.439944 seconds 2024-09-10T06:00:15.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T06:00:15.978 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T06:00:15.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T06:00:15.980 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T06:00:16.018 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T06:00:16.018 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-10T06:00:16.018 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T06:00:16.068 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-10T06:00:16.068 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T06:00:16.079 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T06:00:16.079 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T06:00:16.112 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T06:00:16.149 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T06:00:16.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T06:00:16.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T06:00:16.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T06:00:16.272 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T06:00:16.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T06:00:16.283 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T06:00:16.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T06:00:16.311 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:00:16.332 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:00:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-10T06:00:16.348 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-10T06:00:16.371 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:00:16.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:00:16.399 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:00:16.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:00:16.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T06:00:16.427 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T06:00:16.428 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/remote/smithi070 2024-09-10T06:00:16.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T06:00:16.462 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898747/remote/smithi098 2024-09-10T06:00:16.463 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T06:00:16.485 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T06:00:16.485 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T06:00:16.504 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T06:00:16.527 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T06:00:16.536 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T06:00:16.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T06:00:16.578 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T06:00:16.578 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T06:00:16.580 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T06:00:16.583 INFO:teuthology.orchestra.run.smithi070.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 06:00 /home/ubuntu/cephtest 2024-09-10T06:00:16.587 INFO:teuthology.orchestra.run.smithi098.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 06:00 /home/ubuntu/cephtest 2024-09-10T06:00:16.588 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T06:00:16.629 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T06:00:16.731 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 923.4399435520172 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-10T06:00:16.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T06:00:16.797 INFO:teuthology.run:pass